Nov 15 04:09:57 user nova-compute[74805]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74805) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 04:09:57 user nova-compute[74805]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74805) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 04:09:57 user nova-compute[74805]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74805) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 04:09:57 user nova-compute[74805]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:09:58 user nova-compute[74805]: INFO nova.virt.driver [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 15 04:09:58 user nova-compute[74805]: INFO nova.compute.provider_config [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] Acquiring lock "singleton_lock" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] Acquired lock "singleton_lock" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] Releasing lock "singleton_lock" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] Full set of CONF: {{(pid=74805) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ******************************************************************************** {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] Configuration options gathered from: {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ================================================================================ {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] allow_resize_to_same_host      = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] arq_binding_timeout            = 300 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] backdoor_port                  = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] backdoor_socket                = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] block_device_allocate_retries  = 300 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] block_device_allocate_retries_interval = 5 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cert                           = self.pem {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] compute_monitors               = [] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] config_dir                     = [] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] config_drive_format            = iso9660 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] config_source                  = [] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] console_host                   = user {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] control_exchange               = nova {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cpu_allocation_ratio           = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] daemon                         = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] debug                          = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] default_access_ip_network_name = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] default_availability_zone      = nova {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] default_ephemeral_format       = ext4 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] default_green_pool_size        = 1000 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] default_schedule_zone          = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] disk_allocation_ratio          = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] enable_new_services            = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] enabled_ssl_apis               = [] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] flat_injected                  = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] force_config_drive             = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] force_raw_images               = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] graceful_shutdown_timeout      = 5 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] heal_instance_info_cache_interval = 60 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] host                           = user {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] instance_build_timeout         = 0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] instance_delete_interval       = 300 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] instance_name_template         = instance-%08x {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] instance_usage_audit           = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] instance_usage_audit_period    = month {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] internal_service_availability_zone = internal {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] key                            = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] live_migration_retry_count     = 30 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] log_config_append              = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] log_dir                        = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] log_file                       = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] log_options                    = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] log_rotate_interval            = 1 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] log_rotate_interval_type       = days {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] log_rotation_type              = none {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] long_rpc_timeout               = 1800 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] max_concurrent_builds          = 10 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] max_concurrent_live_migrations = 1 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] max_concurrent_snapshots       = 5 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] max_local_block_devices        = 3 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] max_logfile_count              = 30 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] max_logfile_size_mb            = 200 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] maximum_instance_delete_attempts = 5 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] metadata_listen                = 0.0.0.0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] metadata_listen_port           = 8775 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] metadata_workers               = 3 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] migrate_max_retries            = -1 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] mkisofs_cmd                    = genisoimage {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] my_ip                          = 10.0.0.210 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] network_allocate_retries       = 0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] osapi_compute_listen_port      = 8774 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] osapi_compute_unique_server_name_scope =  {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] osapi_compute_workers          = 3 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] password_length                = 12 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] periodic_enable                = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] periodic_fuzzy_delay           = 60 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] pointer_model                  = ps2mouse {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] preallocate_images             = none {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] publish_errors                 = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] pybasedir                      = /opt/stack/nova {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ram_allocation_ratio           = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] rate_limit_burst               = 0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] rate_limit_except_level        = CRITICAL {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] rate_limit_interval            = 0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] reboot_timeout                 = 0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] reclaim_instance_interval      = 0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] record                         = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] reimage_timeout_per_gb         = 60 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] report_interval                = 120 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] rescue_timeout                 = 0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] reserved_host_cpus             = 0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] reserved_host_disk_mb          = 0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] reserved_host_memory_mb        = 512 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] reserved_huge_pages            = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] resize_confirm_window          = 0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] resize_fs_using_block_device   = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] resume_guests_state_on_host_boot = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] rpc_response_timeout           = 60 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] run_external_periodic_tasks    = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] running_deleted_instance_action = reap {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] running_deleted_instance_timeout = 0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] scheduler_instance_sync_interval = 120 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] service_down_time              = 720 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] servicegroup_driver            = db {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] shelved_offload_time           = 0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] shelved_poll_interval          = 3600 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] shutdown_timeout               = 0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] source_is_ipv6                 = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ssl_only                       = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] state_path                     = /opt/stack/data/nova {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] sync_power_state_interval      = 600 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] sync_power_state_pool_size     = 1000 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] syslog_log_facility            = LOG_USER {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] tempdir                        = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] timeout_nbd                    = 10 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] transport_url                  = **** {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] update_resources_interval      = 0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] use_cow_images                 = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] use_eventlog                   = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] use_journal                    = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] use_json                       = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] use_rootwrap_daemon            = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] use_stderr                     = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] use_syslog                     = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vcpu_pin_set                   = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vif_plugging_is_fatal          = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vif_plugging_timeout           = 0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] virt_mkfs                      = [] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] volume_usage_poll_interval     = 0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] watch_log_file                 = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] web                            = /usr/share/spice-html5 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_concurrency.disable_process_locking = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api.auth_strategy              = keystone {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api.compute_link_prefix        = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api.dhcp_domain                = novalocal {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api.enable_instance_password   = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api.glance_link_prefix         = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api.instance_list_per_project_cells = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api.list_records_by_skipping_down_cells = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api.local_metadata_per_cell    = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api.max_limit                  = 1000 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api.metadata_cache_expiration  = 15 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api.neutron_default_tenant_id  = default {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api.use_forwarded_for          = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api.use_neutron_default_nets   = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api.vendordata_dynamic_targets = [] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api.vendordata_jsonfile_path   = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.backend_argument         = **** {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.config_prefix            = cache.oslo {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.dead_timeout             = 60.0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.debug_cache_backend      = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.enable_retry_client      = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.enable_socket_keepalive  = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.enabled                  = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.expiration_time          = 600 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.hashclient_retry_attempts = 2 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.memcache_dead_retry      = 300 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.memcache_password        =  {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.memcache_sasl_enabled    = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.memcache_username        =  {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.proxies                  = [] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.retry_attempts           = 2 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.retry_delay              = 0.0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.socket_keepalive_count   = 1 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.socket_keepalive_idle    = 1 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.socket_keepalive_interval = 1 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.tls_allowed_ciphers      = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.tls_cafile               = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.tls_certfile             = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.tls_enabled              = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cache.tls_keyfile              = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cinder.auth_section            = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cinder.auth_type               = password {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cinder.cafile                  = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cinder.certfile                = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cinder.collect_timing          = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cinder.cross_az_attach         = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cinder.debug                   = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cinder.endpoint_template       = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cinder.http_retries            = 3 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cinder.insecure                = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cinder.keyfile                 = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cinder.os_region_name          = RegionOne {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cinder.split_loggers           = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cinder.timeout                 = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] compute.cpu_dedicated_set      = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] compute.cpu_shared_set         = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] compute.image_type_exclude_list = [] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] compute.resource_provider_association_refresh = 300 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] compute.shutdown_retry_interval = 10 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] conductor.workers              = 3 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] console.allowed_origins        = [] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] console.ssl_ciphers            = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] console.ssl_minimum_version    = default {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] consoleauth.token_ttl          = 600 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cyborg.cafile                  = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cyborg.certfile                = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cyborg.collect_timing          = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cyborg.connect_retries         = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cyborg.connect_retry_delay     = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cyborg.endpoint_override       = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cyborg.insecure                = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cyborg.keyfile                 = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cyborg.max_version             = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cyborg.min_version             = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cyborg.region_name             = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cyborg.service_name            = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cyborg.service_type            = accelerator {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cyborg.split_loggers           = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cyborg.status_code_retries     = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cyborg.status_code_retry_delay = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cyborg.timeout                 = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] cyborg.version                 = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] database.backend               = sqlalchemy {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] database.connection            = **** {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] database.connection_debug      = 0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] database.connection_parameters =  {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] database.connection_recycle_time = 3600 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] database.connection_trace      = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] database.db_inc_retry_interval = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] database.db_max_retries        = 20 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] database.db_max_retry_interval = 10 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] database.db_retry_interval     = 1 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] database.max_overflow          = 50 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] database.max_pool_size         = 5 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] database.max_retries           = 10 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] database.mysql_wsrep_sync_wait = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] database.pool_timeout          = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] database.retry_interval        = 10 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] database.slave_connection      = **** {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] database.sqlite_synchronous    = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api_database.backend           = sqlalchemy {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api_database.connection        = **** {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api_database.connection_debug  = 0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api_database.connection_parameters =  {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api_database.connection_recycle_time = 3600 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api_database.connection_trace  = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api_database.db_inc_retry_interval = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api_database.db_max_retries    = 20 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api_database.db_max_retry_interval = 10 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api_database.db_retry_interval = 1 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api_database.max_overflow      = 50 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api_database.max_pool_size     = 5 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api_database.max_retries       = 10 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api_database.pool_timeout      = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api_database.retry_interval    = 10 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api_database.slave_connection  = **** {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] api_database.sqlite_synchronous = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] devices.enabled_mdev_types     = [] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ephemeral_storage_encryption.enabled = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.api_servers             = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.cafile                  = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.certfile                = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.collect_timing          = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.connect_retries         = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.connect_retry_delay     = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.debug                   = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.default_trusted_certificate_ids = [] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.enable_certificate_validation = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.enable_rbd_download     = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.endpoint_override       = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.insecure                = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.keyfile                 = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.max_version             = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.min_version             = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.num_retries             = 3 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.rbd_ceph_conf           =  {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.rbd_connect_timeout     = 5 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.rbd_pool                =  {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.rbd_user                =  {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.region_name             = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.service_name            = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.service_type            = image {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.split_loggers           = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.status_code_retries     = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.status_code_retry_delay = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.timeout                 = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.verify_glance_signatures = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] glance.version                 = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] guestfs.debug                  = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] hyperv.config_drive_cdrom      = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] hyperv.config_drive_inject_password = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] hyperv.enable_remotefx         = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] hyperv.instances_path_share    =  {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] hyperv.limit_cpu_features      = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] hyperv.use_multipath_io        = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] hyperv.vswitch_name            = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] mks.enabled                    = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] image_cache.manager_interval   = 2400 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] image_cache.precache_concurrency = 1 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] image_cache.remove_unused_base_images = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] image_cache.subdirectory_name  = _base {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ironic.api_max_retries         = 60 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ironic.api_retry_interval      = 2 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ironic.auth_section            = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ironic.auth_type               = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ironic.cafile                  = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ironic.certfile                = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ironic.collect_timing          = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ironic.conductor_group         = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ironic.connect_retries         = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ironic.connect_retry_delay     = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ironic.endpoint_override       = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ironic.insecure                = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ironic.keyfile                 = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ironic.max_version             = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ironic.min_version             = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ironic.peer_list               = [] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ironic.region_name             = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ironic.serial_console_state_timeout = 10 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ironic.service_name            = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ironic.service_type            = baremetal {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ironic.split_loggers           = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ironic.status_code_retries     = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ironic.status_code_retry_delay = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ironic.timeout                 = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ironic.version                 = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] key_manager.fixed_key          = **** {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] barbican.barbican_api_version  = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] barbican.barbican_endpoint     = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] barbican.barbican_endpoint_type = public {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] barbican.barbican_region_name  = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] barbican.cafile                = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] barbican.certfile              = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] barbican.collect_timing        = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] barbican.insecure              = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] barbican.keyfile               = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] barbican.number_of_retries     = 60 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] barbican.retry_delay           = 1 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] barbican.send_service_user_token = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] barbican.split_loggers         = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] barbican.timeout               = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] barbican.verify_ssl            = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] barbican.verify_ssl_path       = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] barbican_service_user.auth_section = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] barbican_service_user.auth_type = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] barbican_service_user.cafile   = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] barbican_service_user.certfile = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] barbican_service_user.collect_timing = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] barbican_service_user.insecure = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] barbican_service_user.keyfile  = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] barbican_service_user.split_loggers = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] barbican_service_user.timeout  = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vault.approle_role_id          = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vault.approle_secret_id        = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vault.cafile                   = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vault.certfile                 = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vault.collect_timing           = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vault.insecure                 = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vault.keyfile                  = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vault.kv_mountpoint            = secret {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vault.kv_path                  = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vault.kv_version               = 2 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vault.namespace                = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vault.root_token_id            = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vault.split_loggers            = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vault.ssl_ca_crt_file          = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vault.timeout                  = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vault.use_ssl                  = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] keystone.auth_section          = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] keystone.auth_type             = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] keystone.cafile                = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] keystone.certfile              = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] keystone.collect_timing        = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] keystone.connect_retries       = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] keystone.connect_retry_delay   = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] keystone.endpoint_override     = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] keystone.insecure              = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] keystone.keyfile               = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] keystone.max_version           = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] keystone.min_version           = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] keystone.region_name           = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] keystone.service_name          = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] keystone.service_type          = identity {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] keystone.split_loggers         = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] keystone.status_code_retries   = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] keystone.status_code_retry_delay = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] keystone.timeout               = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] keystone.version               = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.connection_uri         =  {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.cpu_mode               = custom {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: WARNING oslo_config.cfg [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.cpu_power_governor_high = performance {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.cpu_power_management   = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.device_detach_attempts = 8 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.device_detach_timeout  = 20 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.disk_cachemodes        = [] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.disk_prefix            = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.enabled_perf_events    = [] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.file_backed_memory     = 0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.gid_maps               = [] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.hw_disk_discard        = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.hw_machine_type        = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.images_rbd_pool        = rbd {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.images_type            = default {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.images_volume_group    = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.inject_key             = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.inject_partition       = -2 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.inject_password        = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.iscsi_iface            = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.iser_use_multipath     = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.live_migration_downtime = 500 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.live_migration_inbound_addr = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.live_migration_scheme  = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.live_migration_timeout_action = abort {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.live_migration_tunnelled = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: WARNING oslo_config.cfg [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 15 04:09:58 user nova-compute[74805]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 15 04:09:58 user nova-compute[74805]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 15 04:09:58 user nova-compute[74805]: and ``live_migration_inbound_addr`` respectively.
Nov 15 04:09:58 user nova-compute[74805]: ).  Its value may be silently ignored in the future.
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.live_migration_with_native_tls = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.max_queues             = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.nfs_mount_options      = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.num_pcie_ports         = 0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.pmem_namespaces        = [] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.quobyte_client_cfg     = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.rbd_secret_uuid        = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.rbd_user               = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.rescue_image_id        = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.rescue_kernel_id       = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.rx_queue_size          = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.smbfs_mount_options    =  {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.snapshot_compression   = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.snapshot_image_format  = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.sparse_logical_volumes = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.swtpm_enabled          = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.swtpm_group            = tss {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.swtpm_user             = tss {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.sysinfo_serial         = unique {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.tb_cache_size          = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.tx_queue_size          = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.uid_maps               = [] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.use_virtio_for_bridges = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.virt_type              = kvm {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.volume_clear           = zero {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.volume_clear_size      = 0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.volume_use_multipath   = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.vzstorage_cache_path   = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] neutron.auth_section           = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] neutron.auth_type              = password {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] neutron.cafile                 = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] neutron.certfile               = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] neutron.collect_timing         = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] neutron.connect_retries        = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] neutron.connect_retry_delay    = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] neutron.default_floating_pool  = public {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] neutron.endpoint_override      = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] neutron.extension_sync_interval = 600 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] neutron.http_retries           = 3 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] neutron.insecure               = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] neutron.keyfile                = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] neutron.max_version            = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] neutron.min_version            = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] neutron.ovs_bridge             = br-int {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] neutron.physnets               = [] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] neutron.region_name            = RegionOne {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] neutron.service_metadata_proxy = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] neutron.service_name           = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] neutron.service_type           = network {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] neutron.split_loggers          = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] neutron.status_code_retries    = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] neutron.status_code_retry_delay = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] neutron.timeout                = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] neutron.version                = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] notifications.bdms_in_notifications = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] notifications.default_level    = INFO {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] notifications.notification_format = unversioned {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] notifications.notify_on_state_change = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] pci.alias                      = [] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] pci.device_spec                = [] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] pci.report_in_placement        = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.auth_section         = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.auth_type            = password {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.cafile               = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.certfile             = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.collect_timing       = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.connect_retries      = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.connect_retry_delay  = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.default_domain_id    = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.default_domain_name  = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.domain_id            = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.domain_name          = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.endpoint_override    = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.insecure             = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.keyfile              = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.max_version          = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.min_version          = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.password             = **** {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.project_domain_id    = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.project_domain_name  = Default {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.project_id           = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.project_name         = service {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.region_name          = RegionOne {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.service_name         = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.service_type         = placement {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.split_loggers        = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.status_code_retries  = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.status_code_retry_delay = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.system_scope         = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.timeout              = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.trust_id             = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.user_domain_id       = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.user_domain_name     = Default {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.user_id              = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.username             = placement {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] placement.version              = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] quota.cores                    = 20 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] quota.count_usage_from_placement = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] quota.injected_file_content_bytes = 10240 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] quota.injected_file_path_length = 255 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] quota.injected_files           = 5 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] quota.instances                = 10 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] quota.key_pairs                = 100 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] quota.metadata_items           = 128 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] quota.ram                      = 51200 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] quota.recheck_quota            = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] quota.server_group_members     = 10 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] quota.server_groups            = 10 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] rdp.enabled                    = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] scheduler.image_metadata_prefilter = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] scheduler.max_attempts         = 3 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] scheduler.max_placement_results = 1000 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] scheduler.workers              = 3 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] filter_scheduler.host_subset_size = 1 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] filter_scheduler.isolated_hosts = [] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] filter_scheduler.isolated_images = [] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] filter_scheduler.pci_in_placement = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] filter_scheduler.track_instance_changes = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] metrics.required               = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] metrics.weight_multiplier      = 1.0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] metrics.weight_setting         = [] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] serial_console.enabled         = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] serial_console.port_range      = 10000:20000 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] serial_console.serialproxy_port = 6083 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] service_user.auth_section      = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] service_user.auth_type         = password {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] service_user.cafile            = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] service_user.certfile          = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] service_user.collect_timing    = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] service_user.insecure          = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] service_user.keyfile           = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] service_user.send_service_user_token = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] service_user.split_loggers     = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] service_user.timeout           = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] spice.agent_enabled            = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] spice.enabled                  = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] spice.html5proxy_port          = 6082 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] spice.image_compression        = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] spice.jpeg_compression         = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] spice.playback_compression     = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] spice.server_listen            = 127.0.0.1 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] spice.streaming_mode           = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] spice.zlib_compression         = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] upgrade_levels.baseapi         = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] upgrade_levels.cert            = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] upgrade_levels.compute         = auto {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] upgrade_levels.conductor       = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] upgrade_levels.scheduler       = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vendordata_dynamic_auth.cafile = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vendordata_dynamic_auth.certfile = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vendordata_dynamic_auth.insecure = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vendordata_dynamic_auth.timeout = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vmware.api_retry_count         = 10 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vmware.ca_file                 = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vmware.cache_prefix            = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vmware.cluster_name            = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vmware.connection_pool_size    = 10 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vmware.console_delay_seconds   = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vmware.datastore_regex         = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vmware.host_ip                 = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vmware.host_password           = **** {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vmware.host_port               = 443 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vmware.host_username           = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vmware.insecure                = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vmware.integration_bridge      = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vmware.maximum_objects         = 100 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vmware.pbm_default_policy      = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vmware.pbm_enabled             = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vmware.pbm_wsdl_location       = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vmware.serial_port_proxy_uri   = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vmware.serial_port_service_uri = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vmware.task_poll_interval      = 0.5 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vmware.use_linked_clone        = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vmware.vnc_keymap              = en-us {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vmware.vnc_port                = 5900 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vmware.vnc_port_total          = 10000 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vnc.auth_schemes               = ['none'] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vnc.enabled                    = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vnc.novncproxy_port            = 6080 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vnc.vencrypt_ca_certs          = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vnc.vencrypt_client_cert       = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vnc.vencrypt_client_key        = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] workarounds.disable_rootwrap   = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] workarounds.enable_numa_live_migration = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] workarounds.libvirt_disable_apic = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] wsgi.client_socket_timeout     = 900 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] wsgi.default_pool_size         = 1000 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] wsgi.keep_alive                = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] wsgi.max_header_line           = 16384 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] wsgi.ssl_ca_file               = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] wsgi.ssl_cert_file             = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] wsgi.ssl_key_file              = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] wsgi.tcp_keepidle              = 600 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] zvm.ca_file                    = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] zvm.cloud_connector_url        = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] zvm.reachable_timeout          = 300 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_policy.enforce_new_defaults = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_policy.enforce_scope      = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_policy.policy_default_rule = default {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] profiler.connection_string     = messaging:// {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] profiler.enabled               = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] profiler.es_doc_type           = notification {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] profiler.es_scroll_size        = 10000 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] profiler.es_scroll_time        = 2m {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] profiler.filter_error_trace    = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] profiler.hmac_keys             = **** {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] profiler.sentinel_service_name = mymaster {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] profiler.socket_timeout        = 0.1 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] profiler.trace_requests        = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] profiler.trace_sqlalchemy      = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] profiler_jaeger.process_tags   = {} {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] profiler_jaeger.service_name_prefix = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] profiler_otlp.service_name_prefix = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] remote_debug.host              = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] remote_debug.port              = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_notifications.retry = -1 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_limit.auth_section        = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_limit.auth_type           = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_limit.cafile              = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_limit.certfile            = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_limit.collect_timing      = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_limit.connect_retries     = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_limit.connect_retry_delay = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_limit.endpoint_id         = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_limit.endpoint_override   = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_limit.insecure            = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_limit.keyfile             = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_limit.max_version         = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_limit.min_version         = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_limit.region_name         = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_limit.service_name        = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_limit.service_type        = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_limit.split_loggers       = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_limit.status_code_retries = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_limit.status_code_retry_delay = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_limit.timeout             = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_limit.valid_interfaces    = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_limit.version             = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_reports.file_event_handler = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] oslo_reports.log_dir           = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vif_plug_ovs_privileged.group  = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] vif_plug_ovs_privileged.user   = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] os_vif_ovs.isolate_vif         = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] os_brick.lock_path             = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] privsep_osbrick.capabilities   = [21] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] privsep_osbrick.group          = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] privsep_osbrick.helper_command = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] privsep_osbrick.user           = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] nova_sys_admin.group           = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] nova_sys_admin.helper_command  = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] nova_sys_admin.user            = None {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG oslo_service.service [None req-a9087c21-5f45-4df0-a378-15047dba01a6 None None] ******************************************************************************** {{(pid=74805) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 15 04:09:58 user nova-compute[74805]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 15 04:09:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Connecting to libvirt: qemu:///system {{(pid=74805) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f2fb447f040> {{(pid=74805) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 15 04:09:58 user nova-compute[74805]: libvirt:  error : internal error: could not initialize domain event timer
Nov 15 04:09:58 user nova-compute[74805]: WARNING nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 15 04:09:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f2fb447f040> {{(pid=74805) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Starting native event thread {{(pid=74805) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Starting green dispatch thread {{(pid=74805) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 15 04:09:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Starting connection event dispatch thread {{(pid=74805) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 15 04:09:58 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Connection event '1' reason 'None'
Nov 15 04:09:58 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 15 04:09:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.mount [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Initialising _HostMountState generation 0 {{(pid=74805) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 15 04:10:05 user nova-compute[74805]: INFO nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Libvirt host capabilities <capabilities>
Nov 15 04:10:05 user nova-compute[74805]:   <host>
Nov 15 04:10:05 user nova-compute[74805]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 15 04:10:05 user nova-compute[74805]:     <cpu>
Nov 15 04:10:05 user nova-compute[74805]:       <arch>x86_64</arch>
Nov 15 04:10:05 user nova-compute[74805]:       <model>IvyBridge-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <vendor>Intel</vendor>
Nov 15 04:10:05 user nova-compute[74805]:       <microcode version='1070'/>
Nov 15 04:10:05 user nova-compute[74805]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 15 04:10:05 user nova-compute[74805]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature name='ss'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature name='vmx'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature name='pcid'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature name='osxsave'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature name='hypervisor'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature name='arat'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature name='tsc_adjust'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature name='md-clear'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature name='stibp'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature name='arch-capabilities'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature name='ssbd'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature name='invtsc'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature name='rsba'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature name='skip-l1dfl-vmentry'/>
Nov 15 04:10:05 user nova-compute[74805]:       <pages unit='KiB' size='4'/>
Nov 15 04:10:05 user nova-compute[74805]:       <pages unit='KiB' size='2048'/>
Nov 15 04:10:05 user nova-compute[74805]:     </cpu>
Nov 15 04:10:05 user nova-compute[74805]:     <power_management>
Nov 15 04:10:05 user nova-compute[74805]:       <suspend_mem/>
Nov 15 04:10:05 user nova-compute[74805]:       <suspend_disk/>
Nov 15 04:10:05 user nova-compute[74805]:       <suspend_hybrid/>
Nov 15 04:10:05 user nova-compute[74805]:     </power_management>
Nov 15 04:10:05 user nova-compute[74805]:     <iommu support='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     <migration_features>
Nov 15 04:10:05 user nova-compute[74805]:       <live/>
Nov 15 04:10:05 user nova-compute[74805]:       <uri_transports>
Nov 15 04:10:05 user nova-compute[74805]:         <uri_transport>tcp</uri_transport>
Nov 15 04:10:05 user nova-compute[74805]:         <uri_transport>rdma</uri_transport>
Nov 15 04:10:05 user nova-compute[74805]:       </uri_transports>
Nov 15 04:10:05 user nova-compute[74805]:     </migration_features>
Nov 15 04:10:05 user nova-compute[74805]:     <topology>
Nov 15 04:10:05 user nova-compute[74805]:       <cells num='2'>
Nov 15 04:10:05 user nova-compute[74805]:         <cell id='0'>
Nov 15 04:10:05 user nova-compute[74805]:           <memory unit='KiB'>8140616</memory>
Nov 15 04:10:05 user nova-compute[74805]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 15 04:10:05 user nova-compute[74805]:           <pages unit='KiB' size='2048'>0</pages>
Nov 15 04:10:05 user nova-compute[74805]:           <distances>
Nov 15 04:10:05 user nova-compute[74805]:             <sibling id='0' value='10'/>
Nov 15 04:10:05 user nova-compute[74805]:             <sibling id='1' value='20'/>
Nov 15 04:10:05 user nova-compute[74805]:           </distances>
Nov 15 04:10:05 user nova-compute[74805]:           <cpus num='6'>
Nov 15 04:10:05 user nova-compute[74805]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 15 04:10:05 user nova-compute[74805]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 15 04:10:05 user nova-compute[74805]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 15 04:10:05 user nova-compute[74805]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 15 04:10:05 user nova-compute[74805]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 15 04:10:05 user nova-compute[74805]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 15 04:10:05 user nova-compute[74805]:           </cpus>
Nov 15 04:10:05 user nova-compute[74805]:         </cell>
Nov 15 04:10:05 user nova-compute[74805]:         <cell id='1'>
Nov 15 04:10:05 user nova-compute[74805]:           <memory unit='KiB'>8255068</memory>
Nov 15 04:10:05 user nova-compute[74805]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 15 04:10:05 user nova-compute[74805]:           <pages unit='KiB' size='2048'>0</pages>
Nov 15 04:10:05 user nova-compute[74805]:           <distances>
Nov 15 04:10:05 user nova-compute[74805]:             <sibling id='0' value='20'/>
Nov 15 04:10:05 user nova-compute[74805]:             <sibling id='1' value='10'/>
Nov 15 04:10:05 user nova-compute[74805]:           </distances>
Nov 15 04:10:05 user nova-compute[74805]:           <cpus num='6'>
Nov 15 04:10:05 user nova-compute[74805]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 15 04:10:05 user nova-compute[74805]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 15 04:10:05 user nova-compute[74805]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 15 04:10:05 user nova-compute[74805]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 15 04:10:05 user nova-compute[74805]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 15 04:10:05 user nova-compute[74805]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 15 04:10:05 user nova-compute[74805]:           </cpus>
Nov 15 04:10:05 user nova-compute[74805]:         </cell>
Nov 15 04:10:05 user nova-compute[74805]:       </cells>
Nov 15 04:10:05 user nova-compute[74805]:     </topology>
Nov 15 04:10:05 user nova-compute[74805]:     <cache>
Nov 15 04:10:05 user nova-compute[74805]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 15 04:10:05 user nova-compute[74805]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 15 04:10:05 user nova-compute[74805]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 15 04:10:05 user nova-compute[74805]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 15 04:10:05 user nova-compute[74805]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 15 04:10:05 user nova-compute[74805]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 15 04:10:05 user nova-compute[74805]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 15 04:10:05 user nova-compute[74805]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 15 04:10:05 user nova-compute[74805]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 15 04:10:05 user nova-compute[74805]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 15 04:10:05 user nova-compute[74805]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 15 04:10:05 user nova-compute[74805]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 15 04:10:05 user nova-compute[74805]:     </cache>
Nov 15 04:10:05 user nova-compute[74805]:     <secmodel>
Nov 15 04:10:05 user nova-compute[74805]:       <model>apparmor</model>
Nov 15 04:10:05 user nova-compute[74805]:       <doi>0</doi>
Nov 15 04:10:05 user nova-compute[74805]:     </secmodel>
Nov 15 04:10:05 user nova-compute[74805]:     <secmodel>
Nov 15 04:10:05 user nova-compute[74805]:       <model>dac</model>
Nov 15 04:10:05 user nova-compute[74805]:       <doi>0</doi>
Nov 15 04:10:05 user nova-compute[74805]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 15 04:10:05 user nova-compute[74805]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 15 04:10:05 user nova-compute[74805]:     </secmodel>
Nov 15 04:10:05 user nova-compute[74805]:   </host>
Nov 15 04:10:05 user nova-compute[74805]:   <guest>
Nov 15 04:10:05 user nova-compute[74805]:     <os_type>hvm</os_type>
Nov 15 04:10:05 user nova-compute[74805]:     <arch name='alpha'>
Nov 15 04:10:05 user nova-compute[74805]:       <wordsize>64</wordsize>
Nov 15 04:10:05 user nova-compute[74805]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>clipper</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <domain type='qemu'/>
Nov 15 04:10:05 user nova-compute[74805]:     </arch>
Nov 15 04:10:05 user nova-compute[74805]:     <features>
Nov 15 04:10:05 user nova-compute[74805]:       <cpuselection/>
Nov 15 04:10:05 user nova-compute[74805]:       <deviceboot/>
Nov 15 04:10:05 user nova-compute[74805]:       <disksnapshot default='on' toggle='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     </features>
Nov 15 04:10:05 user nova-compute[74805]:   </guest>
Nov 15 04:10:05 user nova-compute[74805]:   <guest>
Nov 15 04:10:05 user nova-compute[74805]:     <os_type>hvm</os_type>
Nov 15 04:10:05 user nova-compute[74805]:     <arch name='armv6l'>
Nov 15 04:10:05 user nova-compute[74805]:       <wordsize>32</wordsize>
Nov 15 04:10:05 user nova-compute[74805]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>spitz</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>nuri</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>kzm</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>sx1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>z2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>tosa</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>n810</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>n800</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>terrier</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>midway</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>microbit</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>verdex</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>highbank</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>akita</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>connex</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>collie</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <domain type='qemu'/>
Nov 15 04:10:05 user nova-compute[74805]:     </arch>
Nov 15 04:10:05 user nova-compute[74805]:     <features>
Nov 15 04:10:05 user nova-compute[74805]:       <cpuselection/>
Nov 15 04:10:05 user nova-compute[74805]:       <deviceboot/>
Nov 15 04:10:05 user nova-compute[74805]:       <disksnapshot default='on' toggle='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     </features>
Nov 15 04:10:05 user nova-compute[74805]:   </guest>
Nov 15 04:10:05 user nova-compute[74805]:   <guest>
Nov 15 04:10:05 user nova-compute[74805]:     <os_type>hvm</os_type>
Nov 15 04:10:05 user nova-compute[74805]:     <arch name='armv7l'>
Nov 15 04:10:05 user nova-compute[74805]:       <wordsize>32</wordsize>
Nov 15 04:10:05 user nova-compute[74805]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>spitz</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>nuri</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>kzm</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>sx1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>z2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>tosa</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>n810</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>n800</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>terrier</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>midway</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>microbit</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>verdex</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>highbank</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>akita</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>connex</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>collie</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <domain type='qemu'/>
Nov 15 04:10:05 user nova-compute[74805]:     </arch>
Nov 15 04:10:05 user nova-compute[74805]:     <features>
Nov 15 04:10:05 user nova-compute[74805]:       <cpuselection/>
Nov 15 04:10:05 user nova-compute[74805]:       <deviceboot/>
Nov 15 04:10:05 user nova-compute[74805]:       <disksnapshot default='on' toggle='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     </features>
Nov 15 04:10:05 user nova-compute[74805]:   </guest>
Nov 15 04:10:05 user nova-compute[74805]:   <guest>
Nov 15 04:10:05 user nova-compute[74805]:     <os_type>hvm</os_type>
Nov 15 04:10:05 user nova-compute[74805]:     <arch name='aarch64'>
Nov 15 04:10:05 user nova-compute[74805]:       <wordsize>64</wordsize>
Nov 15 04:10:05 user nova-compute[74805]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>spitz</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>nuri</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>kzm</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>sx1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>z2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>tosa</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>n810</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>n800</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>terrier</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>midway</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>microbit</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>verdex</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>raspi3b</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>highbank</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>akita</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>connex</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>collie</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <domain type='qemu'/>
Nov 15 04:10:05 user nova-compute[74805]:     </arch>
Nov 15 04:10:05 user nova-compute[74805]:     <features>
Nov 15 04:10:05 user nova-compute[74805]:       <acpi default='on' toggle='yes'/>
Nov 15 04:10:05 user nova-compute[74805]:       <cpuselection/>
Nov 15 04:10:05 user nova-compute[74805]:       <deviceboot/>
Nov 15 04:10:05 user nova-compute[74805]:       <disksnapshot default='on' toggle='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     </features>
Nov 15 04:10:05 user nova-compute[74805]:   </guest>
Nov 15 04:10:05 user nova-compute[74805]:   <guest>
Nov 15 04:10:05 user nova-compute[74805]:     <os_type>hvm</os_type>
Nov 15 04:10:05 user nova-compute[74805]:     <arch name='cris'>
Nov 15 04:10:05 user nova-compute[74805]:       <wordsize>32</wordsize>
Nov 15 04:10:05 user nova-compute[74805]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <domain type='qemu'/>
Nov 15 04:10:05 user nova-compute[74805]:     </arch>
Nov 15 04:10:05 user nova-compute[74805]:     <features>
Nov 15 04:10:05 user nova-compute[74805]:       <cpuselection/>
Nov 15 04:10:05 user nova-compute[74805]:       <deviceboot/>
Nov 15 04:10:05 user nova-compute[74805]:       <disksnapshot default='on' toggle='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     </features>
Nov 15 04:10:05 user nova-compute[74805]:   </guest>
Nov 15 04:10:05 user nova-compute[74805]:   <guest>
Nov 15 04:10:05 user nova-compute[74805]:     <os_type>hvm</os_type>
Nov 15 04:10:05 user nova-compute[74805]:     <arch name='i686'>
Nov 15 04:10:05 user nova-compute[74805]:       <wordsize>32</wordsize>
Nov 15 04:10:05 user nova-compute[74805]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>x-remote</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>isapc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>microvm</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <domain type='qemu'/>
Nov 15 04:10:05 user nova-compute[74805]:       <domain type='kvm'/>
Nov 15 04:10:05 user nova-compute[74805]:     </arch>
Nov 15 04:10:05 user nova-compute[74805]:     <features>
Nov 15 04:10:05 user nova-compute[74805]:       <pae/>
Nov 15 04:10:05 user nova-compute[74805]:       <nonpae/>
Nov 15 04:10:05 user nova-compute[74805]:       <acpi default='on' toggle='yes'/>
Nov 15 04:10:05 user nova-compute[74805]:       <apic default='on' toggle='no'/>
Nov 15 04:10:05 user nova-compute[74805]:       <cpuselection/>
Nov 15 04:10:05 user nova-compute[74805]:       <deviceboot/>
Nov 15 04:10:05 user nova-compute[74805]:       <disksnapshot default='on' toggle='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     </features>
Nov 15 04:10:05 user nova-compute[74805]:   </guest>
Nov 15 04:10:05 user nova-compute[74805]:   <guest>
Nov 15 04:10:05 user nova-compute[74805]:     <os_type>hvm</os_type>
Nov 15 04:10:05 user nova-compute[74805]:     <arch name='m68k'>
Nov 15 04:10:05 user nova-compute[74805]:       <wordsize>32</wordsize>
Nov 15 04:10:05 user nova-compute[74805]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>an5206</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>q800</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>next-cube</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <domain type='qemu'/>
Nov 15 04:10:05 user nova-compute[74805]:     </arch>
Nov 15 04:10:05 user nova-compute[74805]:     <features>
Nov 15 04:10:05 user nova-compute[74805]:       <cpuselection/>
Nov 15 04:10:05 user nova-compute[74805]:       <deviceboot/>
Nov 15 04:10:05 user nova-compute[74805]:       <disksnapshot default='on' toggle='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     </features>
Nov 15 04:10:05 user nova-compute[74805]:   </guest>
Nov 15 04:10:05 user nova-compute[74805]:   <guest>
Nov 15 04:10:05 user nova-compute[74805]:     <os_type>hvm</os_type>
Nov 15 04:10:05 user nova-compute[74805]:     <arch name='microblaze'>
Nov 15 04:10:05 user nova-compute[74805]:       <wordsize>32</wordsize>
Nov 15 04:10:05 user nova-compute[74805]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <domain type='qemu'/>
Nov 15 04:10:05 user nova-compute[74805]:     </arch>
Nov 15 04:10:05 user nova-compute[74805]:     <features>
Nov 15 04:10:05 user nova-compute[74805]:       <cpuselection/>
Nov 15 04:10:05 user nova-compute[74805]:       <deviceboot/>
Nov 15 04:10:05 user nova-compute[74805]:       <disksnapshot default='on' toggle='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     </features>
Nov 15 04:10:05 user nova-compute[74805]:   </guest>
Nov 15 04:10:05 user nova-compute[74805]:   <guest>
Nov 15 04:10:05 user nova-compute[74805]:     <os_type>hvm</os_type>
Nov 15 04:10:05 user nova-compute[74805]:     <arch name='microblazeel'>
Nov 15 04:10:05 user nova-compute[74805]:       <wordsize>32</wordsize>
Nov 15 04:10:05 user nova-compute[74805]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <domain type='qemu'/>
Nov 15 04:10:05 user nova-compute[74805]:     </arch>
Nov 15 04:10:05 user nova-compute[74805]:     <features>
Nov 15 04:10:05 user nova-compute[74805]:       <cpuselection/>
Nov 15 04:10:05 user nova-compute[74805]:       <deviceboot/>
Nov 15 04:10:05 user nova-compute[74805]:       <disksnapshot default='on' toggle='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     </features>
Nov 15 04:10:05 user nova-compute[74805]:   </guest>
Nov 15 04:10:05 user nova-compute[74805]:   <guest>
Nov 15 04:10:05 user nova-compute[74805]:     <os_type>hvm</os_type>
Nov 15 04:10:05 user nova-compute[74805]:     <arch name='mips'>
Nov 15 04:10:05 user nova-compute[74805]:       <wordsize>32</wordsize>
Nov 15 04:10:05 user nova-compute[74805]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='16'>malta</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <domain type='qemu'/>
Nov 15 04:10:05 user nova-compute[74805]:     </arch>
Nov 15 04:10:05 user nova-compute[74805]:     <features>
Nov 15 04:10:05 user nova-compute[74805]:       <cpuselection/>
Nov 15 04:10:05 user nova-compute[74805]:       <deviceboot/>
Nov 15 04:10:05 user nova-compute[74805]:       <disksnapshot default='on' toggle='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     </features>
Nov 15 04:10:05 user nova-compute[74805]:   </guest>
Nov 15 04:10:05 user nova-compute[74805]:   <guest>
Nov 15 04:10:05 user nova-compute[74805]:     <os_type>hvm</os_type>
Nov 15 04:10:05 user nova-compute[74805]:     <arch name='mipsel'>
Nov 15 04:10:05 user nova-compute[74805]:       <wordsize>32</wordsize>
Nov 15 04:10:05 user nova-compute[74805]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='16'>malta</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <domain type='qemu'/>
Nov 15 04:10:05 user nova-compute[74805]:     </arch>
Nov 15 04:10:05 user nova-compute[74805]:     <features>
Nov 15 04:10:05 user nova-compute[74805]:       <cpuselection/>
Nov 15 04:10:05 user nova-compute[74805]:       <deviceboot/>
Nov 15 04:10:05 user nova-compute[74805]:       <disksnapshot default='on' toggle='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     </features>
Nov 15 04:10:05 user nova-compute[74805]:   </guest>
Nov 15 04:10:05 user nova-compute[74805]:   <guest>
Nov 15 04:10:05 user nova-compute[74805]:     <os_type>hvm</os_type>
Nov 15 04:10:05 user nova-compute[74805]:     <arch name='mips64'>
Nov 15 04:10:05 user nova-compute[74805]:       <wordsize>64</wordsize>
Nov 15 04:10:05 user nova-compute[74805]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='16'>malta</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>pica61</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>magnum</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <domain type='qemu'/>
Nov 15 04:10:05 user nova-compute[74805]:     </arch>
Nov 15 04:10:05 user nova-compute[74805]:     <features>
Nov 15 04:10:05 user nova-compute[74805]:       <cpuselection/>
Nov 15 04:10:05 user nova-compute[74805]:       <deviceboot/>
Nov 15 04:10:05 user nova-compute[74805]:       <disksnapshot default='on' toggle='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     </features>
Nov 15 04:10:05 user nova-compute[74805]:   </guest>
Nov 15 04:10:05 user nova-compute[74805]:   <guest>
Nov 15 04:10:05 user nova-compute[74805]:     <os_type>hvm</os_type>
Nov 15 04:10:05 user nova-compute[74805]:     <arch name='mips64el'>
Nov 15 04:10:05 user nova-compute[74805]:       <wordsize>64</wordsize>
Nov 15 04:10:05 user nova-compute[74805]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='16'>malta</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>pica61</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>magnum</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='16'>boston</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <domain type='qemu'/>
Nov 15 04:10:05 user nova-compute[74805]:     </arch>
Nov 15 04:10:05 user nova-compute[74805]:     <features>
Nov 15 04:10:05 user nova-compute[74805]:       <cpuselection/>
Nov 15 04:10:05 user nova-compute[74805]:       <deviceboot/>
Nov 15 04:10:05 user nova-compute[74805]:       <disksnapshot default='on' toggle='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     </features>
Nov 15 04:10:05 user nova-compute[74805]:   </guest>
Nov 15 04:10:05 user nova-compute[74805]:   <guest>
Nov 15 04:10:05 user nova-compute[74805]:     <os_type>hvm</os_type>
Nov 15 04:10:05 user nova-compute[74805]:     <arch name='ppc'>
Nov 15 04:10:05 user nova-compute[74805]:       <wordsize>32</wordsize>
Nov 15 04:10:05 user nova-compute[74805]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mac99</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>40p</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>taihu</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <domain type='qemu'/>
Nov 15 04:10:05 user nova-compute[74805]:     </arch>
Nov 15 04:10:05 user nova-compute[74805]:     <features>
Nov 15 04:10:05 user nova-compute[74805]:       <cpuselection/>
Nov 15 04:10:05 user nova-compute[74805]:       <deviceboot/>
Nov 15 04:10:05 user nova-compute[74805]:       <disksnapshot default='on' toggle='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     </features>
Nov 15 04:10:05 user nova-compute[74805]:   </guest>
Nov 15 04:10:05 user nova-compute[74805]:   <guest>
Nov 15 04:10:05 user nova-compute[74805]:     <os_type>hvm</os_type>
Nov 15 04:10:05 user nova-compute[74805]:     <arch name='ppc64'>
Nov 15 04:10:05 user nova-compute[74805]:       <wordsize>64</wordsize>
Nov 15 04:10:05 user nova-compute[74805]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2048'>powernv9</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>taihu</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2048'>powernv10</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>40p</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mac99</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2048'>powernv8</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <domain type='qemu'/>
Nov 15 04:10:05 user nova-compute[74805]:     </arch>
Nov 15 04:10:05 user nova-compute[74805]:     <features>
Nov 15 04:10:05 user nova-compute[74805]:       <cpuselection/>
Nov 15 04:10:05 user nova-compute[74805]:       <deviceboot/>
Nov 15 04:10:05 user nova-compute[74805]:       <disksnapshot default='on' toggle='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     </features>
Nov 15 04:10:05 user nova-compute[74805]:   </guest>
Nov 15 04:10:05 user nova-compute[74805]:   <guest>
Nov 15 04:10:05 user nova-compute[74805]:     <os_type>hvm</os_type>
Nov 15 04:10:05 user nova-compute[74805]:     <arch name='ppc64le'>
Nov 15 04:10:05 user nova-compute[74805]:       <wordsize>64</wordsize>
Nov 15 04:10:05 user nova-compute[74805]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2048'>powernv9</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>taihu</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2048'>powernv10</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>40p</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>mac99</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2048'>powernv8</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <domain type='qemu'/>
Nov 15 04:10:05 user nova-compute[74805]:     </arch>
Nov 15 04:10:05 user nova-compute[74805]:     <features>
Nov 15 04:10:05 user nova-compute[74805]:       <cpuselection/>
Nov 15 04:10:05 user nova-compute[74805]:       <deviceboot/>
Nov 15 04:10:05 user nova-compute[74805]:       <disksnapshot default='on' toggle='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     </features>
Nov 15 04:10:05 user nova-compute[74805]:   </guest>
Nov 15 04:10:05 user nova-compute[74805]:   <guest>
Nov 15 04:10:05 user nova-compute[74805]:     <os_type>hvm</os_type>
Nov 15 04:10:05 user nova-compute[74805]:     <arch name='riscv32'>
Nov 15 04:10:05 user nova-compute[74805]:       <wordsize>32</wordsize>
Nov 15 04:10:05 user nova-compute[74805]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='8'>spike</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>opentitan</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='5'>sifive_u</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>sifive_e</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='8'>virt</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <domain type='qemu'/>
Nov 15 04:10:05 user nova-compute[74805]:     </arch>
Nov 15 04:10:05 user nova-compute[74805]:     <features>
Nov 15 04:10:05 user nova-compute[74805]:       <cpuselection/>
Nov 15 04:10:05 user nova-compute[74805]:       <deviceboot/>
Nov 15 04:10:05 user nova-compute[74805]:       <disksnapshot default='on' toggle='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     </features>
Nov 15 04:10:05 user nova-compute[74805]:   </guest>
Nov 15 04:10:05 user nova-compute[74805]:   <guest>
Nov 15 04:10:05 user nova-compute[74805]:     <os_type>hvm</os_type>
Nov 15 04:10:05 user nova-compute[74805]:     <arch name='riscv64'>
Nov 15 04:10:05 user nova-compute[74805]:       <wordsize>64</wordsize>
Nov 15 04:10:05 user nova-compute[74805]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='8'>spike</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='5'>sifive_u</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>shakti_c</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>sifive_e</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='8'>virt</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <domain type='qemu'/>
Nov 15 04:10:05 user nova-compute[74805]:     </arch>
Nov 15 04:10:05 user nova-compute[74805]:     <features>
Nov 15 04:10:05 user nova-compute[74805]:       <cpuselection/>
Nov 15 04:10:05 user nova-compute[74805]:       <deviceboot/>
Nov 15 04:10:05 user nova-compute[74805]:       <disksnapshot default='on' toggle='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     </features>
Nov 15 04:10:05 user nova-compute[74805]:   </guest>
Nov 15 04:10:05 user nova-compute[74805]:   <guest>
Nov 15 04:10:05 user nova-compute[74805]:     <os_type>hvm</os_type>
Nov 15 04:10:05 user nova-compute[74805]:     <arch name='s390x'>
Nov 15 04:10:05 user nova-compute[74805]:       <wordsize>64</wordsize>
Nov 15 04:10:05 user nova-compute[74805]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <domain type='qemu'/>
Nov 15 04:10:05 user nova-compute[74805]:     </arch>
Nov 15 04:10:05 user nova-compute[74805]:     <features>
Nov 15 04:10:05 user nova-compute[74805]:       <cpuselection/>
Nov 15 04:10:05 user nova-compute[74805]:       <deviceboot/>
Nov 15 04:10:05 user nova-compute[74805]:       <disksnapshot default='on' toggle='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     </features>
Nov 15 04:10:05 user nova-compute[74805]:   </guest>
Nov 15 04:10:05 user nova-compute[74805]:   <guest>
Nov 15 04:10:05 user nova-compute[74805]:     <os_type>hvm</os_type>
Nov 15 04:10:05 user nova-compute[74805]:     <arch name='sh4'>
Nov 15 04:10:05 user nova-compute[74805]:       <wordsize>32</wordsize>
Nov 15 04:10:05 user nova-compute[74805]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>shix</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>r2d</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <domain type='qemu'/>
Nov 15 04:10:05 user nova-compute[74805]:     </arch>
Nov 15 04:10:05 user nova-compute[74805]:     <features>
Nov 15 04:10:05 user nova-compute[74805]:       <cpuselection/>
Nov 15 04:10:05 user nova-compute[74805]:       <deviceboot/>
Nov 15 04:10:05 user nova-compute[74805]:       <disksnapshot default='on' toggle='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     </features>
Nov 15 04:10:05 user nova-compute[74805]:   </guest>
Nov 15 04:10:05 user nova-compute[74805]:   <guest>
Nov 15 04:10:05 user nova-compute[74805]:     <os_type>hvm</os_type>
Nov 15 04:10:05 user nova-compute[74805]:     <arch name='sh4eb'>
Nov 15 04:10:05 user nova-compute[74805]:       <wordsize>64</wordsize>
Nov 15 04:10:05 user nova-compute[74805]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>shix</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>r2d</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <domain type='qemu'/>
Nov 15 04:10:05 user nova-compute[74805]:     </arch>
Nov 15 04:10:05 user nova-compute[74805]:     <features>
Nov 15 04:10:05 user nova-compute[74805]:       <cpuselection/>
Nov 15 04:10:05 user nova-compute[74805]:       <deviceboot/>
Nov 15 04:10:05 user nova-compute[74805]:       <disksnapshot default='on' toggle='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     </features>
Nov 15 04:10:05 user nova-compute[74805]:   </guest>
Nov 15 04:10:05 user nova-compute[74805]:   <guest>
Nov 15 04:10:05 user nova-compute[74805]:     <os_type>hvm</os_type>
Nov 15 04:10:05 user nova-compute[74805]:     <arch name='sparc'>
Nov 15 04:10:05 user nova-compute[74805]:       <wordsize>32</wordsize>
Nov 15 04:10:05 user nova-compute[74805]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>SS-5</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>SS-20</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>LX</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>SS-4</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>SS-10</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>Voyager</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <domain type='qemu'/>
Nov 15 04:10:05 user nova-compute[74805]:     </arch>
Nov 15 04:10:05 user nova-compute[74805]:     <features>
Nov 15 04:10:05 user nova-compute[74805]:       <cpuselection/>
Nov 15 04:10:05 user nova-compute[74805]:       <deviceboot/>
Nov 15 04:10:05 user nova-compute[74805]:       <disksnapshot default='on' toggle='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     </features>
Nov 15 04:10:05 user nova-compute[74805]:   </guest>
Nov 15 04:10:05 user nova-compute[74805]:   <guest>
Nov 15 04:10:05 user nova-compute[74805]:     <os_type>hvm</os_type>
Nov 15 04:10:05 user nova-compute[74805]:     <arch name='sparc64'>
Nov 15 04:10:05 user nova-compute[74805]:       <wordsize>64</wordsize>
Nov 15 04:10:05 user nova-compute[74805]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>sun4u</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>niagara</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>sun4v</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <domain type='qemu'/>
Nov 15 04:10:05 user nova-compute[74805]:     </arch>
Nov 15 04:10:05 user nova-compute[74805]:     <features>
Nov 15 04:10:05 user nova-compute[74805]:       <cpuselection/>
Nov 15 04:10:05 user nova-compute[74805]:       <deviceboot/>
Nov 15 04:10:05 user nova-compute[74805]:       <disksnapshot default='on' toggle='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     </features>
Nov 15 04:10:05 user nova-compute[74805]:   </guest>
Nov 15 04:10:05 user nova-compute[74805]:   <guest>
Nov 15 04:10:05 user nova-compute[74805]:     <os_type>hvm</os_type>
Nov 15 04:10:05 user nova-compute[74805]:     <arch name='x86_64'>
Nov 15 04:10:05 user nova-compute[74805]:       <wordsize>64</wordsize>
Nov 15 04:10:05 user nova-compute[74805]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>x-remote</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='1'>isapc</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>microvm</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <domain type='qemu'/>
Nov 15 04:10:05 user nova-compute[74805]:       <domain type='kvm'/>
Nov 15 04:10:05 user nova-compute[74805]:     </arch>
Nov 15 04:10:05 user nova-compute[74805]:     <features>
Nov 15 04:10:05 user nova-compute[74805]:       <acpi default='on' toggle='yes'/>
Nov 15 04:10:05 user nova-compute[74805]:       <apic default='on' toggle='no'/>
Nov 15 04:10:05 user nova-compute[74805]:       <cpuselection/>
Nov 15 04:10:05 user nova-compute[74805]:       <deviceboot/>
Nov 15 04:10:05 user nova-compute[74805]:       <disksnapshot default='on' toggle='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     </features>
Nov 15 04:10:05 user nova-compute[74805]:   </guest>
Nov 15 04:10:05 user nova-compute[74805]:   <guest>
Nov 15 04:10:05 user nova-compute[74805]:     <os_type>hvm</os_type>
Nov 15 04:10:05 user nova-compute[74805]:     <arch name='xtensa'>
Nov 15 04:10:05 user nova-compute[74805]:       <wordsize>32</wordsize>
Nov 15 04:10:05 user nova-compute[74805]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>sim</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='32'>kc705</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='32'>ml605</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='32'>virt</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='32'>lx200</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='32'>lx60</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <domain type='qemu'/>
Nov 15 04:10:05 user nova-compute[74805]:     </arch>
Nov 15 04:10:05 user nova-compute[74805]:     <features>
Nov 15 04:10:05 user nova-compute[74805]:       <cpuselection/>
Nov 15 04:10:05 user nova-compute[74805]:       <deviceboot/>
Nov 15 04:10:05 user nova-compute[74805]:       <disksnapshot default='on' toggle='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     </features>
Nov 15 04:10:05 user nova-compute[74805]:   </guest>
Nov 15 04:10:05 user nova-compute[74805]:   <guest>
Nov 15 04:10:05 user nova-compute[74805]:     <os_type>hvm</os_type>
Nov 15 04:10:05 user nova-compute[74805]:     <arch name='xtensaeb'>
Nov 15 04:10:05 user nova-compute[74805]:       <wordsize>32</wordsize>
Nov 15 04:10:05 user nova-compute[74805]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='4'>sim</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='32'>kc705</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='32'>ml605</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='32'>virt</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='32'>lx200</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='32'>lx60</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 15 04:10:05 user nova-compute[74805]:       <domain type='qemu'/>
Nov 15 04:10:05 user nova-compute[74805]:     </arch>
Nov 15 04:10:05 user nova-compute[74805]:     <features>
Nov 15 04:10:05 user nova-compute[74805]:       <cpuselection/>
Nov 15 04:10:05 user nova-compute[74805]:       <deviceboot/>
Nov 15 04:10:05 user nova-compute[74805]:       <disksnapshot default='on' toggle='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     </features>
Nov 15 04:10:05 user nova-compute[74805]:   </guest>
Nov 15 04:10:05 user nova-compute[74805]: </capabilities>
Nov 15 04:10:05 user nova-compute[74805]: 
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74805) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74805) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74805) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74805) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74805) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74805) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74805) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74805) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74805) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74805) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74805) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=74805) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 15 04:10:05 user nova-compute[74805]: <domainCapabilities>
Nov 15 04:10:05 user nova-compute[74805]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 04:10:05 user nova-compute[74805]:   <domain>kvm</domain>
Nov 15 04:10:05 user nova-compute[74805]:   <machine>pc-i440fx-jammy</machine>
Nov 15 04:10:05 user nova-compute[74805]:   <arch>i686</arch>
Nov 15 04:10:05 user nova-compute[74805]:   <vcpu max='255'/>
Nov 15 04:10:05 user nova-compute[74805]:   <iothreads supported='yes'/>
Nov 15 04:10:05 user nova-compute[74805]:   <os supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:     <enum name='firmware'/>
Nov 15 04:10:05 user nova-compute[74805]:     <loader supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 04:10:05 user nova-compute[74805]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 04:10:05 user nova-compute[74805]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 04:10:05 user nova-compute[74805]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 04:10:05 user nova-compute[74805]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='type'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>rom</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>pflash</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='readonly'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>yes</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>no</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='secure'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>no</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </loader>
Nov 15 04:10:05 user nova-compute[74805]:   </os>
Nov 15 04:10:05 user nova-compute[74805]:   <cpu>
Nov 15 04:10:05 user nova-compute[74805]:     <mode name='host-passthrough' supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='hostPassthroughMigratable'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>off</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </mode>
Nov 15 04:10:05 user nova-compute[74805]:     <mode name='maximum' supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='maximumMigratable'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>on</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>off</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </mode>
Nov 15 04:10:05 user nova-compute[74805]:     <mode name='host-model' supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <vendor>Intel</vendor>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='ss'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='vmx'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='pcid'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='hypervisor'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='arat'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='umip'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='md-clear'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='stibp'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='ssbd'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='ibpb'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='ibrs'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='amd-stibp'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='disable' name='erms'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='disable' name='lm'/>
Nov 15 04:10:05 user nova-compute[74805]:     </mode>
Nov 15 04:10:05 user nova-compute[74805]:     <mode name='custom' supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>qemu64</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='yes'>qemu32</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>phenom</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='yes'>pentium3</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='yes'>pentium2</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='yes'>pentium</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>n270</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>kvm64</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='yes'>kvm32</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='yes'>coreduo</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>core2duo</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>athlon</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Westmere</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Snowridge</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Skylake-Server</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Skylake-Client</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>SandyBridge</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Penryn</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Opteron_G5</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Opteron_G4</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Opteron_G3</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Opteron_G2</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Opteron_G1</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Nehalem</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>IvyBridge</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Icelake-Server</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Haswell</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>EPYC-Rome</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>EPYC-Milan</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>EPYC</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Dhyana</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Cooperlake</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Conroe</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Broadwell</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='yes'>486</model>
Nov 15 04:10:05 user nova-compute[74805]:     </mode>
Nov 15 04:10:05 user nova-compute[74805]:   </cpu>
Nov 15 04:10:05 user nova-compute[74805]:   <memoryBacking supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:     <enum name='sourceType'>
Nov 15 04:10:05 user nova-compute[74805]:       <value>file</value>
Nov 15 04:10:05 user nova-compute[74805]:       <value>anonymous</value>
Nov 15 04:10:05 user nova-compute[74805]:       <value>memfd</value>
Nov 15 04:10:05 user nova-compute[74805]:     </enum>
Nov 15 04:10:05 user nova-compute[74805]:   </memoryBacking>
Nov 15 04:10:05 user nova-compute[74805]:   <devices>
Nov 15 04:10:05 user nova-compute[74805]:     <disk supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='diskDevice'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>disk</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>cdrom</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>floppy</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>lun</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='bus'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>ide</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>fdc</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>scsi</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>usb</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>sata</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='model'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio-transitional</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio-non-transitional</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </disk>
Nov 15 04:10:05 user nova-compute[74805]:     <graphics supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='type'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>sdl</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>vnc</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>spice</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>egl-headless</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </graphics>
Nov 15 04:10:05 user nova-compute[74805]:     <video supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='modelType'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>vga</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>cirrus</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>vmvga</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>qxl</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>none</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>bochs</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>ramfb</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </video>
Nov 15 04:10:05 user nova-compute[74805]:     <hostdev supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='mode'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>subsystem</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='startupPolicy'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>default</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>mandatory</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>requisite</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>optional</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='subsysType'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>usb</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>pci</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>scsi</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='capsType'/>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='pciBackend'/>
Nov 15 04:10:05 user nova-compute[74805]:     </hostdev>
Nov 15 04:10:05 user nova-compute[74805]:     <rng supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='model'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio-transitional</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio-non-transitional</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='backendModel'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>random</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>egd</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>builtin</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </rng>
Nov 15 04:10:05 user nova-compute[74805]:     <filesystem supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='driverType'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>path</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>handle</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtiofs</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </filesystem>
Nov 15 04:10:05 user nova-compute[74805]:     <tpm supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='model'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>tpm-tis</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>tpm-crb</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='backendModel'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>passthrough</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>emulator</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </tpm>
Nov 15 04:10:05 user nova-compute[74805]:   </devices>
Nov 15 04:10:05 user nova-compute[74805]:   <features>
Nov 15 04:10:05 user nova-compute[74805]:     <gic supported='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     <vmcoreinfo supported='yes'/>
Nov 15 04:10:05 user nova-compute[74805]:     <genid supported='yes'/>
Nov 15 04:10:05 user nova-compute[74805]:     <backingStoreInput supported='yes'/>
Nov 15 04:10:05 user nova-compute[74805]:     <backup supported='yes'/>
Nov 15 04:10:05 user nova-compute[74805]:     <sev supported='no'/>
Nov 15 04:10:05 user nova-compute[74805]:   </features>
Nov 15 04:10:05 user nova-compute[74805]: </domainCapabilities>
Nov 15 04:10:05 user nova-compute[74805]:  {{(pid=74805) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 15 04:10:05 user nova-compute[74805]: <domainCapabilities>
Nov 15 04:10:05 user nova-compute[74805]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 04:10:05 user nova-compute[74805]:   <domain>kvm</domain>
Nov 15 04:10:05 user nova-compute[74805]:   <machine>pc-i440fx-6.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:   <arch>i686</arch>
Nov 15 04:10:05 user nova-compute[74805]:   <vcpu max='255'/>
Nov 15 04:10:05 user nova-compute[74805]:   <iothreads supported='yes'/>
Nov 15 04:10:05 user nova-compute[74805]:   <os supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:     <enum name='firmware'/>
Nov 15 04:10:05 user nova-compute[74805]:     <loader supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 04:10:05 user nova-compute[74805]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 04:10:05 user nova-compute[74805]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 04:10:05 user nova-compute[74805]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 04:10:05 user nova-compute[74805]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='type'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>rom</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>pflash</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='readonly'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>yes</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>no</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='secure'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>no</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </loader>
Nov 15 04:10:05 user nova-compute[74805]:   </os>
Nov 15 04:10:05 user nova-compute[74805]:   <cpu>
Nov 15 04:10:05 user nova-compute[74805]:     <mode name='host-passthrough' supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='hostPassthroughMigratable'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>off</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </mode>
Nov 15 04:10:05 user nova-compute[74805]:     <mode name='maximum' supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='maximumMigratable'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>on</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>off</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </mode>
Nov 15 04:10:05 user nova-compute[74805]:     <mode name='host-model' supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <vendor>Intel</vendor>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='ss'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='vmx'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='pcid'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='hypervisor'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='arat'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='umip'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='md-clear'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='stibp'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='ssbd'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='ibpb'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='ibrs'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='amd-stibp'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='disable' name='erms'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='disable' name='lm'/>
Nov 15 04:10:05 user nova-compute[74805]:     </mode>
Nov 15 04:10:05 user nova-compute[74805]:     <mode name='custom' supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>qemu64</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='yes'>qemu32</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>phenom</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='yes'>pentium3</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='yes'>pentium2</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='yes'>pentium</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>n270</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>kvm64</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='yes'>kvm32</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='yes'>coreduo</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>core2duo</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>athlon</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Westmere</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Snowridge</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Skylake-Server</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Skylake-Client</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>SandyBridge</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Penryn</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Opteron_G5</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Opteron_G4</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Opteron_G3</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Opteron_G2</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Opteron_G1</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Nehalem</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>IvyBridge</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Icelake-Server</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Haswell</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>EPYC-Rome</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>EPYC-Milan</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>EPYC</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Dhyana</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Cooperlake</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Conroe</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Broadwell</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='yes'>486</model>
Nov 15 04:10:05 user nova-compute[74805]:     </mode>
Nov 15 04:10:05 user nova-compute[74805]:   </cpu>
Nov 15 04:10:05 user nova-compute[74805]:   <memoryBacking supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:     <enum name='sourceType'>
Nov 15 04:10:05 user nova-compute[74805]:       <value>file</value>
Nov 15 04:10:05 user nova-compute[74805]:       <value>anonymous</value>
Nov 15 04:10:05 user nova-compute[74805]:       <value>memfd</value>
Nov 15 04:10:05 user nova-compute[74805]:     </enum>
Nov 15 04:10:05 user nova-compute[74805]:   </memoryBacking>
Nov 15 04:10:05 user nova-compute[74805]:   <devices>
Nov 15 04:10:05 user nova-compute[74805]:     <disk supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='diskDevice'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>disk</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>cdrom</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>floppy</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>lun</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='bus'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>ide</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>fdc</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>scsi</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>usb</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>sata</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='model'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio-transitional</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio-non-transitional</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </disk>
Nov 15 04:10:05 user nova-compute[74805]:     <graphics supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='type'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>sdl</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>vnc</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>spice</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>egl-headless</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </graphics>
Nov 15 04:10:05 user nova-compute[74805]:     <video supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='modelType'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>vga</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>cirrus</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>vmvga</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>qxl</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>none</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>bochs</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>ramfb</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </video>
Nov 15 04:10:05 user nova-compute[74805]:     <hostdev supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='mode'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>subsystem</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='startupPolicy'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>default</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>mandatory</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>requisite</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>optional</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='subsysType'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>usb</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>pci</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>scsi</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='capsType'/>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='pciBackend'/>
Nov 15 04:10:05 user nova-compute[74805]:     </hostdev>
Nov 15 04:10:05 user nova-compute[74805]:     <rng supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='model'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio-transitional</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio-non-transitional</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='backendModel'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>random</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>egd</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>builtin</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </rng>
Nov 15 04:10:05 user nova-compute[74805]:     <filesystem supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='driverType'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>path</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>handle</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtiofs</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </filesystem>
Nov 15 04:10:05 user nova-compute[74805]:     <tpm supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='model'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>tpm-tis</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>tpm-crb</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='backendModel'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>passthrough</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>emulator</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </tpm>
Nov 15 04:10:05 user nova-compute[74805]:   </devices>
Nov 15 04:10:05 user nova-compute[74805]:   <features>
Nov 15 04:10:05 user nova-compute[74805]:     <gic supported='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     <vmcoreinfo supported='yes'/>
Nov 15 04:10:05 user nova-compute[74805]:     <genid supported='yes'/>
Nov 15 04:10:05 user nova-compute[74805]:     <backingStoreInput supported='yes'/>
Nov 15 04:10:05 user nova-compute[74805]:     <backup supported='yes'/>
Nov 15 04:10:05 user nova-compute[74805]:     <sev supported='no'/>
Nov 15 04:10:05 user nova-compute[74805]:   </features>
Nov 15 04:10:05 user nova-compute[74805]: </domainCapabilities>
Nov 15 04:10:05 user nova-compute[74805]:  {{(pid=74805) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 15 04:10:05 user nova-compute[74805]: <domainCapabilities>
Nov 15 04:10:05 user nova-compute[74805]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 04:10:05 user nova-compute[74805]:   <domain>kvm</domain>
Nov 15 04:10:05 user nova-compute[74805]:   <machine>pc-q35-jammy</machine>
Nov 15 04:10:05 user nova-compute[74805]:   <arch>i686</arch>
Nov 15 04:10:05 user nova-compute[74805]:   <vcpu max='288'/>
Nov 15 04:10:05 user nova-compute[74805]:   <iothreads supported='yes'/>
Nov 15 04:10:05 user nova-compute[74805]:   <os supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:     <enum name='firmware'/>
Nov 15 04:10:05 user nova-compute[74805]:     <loader supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 04:10:05 user nova-compute[74805]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 04:10:05 user nova-compute[74805]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 04:10:05 user nova-compute[74805]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 04:10:05 user nova-compute[74805]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='type'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>rom</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>pflash</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='readonly'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>yes</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>no</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='secure'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>no</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </loader>
Nov 15 04:10:05 user nova-compute[74805]:   </os>
Nov 15 04:10:05 user nova-compute[74805]:   <cpu>
Nov 15 04:10:05 user nova-compute[74805]:     <mode name='host-passthrough' supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='hostPassthroughMigratable'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>off</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </mode>
Nov 15 04:10:05 user nova-compute[74805]:     <mode name='maximum' supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='maximumMigratable'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>on</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>off</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </mode>
Nov 15 04:10:05 user nova-compute[74805]:     <mode name='host-model' supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <vendor>Intel</vendor>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='ss'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='vmx'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='pcid'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='hypervisor'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='arat'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='umip'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='md-clear'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='stibp'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='ssbd'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='ibpb'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='ibrs'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='amd-stibp'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='disable' name='erms'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='disable' name='lm'/>
Nov 15 04:10:05 user nova-compute[74805]:     </mode>
Nov 15 04:10:05 user nova-compute[74805]:     <mode name='custom' supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>qemu64</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='yes'>qemu32</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>phenom</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='yes'>pentium3</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='yes'>pentium2</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='yes'>pentium</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>n270</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>kvm64</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='yes'>kvm32</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='yes'>coreduo</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>core2duo</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>athlon</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Westmere</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Snowridge</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Skylake-Server</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Skylake-Client</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>SandyBridge</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Penryn</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Opteron_G5</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Opteron_G4</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Opteron_G3</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Opteron_G2</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Opteron_G1</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Nehalem</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>IvyBridge</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Icelake-Server</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Haswell</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>EPYC-Rome</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>EPYC-Milan</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>EPYC</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Dhyana</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Cooperlake</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Conroe</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Broadwell</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='yes'>486</model>
Nov 15 04:10:05 user nova-compute[74805]:     </mode>
Nov 15 04:10:05 user nova-compute[74805]:   </cpu>
Nov 15 04:10:05 user nova-compute[74805]:   <memoryBacking supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:     <enum name='sourceType'>
Nov 15 04:10:05 user nova-compute[74805]:       <value>file</value>
Nov 15 04:10:05 user nova-compute[74805]:       <value>anonymous</value>
Nov 15 04:10:05 user nova-compute[74805]:       <value>memfd</value>
Nov 15 04:10:05 user nova-compute[74805]:     </enum>
Nov 15 04:10:05 user nova-compute[74805]:   </memoryBacking>
Nov 15 04:10:05 user nova-compute[74805]:   <devices>
Nov 15 04:10:05 user nova-compute[74805]:     <disk supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='diskDevice'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>disk</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>cdrom</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>floppy</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>lun</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='bus'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>fdc</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>scsi</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>usb</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>sata</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='model'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio-transitional</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio-non-transitional</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </disk>
Nov 15 04:10:05 user nova-compute[74805]:     <graphics supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='type'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>sdl</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>vnc</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>spice</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>egl-headless</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </graphics>
Nov 15 04:10:05 user nova-compute[74805]:     <video supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='modelType'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>vga</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>cirrus</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>vmvga</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>qxl</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>none</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>bochs</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>ramfb</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </video>
Nov 15 04:10:05 user nova-compute[74805]:     <hostdev supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='mode'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>subsystem</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='startupPolicy'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>default</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>mandatory</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>requisite</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>optional</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='subsysType'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>usb</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>pci</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>scsi</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='capsType'/>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='pciBackend'/>
Nov 15 04:10:05 user nova-compute[74805]:     </hostdev>
Nov 15 04:10:05 user nova-compute[74805]:     <rng supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='model'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio-transitional</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio-non-transitional</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='backendModel'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>random</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>egd</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>builtin</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </rng>
Nov 15 04:10:05 user nova-compute[74805]:     <filesystem supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='driverType'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>path</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>handle</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtiofs</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </filesystem>
Nov 15 04:10:05 user nova-compute[74805]:     <tpm supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='model'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>tpm-tis</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>tpm-crb</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='backendModel'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>passthrough</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>emulator</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </tpm>
Nov 15 04:10:05 user nova-compute[74805]:   </devices>
Nov 15 04:10:05 user nova-compute[74805]:   <features>
Nov 15 04:10:05 user nova-compute[74805]:     <gic supported='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     <vmcoreinfo supported='yes'/>
Nov 15 04:10:05 user nova-compute[74805]:     <genid supported='yes'/>
Nov 15 04:10:05 user nova-compute[74805]:     <backingStoreInput supported='yes'/>
Nov 15 04:10:05 user nova-compute[74805]:     <backup supported='yes'/>
Nov 15 04:10:05 user nova-compute[74805]:     <sev supported='no'/>
Nov 15 04:10:05 user nova-compute[74805]:   </features>
Nov 15 04:10:05 user nova-compute[74805]: </domainCapabilities>
Nov 15 04:10:05 user nova-compute[74805]:  {{(pid=74805) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 15 04:10:05 user nova-compute[74805]: <domainCapabilities>
Nov 15 04:10:05 user nova-compute[74805]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 04:10:05 user nova-compute[74805]:   <domain>kvm</domain>
Nov 15 04:10:05 user nova-compute[74805]:   <machine>pc-q35-6.2</machine>
Nov 15 04:10:05 user nova-compute[74805]:   <arch>i686</arch>
Nov 15 04:10:05 user nova-compute[74805]:   <vcpu max='288'/>
Nov 15 04:10:05 user nova-compute[74805]:   <iothreads supported='yes'/>
Nov 15 04:10:05 user nova-compute[74805]:   <os supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:     <enum name='firmware'/>
Nov 15 04:10:05 user nova-compute[74805]:     <loader supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 04:10:05 user nova-compute[74805]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 04:10:05 user nova-compute[74805]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 04:10:05 user nova-compute[74805]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 04:10:05 user nova-compute[74805]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='type'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>rom</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>pflash</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='readonly'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>yes</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>no</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='secure'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>no</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </loader>
Nov 15 04:10:05 user nova-compute[74805]:   </os>
Nov 15 04:10:05 user nova-compute[74805]:   <cpu>
Nov 15 04:10:05 user nova-compute[74805]:     <mode name='host-passthrough' supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='hostPassthroughMigratable'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>off</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </mode>
Nov 15 04:10:05 user nova-compute[74805]:     <mode name='maximum' supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='maximumMigratable'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>on</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>off</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </mode>
Nov 15 04:10:05 user nova-compute[74805]:     <mode name='host-model' supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <vendor>Intel</vendor>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='ss'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='vmx'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='pcid'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='hypervisor'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='arat'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='umip'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='md-clear'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='stibp'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='ssbd'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='ibpb'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='ibrs'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='amd-stibp'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='disable' name='erms'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 04:10:05 user nova-compute[74805]:       <feature policy='disable' name='lm'/>
Nov 15 04:10:05 user nova-compute[74805]:     </mode>
Nov 15 04:10:05 user nova-compute[74805]:     <mode name='custom' supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>qemu64</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='yes'>qemu32</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>phenom</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='yes'>pentium3</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='yes'>pentium2</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='yes'>pentium</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>n270</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>kvm64</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='yes'>kvm32</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='yes'>coreduo</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>core2duo</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>athlon</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Westmere</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Snowridge</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Skylake-Server</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Skylake-Client</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>SandyBridge</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Penryn</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Opteron_G5</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Opteron_G4</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Opteron_G3</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Opteron_G2</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Opteron_G1</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Nehalem</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>IvyBridge</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Icelake-Server</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Haswell</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>EPYC-Rome</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>EPYC-Milan</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>EPYC</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Dhyana</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Cooperlake</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Conroe</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='no'>Broadwell</model>
Nov 15 04:10:05 user nova-compute[74805]:       <model usable='yes'>486</model>
Nov 15 04:10:05 user nova-compute[74805]:     </mode>
Nov 15 04:10:05 user nova-compute[74805]:   </cpu>
Nov 15 04:10:05 user nova-compute[74805]:   <memoryBacking supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:     <enum name='sourceType'>
Nov 15 04:10:05 user nova-compute[74805]:       <value>file</value>
Nov 15 04:10:05 user nova-compute[74805]:       <value>anonymous</value>
Nov 15 04:10:05 user nova-compute[74805]:       <value>memfd</value>
Nov 15 04:10:05 user nova-compute[74805]:     </enum>
Nov 15 04:10:05 user nova-compute[74805]:   </memoryBacking>
Nov 15 04:10:05 user nova-compute[74805]:   <devices>
Nov 15 04:10:05 user nova-compute[74805]:     <disk supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='diskDevice'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>disk</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>cdrom</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>floppy</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>lun</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='bus'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>fdc</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>scsi</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>usb</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>sata</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='model'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio-transitional</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio-non-transitional</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </disk>
Nov 15 04:10:05 user nova-compute[74805]:     <graphics supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='type'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>sdl</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>vnc</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>spice</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>egl-headless</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </graphics>
Nov 15 04:10:05 user nova-compute[74805]:     <video supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='modelType'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>vga</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>cirrus</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>vmvga</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>qxl</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>none</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>bochs</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>ramfb</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </video>
Nov 15 04:10:05 user nova-compute[74805]:     <hostdev supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='mode'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>subsystem</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='startupPolicy'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>default</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>mandatory</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>requisite</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>optional</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='subsysType'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>usb</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>pci</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>scsi</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='capsType'/>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='pciBackend'/>
Nov 15 04:10:05 user nova-compute[74805]:     </hostdev>
Nov 15 04:10:05 user nova-compute[74805]:     <rng supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='model'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio-transitional</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtio-non-transitional</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='backendModel'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>random</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>egd</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>builtin</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </rng>
Nov 15 04:10:05 user nova-compute[74805]:     <filesystem supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='driverType'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>path</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>handle</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>virtiofs</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </filesystem>
Nov 15 04:10:05 user nova-compute[74805]:     <tpm supported='yes'>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='model'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>tpm-tis</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>tpm-crb</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:       <enum name='backendModel'>
Nov 15 04:10:05 user nova-compute[74805]:         <value>passthrough</value>
Nov 15 04:10:05 user nova-compute[74805]:         <value>emulator</value>
Nov 15 04:10:05 user nova-compute[74805]:       </enum>
Nov 15 04:10:05 user nova-compute[74805]:     </tpm>
Nov 15 04:10:05 user nova-compute[74805]:   </devices>
Nov 15 04:10:05 user nova-compute[74805]:   <features>
Nov 15 04:10:05 user nova-compute[74805]:     <gic supported='no'/>
Nov 15 04:10:05 user nova-compute[74805]:     <vmcoreinfo supported='yes'/>
Nov 15 04:10:05 user nova-compute[74805]:     <genid supported='yes'/>
Nov 15 04:10:05 user nova-compute[74805]:     <backingStoreInput supported='yes'/>
Nov 15 04:10:05 user nova-compute[74805]:     <backup supported='yes'/>
Nov 15 04:10:05 user nova-compute[74805]:     <sev supported='no'/>
Nov 15 04:10:05 user nova-compute[74805]:   </features>
Nov 15 04:10:05 user nova-compute[74805]: </domainCapabilities>
Nov 15 04:10:05 user nova-compute[74805]:  {{(pid=74805) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74805) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74805) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74805) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74805) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74805) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74805) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74805) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74805) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74805) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74805) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74805) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74805) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74805) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74805) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74805) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74805) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 04:10:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74805) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=74805) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74805) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74805) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74805) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74805) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74805) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74805) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74805) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74805) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74805) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74805) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74805) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74805) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74805) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74805) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74805) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74805) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74805) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74805) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74805) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74805) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=74805) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 15 04:10:06 user nova-compute[74805]: <domainCapabilities>
Nov 15 04:10:06 user nova-compute[74805]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 04:10:06 user nova-compute[74805]:   <domain>kvm</domain>
Nov 15 04:10:06 user nova-compute[74805]:   <machine>pc-i440fx-jammy</machine>
Nov 15 04:10:06 user nova-compute[74805]:   <arch>x86_64</arch>
Nov 15 04:10:06 user nova-compute[74805]:   <vcpu max='255'/>
Nov 15 04:10:06 user nova-compute[74805]:   <iothreads supported='yes'/>
Nov 15 04:10:06 user nova-compute[74805]:   <os supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:     <enum name='firmware'>
Nov 15 04:10:06 user nova-compute[74805]:       <value>efi</value>
Nov 15 04:10:06 user nova-compute[74805]:     </enum>
Nov 15 04:10:06 user nova-compute[74805]:     <loader supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='type'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>rom</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>pflash</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='readonly'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>yes</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>no</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='secure'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>no</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </loader>
Nov 15 04:10:06 user nova-compute[74805]:   </os>
Nov 15 04:10:06 user nova-compute[74805]:   <cpu>
Nov 15 04:10:06 user nova-compute[74805]:     <mode name='host-passthrough' supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='hostPassthroughMigratable'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>on</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>off</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </mode>
Nov 15 04:10:06 user nova-compute[74805]:     <mode name='maximum' supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='maximumMigratable'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>on</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>off</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </mode>
Nov 15 04:10:06 user nova-compute[74805]:     <mode name='host-model' supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <vendor>Intel</vendor>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='ss'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='vmx'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='pcid'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='hypervisor'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='arat'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='umip'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='md-clear'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='stibp'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='ssbd'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='invtsc'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='ibpb'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='ibrs'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='amd-stibp'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='rsba'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='disable' name='erms'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 04:10:06 user nova-compute[74805]:     </mode>
Nov 15 04:10:06 user nova-compute[74805]:     <mode name='custom' supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>qemu64</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>qemu32</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>phenom</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>pentium3</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>pentium2</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>pentium</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>n270</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>kvm64</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>kvm32</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>coreduo</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>core2duo</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>athlon</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>Westmere</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Snowridge</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Skylake-Server</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Skylake-Client</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>SandyBridge</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>Penryn</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Opteron_G5</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Opteron_G4</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Opteron_G3</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Opteron_G2</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>Opteron_G1</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>Nehalem</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>IvyBridge</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Icelake-Server</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Haswell</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>EPYC-Rome</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>EPYC-Milan</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>EPYC</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Dhyana</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Cooperlake</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>Conroe</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Broadwell</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>486</model>
Nov 15 04:10:06 user nova-compute[74805]:     </mode>
Nov 15 04:10:06 user nova-compute[74805]:   </cpu>
Nov 15 04:10:06 user nova-compute[74805]:   <memoryBacking supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:     <enum name='sourceType'>
Nov 15 04:10:06 user nova-compute[74805]:       <value>file</value>
Nov 15 04:10:06 user nova-compute[74805]:       <value>anonymous</value>
Nov 15 04:10:06 user nova-compute[74805]:       <value>memfd</value>
Nov 15 04:10:06 user nova-compute[74805]:     </enum>
Nov 15 04:10:06 user nova-compute[74805]:   </memoryBacking>
Nov 15 04:10:06 user nova-compute[74805]:   <devices>
Nov 15 04:10:06 user nova-compute[74805]:     <disk supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='diskDevice'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>disk</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>cdrom</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>floppy</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>lun</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='bus'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>ide</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>fdc</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>scsi</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>usb</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>sata</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='model'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio-transitional</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio-non-transitional</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </disk>
Nov 15 04:10:06 user nova-compute[74805]:     <graphics supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='type'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>sdl</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>vnc</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>spice</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>egl-headless</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </graphics>
Nov 15 04:10:06 user nova-compute[74805]:     <video supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='modelType'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>vga</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>cirrus</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>vmvga</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>qxl</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>none</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>bochs</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>ramfb</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </video>
Nov 15 04:10:06 user nova-compute[74805]:     <hostdev supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='mode'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>subsystem</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='startupPolicy'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>default</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>mandatory</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>requisite</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>optional</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='subsysType'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>usb</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>pci</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>scsi</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='capsType'/>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='pciBackend'/>
Nov 15 04:10:06 user nova-compute[74805]:     </hostdev>
Nov 15 04:10:06 user nova-compute[74805]:     <rng supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='model'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio-transitional</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio-non-transitional</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='backendModel'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>random</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>egd</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>builtin</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </rng>
Nov 15 04:10:06 user nova-compute[74805]:     <filesystem supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='driverType'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>path</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>handle</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtiofs</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </filesystem>
Nov 15 04:10:06 user nova-compute[74805]:     <tpm supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='model'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>tpm-tis</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>tpm-crb</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='backendModel'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>passthrough</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>emulator</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </tpm>
Nov 15 04:10:06 user nova-compute[74805]:   </devices>
Nov 15 04:10:06 user nova-compute[74805]:   <features>
Nov 15 04:10:06 user nova-compute[74805]:     <gic supported='no'/>
Nov 15 04:10:06 user nova-compute[74805]:     <vmcoreinfo supported='yes'/>
Nov 15 04:10:06 user nova-compute[74805]:     <genid supported='yes'/>
Nov 15 04:10:06 user nova-compute[74805]:     <backingStoreInput supported='yes'/>
Nov 15 04:10:06 user nova-compute[74805]:     <backup supported='yes'/>
Nov 15 04:10:06 user nova-compute[74805]:     <sev supported='no'/>
Nov 15 04:10:06 user nova-compute[74805]:   </features>
Nov 15 04:10:06 user nova-compute[74805]: </domainCapabilities>
Nov 15 04:10:06 user nova-compute[74805]:  {{(pid=74805) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 15 04:10:06 user nova-compute[74805]: <domainCapabilities>
Nov 15 04:10:06 user nova-compute[74805]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 04:10:06 user nova-compute[74805]:   <domain>kvm</domain>
Nov 15 04:10:06 user nova-compute[74805]:   <machine>pc-i440fx-6.2</machine>
Nov 15 04:10:06 user nova-compute[74805]:   <arch>x86_64</arch>
Nov 15 04:10:06 user nova-compute[74805]:   <vcpu max='255'/>
Nov 15 04:10:06 user nova-compute[74805]:   <iothreads supported='yes'/>
Nov 15 04:10:06 user nova-compute[74805]:   <os supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:     <enum name='firmware'>
Nov 15 04:10:06 user nova-compute[74805]:       <value>efi</value>
Nov 15 04:10:06 user nova-compute[74805]:     </enum>
Nov 15 04:10:06 user nova-compute[74805]:     <loader supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='type'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>rom</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>pflash</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='readonly'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>yes</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>no</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='secure'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>no</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </loader>
Nov 15 04:10:06 user nova-compute[74805]:   </os>
Nov 15 04:10:06 user nova-compute[74805]:   <cpu>
Nov 15 04:10:06 user nova-compute[74805]:     <mode name='host-passthrough' supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='hostPassthroughMigratable'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>on</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>off</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </mode>
Nov 15 04:10:06 user nova-compute[74805]:     <mode name='maximum' supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='maximumMigratable'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>on</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>off</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </mode>
Nov 15 04:10:06 user nova-compute[74805]:     <mode name='host-model' supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <vendor>Intel</vendor>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='ss'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='vmx'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='pcid'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='hypervisor'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='arat'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='umip'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='md-clear'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='stibp'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='ssbd'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='invtsc'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='ibpb'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='ibrs'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='amd-stibp'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='rsba'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='disable' name='erms'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 04:10:06 user nova-compute[74805]:     </mode>
Nov 15 04:10:06 user nova-compute[74805]:     <mode name='custom' supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>qemu64</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>qemu32</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>phenom</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>pentium3</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>pentium2</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>pentium</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>n270</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>kvm64</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>kvm32</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>coreduo</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>core2duo</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>athlon</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>Westmere</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Snowridge</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Skylake-Server</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Skylake-Client</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>SandyBridge</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>Penryn</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Opteron_G5</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Opteron_G4</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Opteron_G3</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Opteron_G2</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>Opteron_G1</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>Nehalem</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>IvyBridge</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Icelake-Server</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Haswell</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>EPYC-Rome</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>EPYC-Milan</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>EPYC</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Dhyana</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Cooperlake</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>Conroe</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Broadwell</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>486</model>
Nov 15 04:10:06 user nova-compute[74805]:     </mode>
Nov 15 04:10:06 user nova-compute[74805]:   </cpu>
Nov 15 04:10:06 user nova-compute[74805]:   <memoryBacking supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:     <enum name='sourceType'>
Nov 15 04:10:06 user nova-compute[74805]:       <value>file</value>
Nov 15 04:10:06 user nova-compute[74805]:       <value>anonymous</value>
Nov 15 04:10:06 user nova-compute[74805]:       <value>memfd</value>
Nov 15 04:10:06 user nova-compute[74805]:     </enum>
Nov 15 04:10:06 user nova-compute[74805]:   </memoryBacking>
Nov 15 04:10:06 user nova-compute[74805]:   <devices>
Nov 15 04:10:06 user nova-compute[74805]:     <disk supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='diskDevice'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>disk</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>cdrom</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>floppy</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>lun</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='bus'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>ide</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>fdc</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>scsi</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>usb</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>sata</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='model'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio-transitional</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio-non-transitional</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </disk>
Nov 15 04:10:06 user nova-compute[74805]:     <graphics supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='type'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>sdl</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>vnc</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>spice</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>egl-headless</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </graphics>
Nov 15 04:10:06 user nova-compute[74805]:     <video supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='modelType'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>vga</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>cirrus</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>vmvga</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>qxl</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>none</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>bochs</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>ramfb</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </video>
Nov 15 04:10:06 user nova-compute[74805]:     <hostdev supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='mode'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>subsystem</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='startupPolicy'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>default</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>mandatory</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>requisite</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>optional</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='subsysType'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>usb</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>pci</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>scsi</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='capsType'/>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='pciBackend'/>
Nov 15 04:10:06 user nova-compute[74805]:     </hostdev>
Nov 15 04:10:06 user nova-compute[74805]:     <rng supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='model'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio-transitional</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio-non-transitional</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='backendModel'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>random</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>egd</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>builtin</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </rng>
Nov 15 04:10:06 user nova-compute[74805]:     <filesystem supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='driverType'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>path</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>handle</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtiofs</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </filesystem>
Nov 15 04:10:06 user nova-compute[74805]:     <tpm supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='model'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>tpm-tis</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>tpm-crb</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='backendModel'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>passthrough</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>emulator</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </tpm>
Nov 15 04:10:06 user nova-compute[74805]:   </devices>
Nov 15 04:10:06 user nova-compute[74805]:   <features>
Nov 15 04:10:06 user nova-compute[74805]:     <gic supported='no'/>
Nov 15 04:10:06 user nova-compute[74805]:     <vmcoreinfo supported='yes'/>
Nov 15 04:10:06 user nova-compute[74805]:     <genid supported='yes'/>
Nov 15 04:10:06 user nova-compute[74805]:     <backingStoreInput supported='yes'/>
Nov 15 04:10:06 user nova-compute[74805]:     <backup supported='yes'/>
Nov 15 04:10:06 user nova-compute[74805]:     <sev supported='no'/>
Nov 15 04:10:06 user nova-compute[74805]:   </features>
Nov 15 04:10:06 user nova-compute[74805]: </domainCapabilities>
Nov 15 04:10:06 user nova-compute[74805]:  {{(pid=74805) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 15 04:10:06 user nova-compute[74805]: <domainCapabilities>
Nov 15 04:10:06 user nova-compute[74805]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 04:10:06 user nova-compute[74805]:   <domain>kvm</domain>
Nov 15 04:10:06 user nova-compute[74805]:   <machine>pc-q35-jammy</machine>
Nov 15 04:10:06 user nova-compute[74805]:   <arch>x86_64</arch>
Nov 15 04:10:06 user nova-compute[74805]:   <vcpu max='288'/>
Nov 15 04:10:06 user nova-compute[74805]:   <iothreads supported='yes'/>
Nov 15 04:10:06 user nova-compute[74805]:   <os supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:     <enum name='firmware'>
Nov 15 04:10:06 user nova-compute[74805]:       <value>efi</value>
Nov 15 04:10:06 user nova-compute[74805]:     </enum>
Nov 15 04:10:06 user nova-compute[74805]:     <loader supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 15 04:10:06 user nova-compute[74805]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 15 04:10:06 user nova-compute[74805]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='type'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>rom</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>pflash</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='readonly'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>yes</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>no</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='secure'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>yes</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>no</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </loader>
Nov 15 04:10:06 user nova-compute[74805]:   </os>
Nov 15 04:10:06 user nova-compute[74805]:   <cpu>
Nov 15 04:10:06 user nova-compute[74805]:     <mode name='host-passthrough' supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='hostPassthroughMigratable'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>on</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>off</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </mode>
Nov 15 04:10:06 user nova-compute[74805]:     <mode name='maximum' supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='maximumMigratable'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>on</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>off</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </mode>
Nov 15 04:10:06 user nova-compute[74805]:     <mode name='host-model' supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <vendor>Intel</vendor>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='ss'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='vmx'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='pcid'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='hypervisor'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='arat'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='umip'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='md-clear'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='stibp'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='ssbd'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='invtsc'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='ibpb'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='ibrs'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='amd-stibp'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='rsba'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='disable' name='erms'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 04:10:06 user nova-compute[74805]:     </mode>
Nov 15 04:10:06 user nova-compute[74805]:     <mode name='custom' supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>qemu64</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>qemu32</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>phenom</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>pentium3</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>pentium2</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>pentium</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>n270</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>kvm64</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>kvm32</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>coreduo</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>core2duo</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>athlon</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>Westmere</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Snowridge</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Skylake-Server</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Skylake-Client</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>SandyBridge</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>Penryn</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Opteron_G5</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Opteron_G4</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Opteron_G3</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Opteron_G2</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>Opteron_G1</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>Nehalem</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>IvyBridge</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Icelake-Server</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Haswell</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>EPYC-Rome</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>EPYC-Milan</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>EPYC</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Dhyana</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Cooperlake</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>Conroe</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Broadwell</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>486</model>
Nov 15 04:10:06 user nova-compute[74805]:     </mode>
Nov 15 04:10:06 user nova-compute[74805]:   </cpu>
Nov 15 04:10:06 user nova-compute[74805]:   <memoryBacking supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:     <enum name='sourceType'>
Nov 15 04:10:06 user nova-compute[74805]:       <value>file</value>
Nov 15 04:10:06 user nova-compute[74805]:       <value>anonymous</value>
Nov 15 04:10:06 user nova-compute[74805]:       <value>memfd</value>
Nov 15 04:10:06 user nova-compute[74805]:     </enum>
Nov 15 04:10:06 user nova-compute[74805]:   </memoryBacking>
Nov 15 04:10:06 user nova-compute[74805]:   <devices>
Nov 15 04:10:06 user nova-compute[74805]:     <disk supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='diskDevice'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>disk</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>cdrom</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>floppy</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>lun</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='bus'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>fdc</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>scsi</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>usb</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>sata</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='model'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio-transitional</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio-non-transitional</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </disk>
Nov 15 04:10:06 user nova-compute[74805]:     <graphics supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='type'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>sdl</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>vnc</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>spice</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>egl-headless</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </graphics>
Nov 15 04:10:06 user nova-compute[74805]:     <video supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='modelType'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>vga</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>cirrus</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>vmvga</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>qxl</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>none</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>bochs</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>ramfb</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </video>
Nov 15 04:10:06 user nova-compute[74805]:     <hostdev supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='mode'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>subsystem</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='startupPolicy'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>default</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>mandatory</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>requisite</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>optional</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='subsysType'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>usb</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>pci</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>scsi</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='capsType'/>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='pciBackend'/>
Nov 15 04:10:06 user nova-compute[74805]:     </hostdev>
Nov 15 04:10:06 user nova-compute[74805]:     <rng supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='model'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio-transitional</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio-non-transitional</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='backendModel'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>random</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>egd</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>builtin</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </rng>
Nov 15 04:10:06 user nova-compute[74805]:     <filesystem supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='driverType'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>path</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>handle</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtiofs</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </filesystem>
Nov 15 04:10:06 user nova-compute[74805]:     <tpm supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='model'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>tpm-tis</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>tpm-crb</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='backendModel'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>passthrough</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>emulator</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </tpm>
Nov 15 04:10:06 user nova-compute[74805]:   </devices>
Nov 15 04:10:06 user nova-compute[74805]:   <features>
Nov 15 04:10:06 user nova-compute[74805]:     <gic supported='no'/>
Nov 15 04:10:06 user nova-compute[74805]:     <vmcoreinfo supported='yes'/>
Nov 15 04:10:06 user nova-compute[74805]:     <genid supported='yes'/>
Nov 15 04:10:06 user nova-compute[74805]:     <backingStoreInput supported='yes'/>
Nov 15 04:10:06 user nova-compute[74805]:     <backup supported='yes'/>
Nov 15 04:10:06 user nova-compute[74805]:     <sev supported='no'/>
Nov 15 04:10:06 user nova-compute[74805]:   </features>
Nov 15 04:10:06 user nova-compute[74805]: </domainCapabilities>
Nov 15 04:10:06 user nova-compute[74805]:  {{(pid=74805) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 15 04:10:06 user nova-compute[74805]: <domainCapabilities>
Nov 15 04:10:06 user nova-compute[74805]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 04:10:06 user nova-compute[74805]:   <domain>kvm</domain>
Nov 15 04:10:06 user nova-compute[74805]:   <machine>pc-q35-6.2</machine>
Nov 15 04:10:06 user nova-compute[74805]:   <arch>x86_64</arch>
Nov 15 04:10:06 user nova-compute[74805]:   <vcpu max='288'/>
Nov 15 04:10:06 user nova-compute[74805]:   <iothreads supported='yes'/>
Nov 15 04:10:06 user nova-compute[74805]:   <os supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:     <enum name='firmware'>
Nov 15 04:10:06 user nova-compute[74805]:       <value>efi</value>
Nov 15 04:10:06 user nova-compute[74805]:     </enum>
Nov 15 04:10:06 user nova-compute[74805]:     <loader supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 15 04:10:06 user nova-compute[74805]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 15 04:10:06 user nova-compute[74805]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='type'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>rom</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>pflash</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='readonly'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>yes</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>no</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='secure'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>yes</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>no</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </loader>
Nov 15 04:10:06 user nova-compute[74805]:   </os>
Nov 15 04:10:06 user nova-compute[74805]:   <cpu>
Nov 15 04:10:06 user nova-compute[74805]:     <mode name='host-passthrough' supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='hostPassthroughMigratable'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>on</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>off</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </mode>
Nov 15 04:10:06 user nova-compute[74805]:     <mode name='maximum' supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='maximumMigratable'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>on</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>off</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </mode>
Nov 15 04:10:06 user nova-compute[74805]:     <mode name='host-model' supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <vendor>Intel</vendor>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='ss'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='vmx'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='pcid'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='hypervisor'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='arat'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='umip'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='md-clear'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='stibp'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='ssbd'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='invtsc'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='ibpb'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='ibrs'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='amd-stibp'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='rsba'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='disable' name='erms'/>
Nov 15 04:10:06 user nova-compute[74805]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 04:10:06 user nova-compute[74805]:     </mode>
Nov 15 04:10:06 user nova-compute[74805]:     <mode name='custom' supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>qemu64</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>qemu32</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>phenom</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>pentium3</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>pentium2</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>pentium</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>n270</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>kvm64</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>kvm32</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>coreduo</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>core2duo</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>athlon</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>Westmere</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Snowridge</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Skylake-Server</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Skylake-Client</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>SandyBridge</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>Penryn</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Opteron_G5</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Opteron_G4</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Opteron_G3</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Opteron_G2</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>Opteron_G1</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>Nehalem</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>IvyBridge</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Icelake-Server</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Haswell</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>EPYC-Rome</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>EPYC-Milan</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>EPYC</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Dhyana</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Cooperlake</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>Conroe</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='no'>Broadwell</model>
Nov 15 04:10:06 user nova-compute[74805]:       <model usable='yes'>486</model>
Nov 15 04:10:06 user nova-compute[74805]:     </mode>
Nov 15 04:10:06 user nova-compute[74805]:   </cpu>
Nov 15 04:10:06 user nova-compute[74805]:   <memoryBacking supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:     <enum name='sourceType'>
Nov 15 04:10:06 user nova-compute[74805]:       <value>file</value>
Nov 15 04:10:06 user nova-compute[74805]:       <value>anonymous</value>
Nov 15 04:10:06 user nova-compute[74805]:       <value>memfd</value>
Nov 15 04:10:06 user nova-compute[74805]:     </enum>
Nov 15 04:10:06 user nova-compute[74805]:   </memoryBacking>
Nov 15 04:10:06 user nova-compute[74805]:   <devices>
Nov 15 04:10:06 user nova-compute[74805]:     <disk supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='diskDevice'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>disk</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>cdrom</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>floppy</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>lun</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='bus'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>fdc</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>scsi</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>usb</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>sata</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='model'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio-transitional</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio-non-transitional</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </disk>
Nov 15 04:10:06 user nova-compute[74805]:     <graphics supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='type'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>sdl</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>vnc</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>spice</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>egl-headless</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </graphics>
Nov 15 04:10:06 user nova-compute[74805]:     <video supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='modelType'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>vga</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>cirrus</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>vmvga</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>qxl</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>none</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>bochs</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>ramfb</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </video>
Nov 15 04:10:06 user nova-compute[74805]:     <hostdev supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='mode'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>subsystem</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='startupPolicy'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>default</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>mandatory</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>requisite</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>optional</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='subsysType'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>usb</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>pci</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>scsi</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='capsType'/>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='pciBackend'/>
Nov 15 04:10:06 user nova-compute[74805]:     </hostdev>
Nov 15 04:10:06 user nova-compute[74805]:     <rng supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='model'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio-transitional</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtio-non-transitional</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='backendModel'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>random</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>egd</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>builtin</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </rng>
Nov 15 04:10:06 user nova-compute[74805]:     <filesystem supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='driverType'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>path</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>handle</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>virtiofs</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </filesystem>
Nov 15 04:10:06 user nova-compute[74805]:     <tpm supported='yes'>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='model'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>tpm-tis</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>tpm-crb</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:       <enum name='backendModel'>
Nov 15 04:10:06 user nova-compute[74805]:         <value>passthrough</value>
Nov 15 04:10:06 user nova-compute[74805]:         <value>emulator</value>
Nov 15 04:10:06 user nova-compute[74805]:       </enum>
Nov 15 04:10:06 user nova-compute[74805]:     </tpm>
Nov 15 04:10:06 user nova-compute[74805]:   </devices>
Nov 15 04:10:06 user nova-compute[74805]:   <features>
Nov 15 04:10:06 user nova-compute[74805]:     <gic supported='no'/>
Nov 15 04:10:06 user nova-compute[74805]:     <vmcoreinfo supported='yes'/>
Nov 15 04:10:06 user nova-compute[74805]:     <genid supported='yes'/>
Nov 15 04:10:06 user nova-compute[74805]:     <backingStoreInput supported='yes'/>
Nov 15 04:10:06 user nova-compute[74805]:     <backup supported='yes'/>
Nov 15 04:10:06 user nova-compute[74805]:     <sev supported='no'/>
Nov 15 04:10:06 user nova-compute[74805]:   </features>
Nov 15 04:10:06 user nova-compute[74805]: </domainCapabilities>
Nov 15 04:10:06 user nova-compute[74805]:  {{(pid=74805) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74805) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74805) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74805) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74805) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Checking secure boot support for host arch (x86_64) {{(pid=74805) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Checking secure boot support for host arch (x86_64) {{(pid=74805) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Checking secure boot support for host arch (x86_64) {{(pid=74805) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Checking secure boot support for host arch (x86_64) {{(pid=74805) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Checking secure boot support for host arch (x86_64) {{(pid=74805) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 04:10:06 user nova-compute[74805]: INFO nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Secure Boot support detected
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] cpu compare xml: <cpu match="exact">
Nov 15 04:10:06 user nova-compute[74805]:   <model>Nehalem</model>
Nov 15 04:10:06 user nova-compute[74805]: </cpu>
Nov 15 04:10:06 user nova-compute[74805]:  {{(pid=74805) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 15 04:10:06 user nova-compute[74805]: INFO nova.virt.node [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Generated node identity ada87504-5552-4a33-b754-f9a54c67fe39
Nov 15 04:10:06 user nova-compute[74805]: INFO nova.virt.node [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Wrote node identity ada87504-5552-4a33-b754-f9a54c67fe39 to /opt/stack/data/nova/compute_id
Nov 15 04:10:06 user nova-compute[74805]: WARNING nova.compute.manager [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Compute nodes ['ada87504-5552-4a33-b754-f9a54c67fe39'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 15 04:10:06 user nova-compute[74805]: INFO nova.compute.manager [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 15 04:10:06 user nova-compute[74805]: WARNING nova.compute.manager [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 15 04:10:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:10:06 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:10:06 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Hypervisor/Node resource view: name=user free_ram=10971MB free_disk=26.163532257080078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:10:06 user nova-compute[74805]: WARNING nova.compute.resource_tracker [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] No compute node record for user:ada87504-5552-4a33-b754-f9a54c67fe39: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host ada87504-5552-4a33-b754-f9a54c67fe39 could not be found.
Nov 15 04:10:06 user nova-compute[74805]: INFO nova.compute.resource_tracker [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Compute node record created for user:user with uuid: ada87504-5552-4a33-b754-f9a54c67fe39
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:10:06 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] [req-ee6e20af-2f3e-4358-a2e8-8349c4a7030c] Created resource provider record via placement API for resource provider with UUID ada87504-5552-4a33-b754-f9a54c67fe39 and name user.
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74805) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 15 04:10:06 user nova-compute[74805]: INFO nova.virt.libvirt.host [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] kernel doesn't support AMD SEV
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Updating inventory in ProviderTree for provider ada87504-5552-4a33-b754-f9a54c67fe39 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Libvirt baseline CPU <cpu>
Nov 15 04:10:06 user nova-compute[74805]:   <arch>x86_64</arch>
Nov 15 04:10:06 user nova-compute[74805]:   <model>Nehalem</model>
Nov 15 04:10:06 user nova-compute[74805]:   <vendor>Intel</vendor>
Nov 15 04:10:06 user nova-compute[74805]:   <topology sockets="6" cores="1" threads="1"/>
Nov 15 04:10:06 user nova-compute[74805]: </cpu>
Nov 15 04:10:06 user nova-compute[74805]:  {{(pid=74805) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Updated inventory for provider ada87504-5552-4a33-b754-f9a54c67fe39 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Updating resource provider ada87504-5552-4a33-b754-f9a54c67fe39 generation from 0 to 1 during operation: update_inventory {{(pid=74805) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 15 04:10:06 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Updating inventory in ProviderTree for provider ada87504-5552-4a33-b754-f9a54c67fe39 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 04:10:07 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Updating resource provider ada87504-5552-4a33-b754-f9a54c67fe39 generation from 1 to 2 during operation: update_traits {{(pid=74805) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 15 04:10:07 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:10:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.654s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:10:07 user nova-compute[74805]: DEBUG nova.service [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Creating RPC server for service compute {{(pid=74805) start /opt/stack/nova/nova/service.py:182}}
Nov 15 04:10:07 user nova-compute[74805]: DEBUG nova.service [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] Join ServiceGroup membership for this service compute {{(pid=74805) start /opt/stack/nova/nova/service.py:199}}
Nov 15 04:10:07 user nova-compute[74805]: DEBUG nova.servicegroup.drivers.db [None req-80376504-d86f-41e7-86df-a8e9288ddba6 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74805) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 15 04:10:44 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:10:44 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:10:58 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:10:58 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:10:58 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:10:58 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Rebuilding the list of instances to heal {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 04:10:58 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Didn't find any instances for network info cache update. {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 04:10:58 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:10:58 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:10:58 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:10:58 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:10:58 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:10:58 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:10:58 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:10:58 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:10:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:10:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:10:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:10:58 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:10:58 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:10:58 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:10:58 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=10391MB free_disk=26.067367553710938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:10:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:10:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:10:58 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:10:58 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:10:58 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:10:58 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:10:58 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:10:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:11:58 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:11:58 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:11:58 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:11:58 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Rebuilding the list of instances to heal {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 04:11:58 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Didn't find any instances for network info cache update. {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 04:11:58 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:11:58 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:11:59 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:11:59 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:11:59 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:12:00 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:12:00 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:12:00 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:12:00 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:12:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:12:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:12:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:12:00 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:12:00 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:12:00 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:12:00 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=10324MB free_disk=26.115867614746094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:12:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:12:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:12:00 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:12:00 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:12:00 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:12:00 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:12:00 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:12:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.108s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:12:59 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:12:59 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:12:59 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Rebuilding the list of instances to heal {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 04:12:59 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Didn't find any instances for network info cache update. {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 04:12:59 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:13:00 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:13:00 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:13:00 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:13:00 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:13:00 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:13:00 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:13:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:13:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:13:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:13:00 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:13:00 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:13:00 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:13:00 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=10299MB free_disk=25.88405990600586GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:13:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:13:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:13:00 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:13:00 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:13:00 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:13:00 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:13:00 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:13:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.125s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:13:01 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:13:01 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:14:00 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:14:00 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:14:00 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:14:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:00 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:14:00 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:14:00 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:14:00 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=9580MB free_disk=25.903953552246094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:14:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:00 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:14:00 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:14:00 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:14:00 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:14:00 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:14:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:01 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:14:01 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:14:01 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:14:01 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:14:01 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Rebuilding the list of instances to heal {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 04:14:01 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Didn't find any instances for network info cache update. {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 04:14:01 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:14:01 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:14:01 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:14:01 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:14:02 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:14:02 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Acquiring lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:02 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:02 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:14:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:03 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:14:03 user nova-compute[74805]: INFO nova.compute.claims [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Claim successful on node user
Nov 15 04:14:03 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:14:03 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:14:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:03 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:14:03 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:14:03 user nova-compute[74805]: DEBUG nova.network.neutron [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:14:03 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:14:03 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:14:03 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:14:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:14:03 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Creating image(s)
Nov 15 04:14:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Acquiring lock "/opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "/opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "/opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9.part --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:04 user nova-compute[74805]: DEBUG nova.policy [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6db3bb1be1914a19afb67cac89f0a35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18dc7dbc597f4befb565dcff5a92db74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:14:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9.part --force-share --output=json" returned: 0 in 0.204s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:05 user nova-compute[74805]: DEBUG nova.virt.images [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] f5f2780a-c8f6-40c5-9044-7e9b73af604f was qcow2, converting to raw {{(pid=74805) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 04:14:05 user nova-compute[74805]: DEBUG nova.privsep.utils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74805) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 04:14:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9.part /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9.converted {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9.part /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9.converted" returned: 0 in 0.154s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9.converted --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9.converted --force-share --output=json" returned: 0 in 0.171s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.495s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:05 user nova-compute[74805]: INFO oslo.privsep.daemon [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpo_lxs2lx/privsep.sock']
Nov 15 04:14:05 user sudo[84128]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpo_lxs2lx/privsep.sock
Nov 15 04:14:05 user sudo[84128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 04:14:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Acquiring lock "2921f743-66d5-47c1-b2e4-1b6957a2d550" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lock "2921f743-66d5-47c1-b2e4-1b6957a2d550" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:05 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:14:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:05 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:14:05 user nova-compute[74805]: INFO nova.compute.claims [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Claim successful on node user
Nov 15 04:14:06 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:14:06 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:14:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.289s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:06 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:14:06 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:14:06 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:14:06 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:14:06 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:14:06 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:14:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:14:06 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Creating image(s)
Nov 15 04:14:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Acquiring lock "/opt/stack/data/nova/instances/2921f743-66d5-47c1-b2e4-1b6957a2d550/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lock "/opt/stack/data/nova/instances/2921f743-66d5-47c1-b2e4-1b6957a2d550/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lock "/opt/stack/data/nova/instances/2921f743-66d5-47c1-b2e4-1b6957a2d550/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:06 user sudo[84128]: pam_unix(sudo:session): session closed for user root
Nov 15 04:14:06 user nova-compute[74805]: INFO oslo.privsep.daemon [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Spawned new privsep daemon via rootwrap
Nov 15 04:14:06 user nova-compute[74805]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 04:14:06 user nova-compute[74805]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 04:14:06 user nova-compute[74805]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 15 04:14:06 user nova-compute[74805]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84140
Nov 15 04:14:06 user nova-compute[74805]: WARNING oslo_privsep.priv_context [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] privsep daemon already running
Nov 15 04:14:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG nova.policy [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83a575fda76f42a18e836d2d1ade0c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d81fab6ad94b5984ae8f08c57ace0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.184s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.182s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.147s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk 1073741824" returned: 0 in 0.140s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.316s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG nova.network.neutron [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Successfully created port: 29f069d7-6837-470c-a8b7-5cb6225bba4e {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.170s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.164s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/2921f743-66d5-47c1-b2e4-1b6957a2d550/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/2921f743-66d5-47c1-b2e4-1b6957a2d550/disk 1073741824" returned: 0 in 0.059s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Cannot resize image /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Ensure instance console log exists: /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.159s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2921f743-66d5-47c1-b2e4-1b6957a2d550/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:14:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2921f743-66d5-47c1-b2e4-1b6957a2d550/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquiring lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2921f743-66d5-47c1-b2e4-1b6957a2d550/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:08 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Cannot resize image /opt/stack/data/nova/instances/2921f743-66d5-47c1-b2e4-1b6957a2d550/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:14:08 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:14:08 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Ensure instance console log exists: /opt/stack/data/nova/instances/2921f743-66d5-47c1-b2e4-1b6957a2d550/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:14:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:08 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:14:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:08 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:14:08 user nova-compute[74805]: INFO nova.compute.claims [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Claim successful on node user
Nov 15 04:14:08 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:14:08 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:14:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:08 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:14:08 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:14:08 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:14:08 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:14:08 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:14:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:08 user nova-compute[74805]: DEBUG nova.compute.manager [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:14:08 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:14:08 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:14:08 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Creating image(s)
Nov 15 04:14:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquiring lock "/opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "/opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "/opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:08 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:14:08 user nova-compute[74805]: INFO nova.compute.claims [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Claim successful on node user
Nov 15 04:14:08 user nova-compute[74805]: DEBUG nova.policy [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6253a7981e834ef4979d177a04e8eaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e12b863b6ed49f3a03f95c105881e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.189s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Successfully created port: ffbc1668-bf57-488c-b543-d7a288eab7a7 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.187s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk 1073741824" returned: 0 in 0.116s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.598s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG nova.compute.manager [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG nova.network.neutron [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Successfully updated port: 29f069d7-6837-470c-a8b7-5cb6225bba4e {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG nova.compute.manager [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG nova.network.neutron [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Acquiring lock "refresh_cache-2b1e540c-6226-445a-bd45-5b7b8807e2b9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Acquired lock "refresh_cache-2b1e540c-6226-445a-bd45-5b7b8807e2b9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG nova.network.neutron [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.244s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Checking if we can resize image /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:09 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:14:09 user nova-compute[74805]: DEBUG nova.compute.manager [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Cannot resize image /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Ensure instance console log exists: /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG nova.compute.manager [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:14:09 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Creating image(s)
Nov 15 04:14:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "/opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "/opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "/opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG nova.policy [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba1bcf1e429045129d379293cc490bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8280c6302b2e42998c7c436522c47e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG nova.network.neutron [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG nova.compute.manager [req-7e52db2e-1686-4e5c-9af6-a5817c24e2f4 req-71915964-6681-4b82-a93f-96bedb742d7d service nova] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Received event network-changed-29f069d7-6837-470c-a8b7-5cb6225bba4e {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG nova.compute.manager [req-7e52db2e-1686-4e5c-9af6-a5817c24e2f4 req-71915964-6681-4b82-a93f-96bedb742d7d service nova] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Refreshing instance network info cache due to event network-changed-29f069d7-6837-470c-a8b7-5cb6225bba4e. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:14:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7e52db2e-1686-4e5c-9af6-a5817c24e2f4 req-71915964-6681-4b82-a93f-96bedb742d7d service nova] Acquiring lock "refresh_cache-2b1e540c-6226-445a-bd45-5b7b8807e2b9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Acquiring lock "0de78a8a-d66a-4703-a044-89c2f2006860" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "0de78a8a-d66a-4703-a044-89c2f2006860" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.compute.manager [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.183s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk 1073741824" returned: 0 in 0.056s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:14:10 user nova-compute[74805]: INFO nova.compute.claims [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Claim successful on node user
Nov 15 04:14:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Cannot resize image /opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Ensure instance console log exists: /opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.compute.manager [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.compute.manager [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.network.neutron [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:14:10 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.network.neutron [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Updating instance_info_cache with network_info: [{"id": "29f069d7-6837-470c-a8b7-5cb6225bba4e", "address": "fa:16:3e:d3:55:85", "network": {"id": "d6c12b22-58d0-4d38-aa41-0e08de44bb3a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1369824742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dc7dbc597f4befb565dcff5a92db74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f069d7-68", "ovs_interfaceid": "29f069d7-6837-470c-a8b7-5cb6225bba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.compute.manager [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Releasing lock "refresh_cache-2b1e540c-6226-445a-bd45-5b7b8807e2b9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Instance network_info: |[{"id": "29f069d7-6837-470c-a8b7-5cb6225bba4e", "address": "fa:16:3e:d3:55:85", "network": {"id": "d6c12b22-58d0-4d38-aa41-0e08de44bb3a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1369824742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dc7dbc597f4befb565dcff5a92db74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f069d7-68", "ovs_interfaceid": "29f069d7-6837-470c-a8b7-5cb6225bba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7e52db2e-1686-4e5c-9af6-a5817c24e2f4 req-71915964-6681-4b82-a93f-96bedb742d7d service nova] Acquired lock "refresh_cache-2b1e540c-6226-445a-bd45-5b7b8807e2b9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.network.neutron [req-7e52db2e-1686-4e5c-9af6-a5817c24e2f4 req-71915964-6681-4b82-a93f-96bedb742d7d service nova] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Refreshing network info cache for port 29f069d7-6837-470c-a8b7-5cb6225bba4e {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Start _get_guest_xml network_info=[{"id": "29f069d7-6837-470c-a8b7-5cb6225bba4e", "address": "fa:16:3e:d3:55:85", "network": {"id": "d6c12b22-58d0-4d38-aa41-0e08de44bb3a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1369824742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dc7dbc597f4befb565dcff5a92db74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f069d7-68", "ovs_interfaceid": "29f069d7-6837-470c-a8b7-5cb6225bba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:14:10 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:14:10 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.privsep.utils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74805) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-470413441',display_name='tempest-ServersNegativeTestJSON-server-470413441',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-470413441',id=1,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18dc7dbc597f4befb565dcff5a92db74',ramdisk_id='',reservation_id='r-yao67dn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2049948325',owner_user_name='tempest-ServersNegativeTestJSON-2049948325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:04Z,user_data=None,user_id='6db3bb1be1914a19afb67cac89f0a35e',uuid=2b1e540c-6226-445a-bd45-5b7b8807e2b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29f069d7-6837-470c-a8b7-5cb6225bba4e", "address": "fa:16:3e:d3:55:85", "network": {"id": "d6c12b22-58d0-4d38-aa41-0e08de44bb3a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1369824742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dc7dbc597f4befb565dcff5a92db74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f069d7-68", "ovs_interfaceid": "29f069d7-6837-470c-a8b7-5cb6225bba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Converting VIF {"id": "29f069d7-6837-470c-a8b7-5cb6225bba4e", "address": "fa:16:3e:d3:55:85", "network": {"id": "d6c12b22-58d0-4d38-aa41-0e08de44bb3a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1369824742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dc7dbc597f4befb565dcff5a92db74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f069d7-68", "ovs_interfaceid": "29f069d7-6837-470c-a8b7-5cb6225bba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:55:85,bridge_name='br-int',has_traffic_filtering=True,id=29f069d7-6837-470c-a8b7-5cb6225bba4e,network=Network(d6c12b22-58d0-4d38-aa41-0e08de44bb3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29f069d7-68') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.objects.instance [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b1e540c-6226-445a-bd45-5b7b8807e2b9 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:14:10 user nova-compute[74805]: DEBUG nova.policy [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b2cddbf10a1342f3a29972aecfb8f67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc936c67de2046ff82115c5ebdb8c844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:14:11 user nova-compute[74805]:   <uuid>2b1e540c-6226-445a-bd45-5b7b8807e2b9</uuid>
Nov 15 04:14:11 user nova-compute[74805]:   <name>instance-00000001</name>
Nov 15 04:14:11 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:14:11 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:14:11 user nova-compute[74805]:   <metadata>
Nov 15 04:14:11 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:14:11 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:14:11 user nova-compute[74805]:       <nova:name>tempest-ServersNegativeTestJSON-server-470413441</nova:name>
Nov 15 04:14:11 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:14:10</nova:creationTime>
Nov 15 04:14:11 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:14:11 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:14:11 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:14:11 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:14:11 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:14:11 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:14:11 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:14:11 user nova-compute[74805]:       <nova:owner>
Nov 15 04:14:11 user nova-compute[74805]:         <nova:user uuid="6db3bb1be1914a19afb67cac89f0a35e">tempest-ServersNegativeTestJSON-2049948325-project-member</nova:user>
Nov 15 04:14:11 user nova-compute[74805]:         <nova:project uuid="18dc7dbc597f4befb565dcff5a92db74">tempest-ServersNegativeTestJSON-2049948325</nova:project>
Nov 15 04:14:11 user nova-compute[74805]:       </nova:owner>
Nov 15 04:14:11 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:14:11 user nova-compute[74805]:       <nova:ports>
Nov 15 04:14:11 user nova-compute[74805]:         <nova:port uuid="29f069d7-6837-470c-a8b7-5cb6225bba4e">
Nov 15 04:14:11 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 04:14:11 user nova-compute[74805]:         </nova:port>
Nov 15 04:14:11 user nova-compute[74805]:       </nova:ports>
Nov 15 04:14:11 user nova-compute[74805]:     </nova:instance>
Nov 15 04:14:11 user nova-compute[74805]:   </metadata>
Nov 15 04:14:11 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:14:11 user nova-compute[74805]:     <system>
Nov 15 04:14:11 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:14:11 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:14:11 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:14:11 user nova-compute[74805]:       <entry name="serial">2b1e540c-6226-445a-bd45-5b7b8807e2b9</entry>
Nov 15 04:14:11 user nova-compute[74805]:       <entry name="uuid">2b1e540c-6226-445a-bd45-5b7b8807e2b9</entry>
Nov 15 04:14:11 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:14:11 user nova-compute[74805]:     </system>
Nov 15 04:14:11 user nova-compute[74805]:   </sysinfo>
Nov 15 04:14:11 user nova-compute[74805]:   <os>
Nov 15 04:14:11 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:14:11 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:14:11 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:14:11 user nova-compute[74805]:   </os>
Nov 15 04:14:11 user nova-compute[74805]:   <features>
Nov 15 04:14:11 user nova-compute[74805]:     <acpi/>
Nov 15 04:14:11 user nova-compute[74805]:     <apic/>
Nov 15 04:14:11 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:14:11 user nova-compute[74805]:   </features>
Nov 15 04:14:11 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:14:11 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:14:11 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:14:11 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:14:11 user nova-compute[74805]:   </clock>
Nov 15 04:14:11 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:14:11 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:14:11 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:14:11 user nova-compute[74805]:   </cpu>
Nov 15 04:14:11 user nova-compute[74805]:   <devices>
Nov 15 04:14:11 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:14:11 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:14:11 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk"/>
Nov 15 04:14:11 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:14:11 user nova-compute[74805]:     </disk>
Nov 15 04:14:11 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:14:11 user nova-compute[74805]:       <mac address="fa:16:3e:d3:55:85"/>
Nov 15 04:14:11 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:14:11 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:14:11 user nova-compute[74805]:       <target dev="tap29f069d7-68"/>
Nov 15 04:14:11 user nova-compute[74805]:     </interface>
Nov 15 04:14:11 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:14:11 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/console.log" append="off"/>
Nov 15 04:14:11 user nova-compute[74805]:     </serial>
Nov 15 04:14:11 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:14:11 user nova-compute[74805]:     <video>
Nov 15 04:14:11 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:14:11 user nova-compute[74805]:     </video>
Nov 15 04:14:11 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:14:11 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:14:11 user nova-compute[74805]:     </rng>
Nov 15 04:14:11 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:14:11 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:14:11 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:14:11 user nova-compute[74805]:     </memballoon>
Nov 15 04:14:11 user nova-compute[74805]:   </devices>
Nov 15 04:14:11 user nova-compute[74805]: </domain>
Nov 15 04:14:11 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-470413441',display_name='tempest-ServersNegativeTestJSON-server-470413441',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-470413441',id=1,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18dc7dbc597f4befb565dcff5a92db74',ramdisk_id='',reservation_id='r-yao67dn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2049948325',owner_user_name='tempest-ServersNegativeTestJSON-2049948325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:04Z,user_data=None,user_id='6db3bb1be1914a19afb67cac89f0a35e',uuid=2b1e540c-6226-445a-bd45-5b7b8807e2b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29f069d7-6837-470c-a8b7-5cb6225bba4e", "address": "fa:16:3e:d3:55:85", "network": {"id": "d6c12b22-58d0-4d38-aa41-0e08de44bb3a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1369824742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dc7dbc597f4befb565dcff5a92db74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f069d7-68", "ovs_interfaceid": "29f069d7-6837-470c-a8b7-5cb6225bba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Converting VIF {"id": "29f069d7-6837-470c-a8b7-5cb6225bba4e", "address": "fa:16:3e:d3:55:85", "network": {"id": "d6c12b22-58d0-4d38-aa41-0e08de44bb3a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1369824742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dc7dbc597f4befb565dcff5a92db74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f069d7-68", "ovs_interfaceid": "29f069d7-6837-470c-a8b7-5cb6225bba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:55:85,bridge_name='br-int',has_traffic_filtering=True,id=29f069d7-6837-470c-a8b7-5cb6225bba4e,network=Network(d6c12b22-58d0-4d38-aa41-0e08de44bb3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29f069d7-68') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG os_vif [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:55:85,bridge_name='br-int',has_traffic_filtering=True,id=29f069d7-6837-470c-a8b7-5cb6225bba4e,network=Network(d6c12b22-58d0-4d38-aa41-0e08de44bb3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29f069d7-68') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Successfully created port: 2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG nova.compute.manager [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:14:11 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Creating image(s)
Nov 15 04:14:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Acquiring lock "/opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "/opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "/opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Created schema index Interface.name {{(pid=74805) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Created schema index Port.name {{(pid=74805) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Created schema index Bridge.name {{(pid=74805) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [POLLOUT] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "d63f3726-27df-455f-bda0-3ddca95b70d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "d63f3726-27df-455f-bda0-3ddca95b70d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a80a4065-06fb-5dcc-b394-caefab6c5b2f', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:14:11 user nova-compute[74805]: INFO oslo.privsep.daemon [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpd89injwa/privsep.sock']
Nov 15 04:14:11 user nova-compute[74805]: DEBUG nova.compute.manager [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:14:11 user sudo[84233]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpd89injwa/privsep.sock
Nov 15 04:14:11 user sudo[84233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 04:14:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.198s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Successfully updated port: ffbc1668-bf57-488c-b543-d7a288eab7a7 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Acquiring lock "refresh_cache-2921f743-66d5-47c1-b2e4-1b6957a2d550" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Acquired lock "refresh_cache-2921f743-66d5-47c1-b2e4-1b6957a2d550" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:14:11 user nova-compute[74805]: INFO nova.compute.claims [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Claim successful on node user
Nov 15 04:14:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.235s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk 1073741824" returned: 0 in 0.048s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG nova.compute.manager [req-82630e40-4ff8-4b4b-bc2f-8540240f58f7 req-5d9ce725-c4b1-4b8d-8438-ea77cb6c6895 service nova] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Received event network-changed-ffbc1668-bf57-488c-b543-d7a288eab7a7 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG nova.compute.manager [req-82630e40-4ff8-4b4b-bc2f-8540240f58f7 req-5d9ce725-c4b1-4b8d-8438-ea77cb6c6895 service nova] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Refreshing instance network info cache due to event network-changed-ffbc1668-bf57-488c-b543-d7a288eab7a7. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-82630e40-4ff8-4b4b-bc2f-8540240f58f7 req-5d9ce725-c4b1-4b8d-8438-ea77cb6c6895 service nova] Acquiring lock "refresh_cache-2921f743-66d5-47c1-b2e4-1b6957a2d550" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.187s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG nova.compute.manager [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG nova.compute.manager [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG nova.network.neutron [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:14:11 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:14:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Cannot resize image /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Ensure instance console log exists: /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.compute.manager [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.compute.manager [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:14:12 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Creating image(s)
Nov 15 04:14:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "/opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "/opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "/opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.policy [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0b6a8eff61f4d6ba2e83d7939143112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcdb40f067540dab36661ea0586f1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Updating instance_info_cache with network_info: [{"id": "ffbc1668-bf57-488c-b543-d7a288eab7a7", "address": "fa:16:3e:12:75:7a", "network": {"id": "a93e5b59-b6ae-4772-877c-c76e939a5f94", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1410274890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d81fab6ad94b5984ae8f08c57ace0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbc1668-bf", "ovs_interfaceid": "ffbc1668-bf57-488c-b543-d7a288eab7a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Releasing lock "refresh_cache-2921f743-66d5-47c1-b2e4-1b6957a2d550" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Instance network_info: |[{"id": "ffbc1668-bf57-488c-b543-d7a288eab7a7", "address": "fa:16:3e:12:75:7a", "network": {"id": "a93e5b59-b6ae-4772-877c-c76e939a5f94", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1410274890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d81fab6ad94b5984ae8f08c57ace0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbc1668-bf", "ovs_interfaceid": "ffbc1668-bf57-488c-b543-d7a288eab7a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-82630e40-4ff8-4b4b-bc2f-8540240f58f7 req-5d9ce725-c4b1-4b8d-8438-ea77cb6c6895 service nova] Acquired lock "refresh_cache-2921f743-66d5-47c1-b2e4-1b6957a2d550" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.network.neutron [req-82630e40-4ff8-4b4b-bc2f-8540240f58f7 req-5d9ce725-c4b1-4b8d-8438-ea77cb6c6895 service nova] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Refreshing network info cache for port ffbc1668-bf57-488c-b543-d7a288eab7a7 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Start _get_guest_xml network_info=[{"id": "ffbc1668-bf57-488c-b543-d7a288eab7a7", "address": "fa:16:3e:12:75:7a", "network": {"id": "a93e5b59-b6ae-4772-877c-c76e939a5f94", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1410274890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d81fab6ad94b5984ae8f08c57ace0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbc1668-bf", "ovs_interfaceid": "ffbc1668-bf57-488c-b543-d7a288eab7a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:14:12 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:14:12 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.network.neutron [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Successfully created port: 94bbd0d6-bf79-45aa-b274-8a9b44dd26ab {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1979337337',display_name='tempest-DeleteServersTestJSON-server-1979337337',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1979337337',id=2,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28d81fab6ad94b5984ae8f08c57ace0e',ramdisk_id='',reservation_id='r-4t2i0vt4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-242667702',owner_user_name='tempest-DeleteServersTestJSON-242667702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:07Z,user_data=None,user_id='83a575fda76f42a18e836d2d1ade0c3c',uuid=2921f743-66d5-47c1-b2e4-1b6957a2d550,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffbc1668-bf57-488c-b543-d7a288eab7a7", "address": "fa:16:3e:12:75:7a", "network": {"id": "a93e5b59-b6ae-4772-877c-c76e939a5f94", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1410274890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d81fab6ad94b5984ae8f08c57ace0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbc1668-bf", "ovs_interfaceid": "ffbc1668-bf57-488c-b543-d7a288eab7a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Converting VIF {"id": "ffbc1668-bf57-488c-b543-d7a288eab7a7", "address": "fa:16:3e:12:75:7a", "network": {"id": "a93e5b59-b6ae-4772-877c-c76e939a5f94", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1410274890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d81fab6ad94b5984ae8f08c57ace0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbc1668-bf", "ovs_interfaceid": "ffbc1668-bf57-488c-b543-d7a288eab7a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:75:7a,bridge_name='br-int',has_traffic_filtering=True,id=ffbc1668-bf57-488c-b543-d7a288eab7a7,network=Network(a93e5b59-b6ae-4772-877c-c76e939a5f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffbc1668-bf') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.objects.instance [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lazy-loading 'pci_devices' on Instance uuid 2921f743-66d5-47c1-b2e4-1b6957a2d550 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.233s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:14:12 user nova-compute[74805]:   <uuid>2921f743-66d5-47c1-b2e4-1b6957a2d550</uuid>
Nov 15 04:14:12 user nova-compute[74805]:   <name>instance-00000002</name>
Nov 15 04:14:12 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:14:12 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:14:12 user nova-compute[74805]:   <metadata>
Nov 15 04:14:12 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:14:12 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:14:12 user nova-compute[74805]:       <nova:name>tempest-DeleteServersTestJSON-server-1979337337</nova:name>
Nov 15 04:14:12 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:14:12</nova:creationTime>
Nov 15 04:14:12 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:14:12 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:14:12 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:14:12 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:14:12 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:14:12 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:14:12 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:14:12 user nova-compute[74805]:       <nova:owner>
Nov 15 04:14:12 user nova-compute[74805]:         <nova:user uuid="83a575fda76f42a18e836d2d1ade0c3c">tempest-DeleteServersTestJSON-242667702-project-member</nova:user>
Nov 15 04:14:12 user nova-compute[74805]:         <nova:project uuid="28d81fab6ad94b5984ae8f08c57ace0e">tempest-DeleteServersTestJSON-242667702</nova:project>
Nov 15 04:14:12 user nova-compute[74805]:       </nova:owner>
Nov 15 04:14:12 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:14:12 user nova-compute[74805]:       <nova:ports>
Nov 15 04:14:12 user nova-compute[74805]:         <nova:port uuid="ffbc1668-bf57-488c-b543-d7a288eab7a7">
Nov 15 04:14:12 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 04:14:12 user nova-compute[74805]:         </nova:port>
Nov 15 04:14:12 user nova-compute[74805]:       </nova:ports>
Nov 15 04:14:12 user nova-compute[74805]:     </nova:instance>
Nov 15 04:14:12 user nova-compute[74805]:   </metadata>
Nov 15 04:14:12 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:14:12 user nova-compute[74805]:     <system>
Nov 15 04:14:12 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:14:12 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:14:12 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:14:12 user nova-compute[74805]:       <entry name="serial">2921f743-66d5-47c1-b2e4-1b6957a2d550</entry>
Nov 15 04:14:12 user nova-compute[74805]:       <entry name="uuid">2921f743-66d5-47c1-b2e4-1b6957a2d550</entry>
Nov 15 04:14:12 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:14:12 user nova-compute[74805]:     </system>
Nov 15 04:14:12 user nova-compute[74805]:   </sysinfo>
Nov 15 04:14:12 user nova-compute[74805]:   <os>
Nov 15 04:14:12 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:14:12 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:14:12 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:14:12 user nova-compute[74805]:   </os>
Nov 15 04:14:12 user nova-compute[74805]:   <features>
Nov 15 04:14:12 user nova-compute[74805]:     <acpi/>
Nov 15 04:14:12 user nova-compute[74805]:     <apic/>
Nov 15 04:14:12 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:14:12 user nova-compute[74805]:   </features>
Nov 15 04:14:12 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:14:12 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:14:12 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:14:12 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:14:12 user nova-compute[74805]:   </clock>
Nov 15 04:14:12 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:14:12 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:14:12 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:14:12 user nova-compute[74805]:   </cpu>
Nov 15 04:14:12 user nova-compute[74805]:   <devices>
Nov 15 04:14:12 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:14:12 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:14:12 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/2921f743-66d5-47c1-b2e4-1b6957a2d550/disk"/>
Nov 15 04:14:12 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:14:12 user nova-compute[74805]:     </disk>
Nov 15 04:14:12 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:14:12 user nova-compute[74805]:       <mac address="fa:16:3e:12:75:7a"/>
Nov 15 04:14:12 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:14:12 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:14:12 user nova-compute[74805]:       <target dev="tapffbc1668-bf"/>
Nov 15 04:14:12 user nova-compute[74805]:     </interface>
Nov 15 04:14:12 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:14:12 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/2921f743-66d5-47c1-b2e4-1b6957a2d550/console.log" append="off"/>
Nov 15 04:14:12 user nova-compute[74805]:     </serial>
Nov 15 04:14:12 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:14:12 user nova-compute[74805]:     <video>
Nov 15 04:14:12 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:14:12 user nova-compute[74805]:     </video>
Nov 15 04:14:12 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:14:12 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:14:12 user nova-compute[74805]:     </rng>
Nov 15 04:14:12 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:14:12 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:14:12 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:14:12 user nova-compute[74805]:     </memballoon>
Nov 15 04:14:12 user nova-compute[74805]:   </devices>
Nov 15 04:14:12 user nova-compute[74805]: </domain>
Nov 15 04:14:12 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1979337337',display_name='tempest-DeleteServersTestJSON-server-1979337337',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1979337337',id=2,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28d81fab6ad94b5984ae8f08c57ace0e',ramdisk_id='',reservation_id='r-4t2i0vt4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-242667702',owner_user_name='tempest-DeleteServersTestJSON-242667702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:07Z,user_data=None,user_id='83a575fda76f42a18e836d2d1ade0c3c',uuid=2921f743-66d5-47c1-b2e4-1b6957a2d550,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffbc1668-bf57-488c-b543-d7a288eab7a7", "address": "fa:16:3e:12:75:7a", "network": {"id": "a93e5b59-b6ae-4772-877c-c76e939a5f94", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1410274890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d81fab6ad94b5984ae8f08c57ace0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbc1668-bf", "ovs_interfaceid": "ffbc1668-bf57-488c-b543-d7a288eab7a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Converting VIF {"id": "ffbc1668-bf57-488c-b543-d7a288eab7a7", "address": "fa:16:3e:12:75:7a", "network": {"id": "a93e5b59-b6ae-4772-877c-c76e939a5f94", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1410274890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d81fab6ad94b5984ae8f08c57ace0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbc1668-bf", "ovs_interfaceid": "ffbc1668-bf57-488c-b543-d7a288eab7a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:75:7a,bridge_name='br-int',has_traffic_filtering=True,id=ffbc1668-bf57-488c-b543-d7a288eab7a7,network=Network(a93e5b59-b6ae-4772-877c-c76e939a5f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffbc1668-bf') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG os_vif [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:75:7a,bridge_name='br-int',has_traffic_filtering=True,id=ffbc1668-bf57-488c-b543-d7a288eab7a7,network=Network(a93e5b59-b6ae-4772-877c-c76e939a5f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffbc1668-bf') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.network.neutron [req-7e52db2e-1686-4e5c-9af6-a5817c24e2f4 req-71915964-6681-4b82-a93f-96bedb742d7d service nova] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Updated VIF entry in instance network info cache for port 29f069d7-6837-470c-a8b7-5cb6225bba4e. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.network.neutron [req-7e52db2e-1686-4e5c-9af6-a5817c24e2f4 req-71915964-6681-4b82-a93f-96bedb742d7d service nova] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Updating instance_info_cache with network_info: [{"id": "29f069d7-6837-470c-a8b7-5cb6225bba4e", "address": "fa:16:3e:d3:55:85", "network": {"id": "d6c12b22-58d0-4d38-aa41-0e08de44bb3a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1369824742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dc7dbc597f4befb565dcff5a92db74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f069d7-68", "ovs_interfaceid": "29f069d7-6837-470c-a8b7-5cb6225bba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e54971ca-7610-5cb0-8df8-cec7f0f076b2', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7e52db2e-1686-4e5c-9af6-a5817c24e2f4 req-71915964-6681-4b82-a93f-96bedb742d7d service nova] Releasing lock "refresh_cache-2b1e540c-6226-445a-bd45-5b7b8807e2b9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.163s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk 1073741824" returned: 0 in 0.052s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:12 user sudo[84233]: pam_unix(sudo:session): session closed for user root
Nov 15 04:14:12 user nova-compute[74805]: INFO oslo.privsep.daemon [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Spawned new privsep daemon via rootwrap
Nov 15 04:14:12 user nova-compute[74805]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 04:14:12 user nova-compute[74805]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 04:14:12 user nova-compute[74805]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 15 04:14:12 user nova-compute[74805]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84254
Nov 15 04:14:12 user nova-compute[74805]: WARNING oslo_privsep.priv_context [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] privsep daemon already running
Nov 15 04:14:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.198s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Cannot resize image /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Ensure instance console log exists: /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffbc1668-bf, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapffbc1668-bf, col_values=(('qos', UUID('f4a6f073-010b-417a-b39c-6c511986cc3a')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapffbc1668-bf, col_values=(('external_ids', {'iface-id': 'ffbc1668-bf57-488c-b543-d7a288eab7a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:75:7a', 'vm-uuid': '2921f743-66d5-47c1-b2e4-1b6957a2d550'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:13 user nova-compute[74805]: DEBUG nova.network.neutron [req-82630e40-4ff8-4b4b-bc2f-8540240f58f7 req-5d9ce725-c4b1-4b8d-8438-ea77cb6c6895 service nova] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Updated VIF entry in instance network info cache for port ffbc1668-bf57-488c-b543-d7a288eab7a7. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:14:13 user nova-compute[74805]: DEBUG nova.network.neutron [req-82630e40-4ff8-4b4b-bc2f-8540240f58f7 req-5d9ce725-c4b1-4b8d-8438-ea77cb6c6895 service nova] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Updating instance_info_cache with network_info: [{"id": "ffbc1668-bf57-488c-b543-d7a288eab7a7", "address": "fa:16:3e:12:75:7a", "network": {"id": "a93e5b59-b6ae-4772-877c-c76e939a5f94", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1410274890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d81fab6ad94b5984ae8f08c57ace0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbc1668-bf", "ovs_interfaceid": "ffbc1668-bf57-488c-b543-d7a288eab7a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:14:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:14:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:13 user nova-compute[74805]: INFO os_vif [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:75:7a,bridge_name='br-int',has_traffic_filtering=True,id=ffbc1668-bf57-488c-b543-d7a288eab7a7,network=Network(a93e5b59-b6ae-4772-877c-c76e939a5f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffbc1668-bf')
Nov 15 04:14:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29f069d7-68, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29f069d7-68, col_values=(('qos', UUID('af68ec31-2348-46da-b077-73f94d37ab13')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29f069d7-68, col_values=(('external_ids', {'iface-id': '29f069d7-6837-470c-a8b7-5cb6225bba4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:55:85', 'vm-uuid': '2b1e540c-6226-445a-bd45-5b7b8807e2b9'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:14:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:13 user nova-compute[74805]: INFO os_vif [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:55:85,bridge_name='br-int',has_traffic_filtering=True,id=29f069d7-6837-470c-a8b7-5cb6225bba4e,network=Network(d6c12b22-58d0-4d38-aa41-0e08de44bb3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29f069d7-68')
Nov 15 04:14:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-82630e40-4ff8-4b4b-bc2f-8540240f58f7 req-5d9ce725-c4b1-4b8d-8438-ea77cb6c6895 service nova] Releasing lock "refresh_cache-2921f743-66d5-47c1-b2e4-1b6957a2d550" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:14:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:14:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] No VIF found with MAC fa:16:3e:d3:55:85, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:14:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:14:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] No VIF found with MAC fa:16:3e:12:75:7a, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:14:13 user nova-compute[74805]: DEBUG nova.network.neutron [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Successfully created port: 9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:14:13 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Successfully updated port: 2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:14:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquiring lock "refresh_cache-39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:14:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquired lock "refresh_cache-39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:14:13 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:14:13 user nova-compute[74805]: DEBUG nova.network.neutron [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Successfully created port: 0d0a11b6-25c5-4478-8c6f-40ac41f83b3d {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:14:13 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:14:13 user nova-compute[74805]: DEBUG nova.compute.manager [req-8ed907d3-3b24-4b05-a53e-967ca7fd709c req-ed13b97b-2449-42d8-acfe-28978a18fe14 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Received event network-changed-2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:14:13 user nova-compute[74805]: DEBUG nova.compute.manager [req-8ed907d3-3b24-4b05-a53e-967ca7fd709c req-ed13b97b-2449-42d8-acfe-28978a18fe14 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Refreshing instance network info cache due to event network-changed-2bdff360-1f21-4ce8-9c04-a5115a3316b2. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:14:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8ed907d3-3b24-4b05-a53e-967ca7fd709c req-ed13b97b-2449-42d8-acfe-28978a18fe14 service nova] Acquiring lock "refresh_cache-39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Updating instance_info_cache with network_info: [{"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.network.neutron [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Successfully updated port: 0d0a11b6-25c5-4478-8c6f-40ac41f83b3d {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "refresh_cache-d63f3726-27df-455f-bda0-3ddca95b70d9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquired lock "refresh_cache-d63f3726-27df-455f-bda0-3ddca95b70d9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.network.neutron [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Releasing lock "refresh_cache-39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Instance network_info: |[{"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8ed907d3-3b24-4b05-a53e-967ca7fd709c req-ed13b97b-2449-42d8-acfe-28978a18fe14 service nova] Acquired lock "refresh_cache-39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.network.neutron [req-8ed907d3-3b24-4b05-a53e-967ca7fd709c req-ed13b97b-2449-42d8-acfe-28978a18fe14 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Refreshing network info cache for port 2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Start _get_guest_xml network_info=[{"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:14:14 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:14:14 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2010307012',display_name='tempest-ServerActionsTestOtherB-server-2010307012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2010307012',id=3,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN2t8TNG6ZVHF/Uf5V+OtupNhI5/tplcqGEarq2oKWoGX9vvIofLCSj5BmzwvNfOMIgQ6qY6HA1c0ScmczPixk4TIDvFHJbrnEyQ0asmj0Ggpy7B5hD2wopJrs+94VPUA==',key_name='tempest-keypair-149654948',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e12b863b6ed49f3a03f95c105881e5e',ramdisk_id='',reservation_id='r-zfce7v2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-997020636',owner_user_name='tempest-ServerActionsTestOtherB-997020636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6253a7981e834ef4979d177a04e8eaf8',uuid=39ab9e2c-5856-4fe6-aa2c-42f9ac52632c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Converting VIF {"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:e7:d1,bridge_name='br-int',has_traffic_filtering=True,id=2bdff360-1f21-4ce8-9c04-a5115a3316b2,network=Network(90f83e19-1c70-437a-9f75-cbbca516eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdff360-1f') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.objects.instance [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lazy-loading 'pci_devices' on Instance uuid 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:14:14 user nova-compute[74805]:   <uuid>39ab9e2c-5856-4fe6-aa2c-42f9ac52632c</uuid>
Nov 15 04:14:14 user nova-compute[74805]:   <name>instance-00000003</name>
Nov 15 04:14:14 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:14:14 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:14:14 user nova-compute[74805]:   <metadata>
Nov 15 04:14:14 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:14:14 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:14:14 user nova-compute[74805]:       <nova:name>tempest-ServerActionsTestOtherB-server-2010307012</nova:name>
Nov 15 04:14:14 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:14:14</nova:creationTime>
Nov 15 04:14:14 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:14:14 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:14:14 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:14:14 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:14:14 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:14:14 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:14:14 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:14:14 user nova-compute[74805]:       <nova:owner>
Nov 15 04:14:14 user nova-compute[74805]:         <nova:user uuid="6253a7981e834ef4979d177a04e8eaf8">tempest-ServerActionsTestOtherB-997020636-project-member</nova:user>
Nov 15 04:14:14 user nova-compute[74805]:         <nova:project uuid="6e12b863b6ed49f3a03f95c105881e5e">tempest-ServerActionsTestOtherB-997020636</nova:project>
Nov 15 04:14:14 user nova-compute[74805]:       </nova:owner>
Nov 15 04:14:14 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:14:14 user nova-compute[74805]:       <nova:ports>
Nov 15 04:14:14 user nova-compute[74805]:         <nova:port uuid="2bdff360-1f21-4ce8-9c04-a5115a3316b2">
Nov 15 04:14:14 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 04:14:14 user nova-compute[74805]:         </nova:port>
Nov 15 04:14:14 user nova-compute[74805]:       </nova:ports>
Nov 15 04:14:14 user nova-compute[74805]:     </nova:instance>
Nov 15 04:14:14 user nova-compute[74805]:   </metadata>
Nov 15 04:14:14 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:14:14 user nova-compute[74805]:     <system>
Nov 15 04:14:14 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:14:14 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:14:14 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:14:14 user nova-compute[74805]:       <entry name="serial">39ab9e2c-5856-4fe6-aa2c-42f9ac52632c</entry>
Nov 15 04:14:14 user nova-compute[74805]:       <entry name="uuid">39ab9e2c-5856-4fe6-aa2c-42f9ac52632c</entry>
Nov 15 04:14:14 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:14:14 user nova-compute[74805]:     </system>
Nov 15 04:14:14 user nova-compute[74805]:   </sysinfo>
Nov 15 04:14:14 user nova-compute[74805]:   <os>
Nov 15 04:14:14 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:14:14 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:14:14 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:14:14 user nova-compute[74805]:   </os>
Nov 15 04:14:14 user nova-compute[74805]:   <features>
Nov 15 04:14:14 user nova-compute[74805]:     <acpi/>
Nov 15 04:14:14 user nova-compute[74805]:     <apic/>
Nov 15 04:14:14 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:14:14 user nova-compute[74805]:   </features>
Nov 15 04:14:14 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:14:14 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:14:14 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:14:14 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:14:14 user nova-compute[74805]:   </clock>
Nov 15 04:14:14 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:14:14 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:14:14 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:14:14 user nova-compute[74805]:   </cpu>
Nov 15 04:14:14 user nova-compute[74805]:   <devices>
Nov 15 04:14:14 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:14:14 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:14:14 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk"/>
Nov 15 04:14:14 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:14:14 user nova-compute[74805]:     </disk>
Nov 15 04:14:14 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:14:14 user nova-compute[74805]:       <mac address="fa:16:3e:28:e7:d1"/>
Nov 15 04:14:14 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:14:14 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:14:14 user nova-compute[74805]:       <target dev="tap2bdff360-1f"/>
Nov 15 04:14:14 user nova-compute[74805]:     </interface>
Nov 15 04:14:14 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:14:14 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/console.log" append="off"/>
Nov 15 04:14:14 user nova-compute[74805]:     </serial>
Nov 15 04:14:14 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:14:14 user nova-compute[74805]:     <video>
Nov 15 04:14:14 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:14:14 user nova-compute[74805]:     </video>
Nov 15 04:14:14 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:14:14 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:14:14 user nova-compute[74805]:     </rng>
Nov 15 04:14:14 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:14:14 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:14:14 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:14:14 user nova-compute[74805]:     </memballoon>
Nov 15 04:14:14 user nova-compute[74805]:   </devices>
Nov 15 04:14:14 user nova-compute[74805]: </domain>
Nov 15 04:14:14 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2010307012',display_name='tempest-ServerActionsTestOtherB-server-2010307012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2010307012',id=3,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN2t8TNG6ZVHF/Uf5V+OtupNhI5/tplcqGEarq2oKWoGX9vvIofLCSj5BmzwvNfOMIgQ6qY6HA1c0ScmczPixk4TIDvFHJbrnEyQ0asmj0Ggpy7B5hD2wopJrs+94VPUA==',key_name='tempest-keypair-149654948',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e12b863b6ed49f3a03f95c105881e5e',ramdisk_id='',reservation_id='r-zfce7v2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-997020636',owner_user_name='tempest-ServerActionsTestOtherB-997020636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6253a7981e834ef4979d177a04e8eaf8',uuid=39ab9e2c-5856-4fe6-aa2c-42f9ac52632c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Converting VIF {"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:e7:d1,bridge_name='br-int',has_traffic_filtering=True,id=2bdff360-1f21-4ce8-9c04-a5115a3316b2,network=Network(90f83e19-1c70-437a-9f75-cbbca516eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdff360-1f') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG os_vif [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:e7:d1,bridge_name='br-int',has_traffic_filtering=True,id=2bdff360-1f21-4ce8-9c04-a5115a3316b2,network=Network(90f83e19-1c70-437a-9f75-cbbca516eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdff360-1f') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8997d5c-65a8-5884-85c0-fee7e124b924', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.network.neutron [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.compute.manager [req-2db971aa-c8ce-4b94-b92c-42e0bd1b2603 req-a053b74e-4780-421c-9742-46960e39b32a service nova] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Received event network-changed-0d0a11b6-25c5-4478-8c6f-40ac41f83b3d {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.compute.manager [req-2db971aa-c8ce-4b94-b92c-42e0bd1b2603 req-a053b74e-4780-421c-9742-46960e39b32a service nova] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Refreshing instance network info cache due to event network-changed-0d0a11b6-25c5-4478-8c6f-40ac41f83b3d. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2db971aa-c8ce-4b94-b92c-42e0bd1b2603 req-a053b74e-4780-421c-9742-46960e39b32a service nova] Acquiring lock "refresh_cache-d63f3726-27df-455f-bda0-3ddca95b70d9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2bdff360-1f, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2bdff360-1f, col_values=(('qos', UUID('3b4351d2-480d-47fd-bad9-d2a5f577370a')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2bdff360-1f, col_values=(('external_ids', {'iface-id': '2bdff360-1f21-4ce8-9c04-a5115a3316b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:e7:d1', 'vm-uuid': '39ab9e2c-5856-4fe6-aa2c-42f9ac52632c'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:14 user nova-compute[74805]: INFO os_vif [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:e7:d1,bridge_name='br-int',has_traffic_filtering=True,id=2bdff360-1f21-4ce8-9c04-a5115a3316b2,network=Network(90f83e19-1c70-437a-9f75-cbbca516eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdff360-1f')
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] No VIF found with MAC fa:16:3e:28:e7:d1, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.network.neutron [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Updating instance_info_cache with network_info: [{"id": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "address": "fa:16:3e:b1:3d:ff", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d0a11b6-25", "ovs_interfaceid": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Releasing lock "refresh_cache-d63f3726-27df-455f-bda0-3ddca95b70d9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.compute.manager [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Instance network_info: |[{"id": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "address": "fa:16:3e:b1:3d:ff", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d0a11b6-25", "ovs_interfaceid": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2db971aa-c8ce-4b94-b92c-42e0bd1b2603 req-a053b74e-4780-421c-9742-46960e39b32a service nova] Acquired lock "refresh_cache-d63f3726-27df-455f-bda0-3ddca95b70d9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.network.neutron [req-2db971aa-c8ce-4b94-b92c-42e0bd1b2603 req-a053b74e-4780-421c-9742-46960e39b32a service nova] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Refreshing network info cache for port 0d0a11b6-25c5-4478-8c6f-40ac41f83b3d {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Start _get_guest_xml network_info=[{"id": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "address": "fa:16:3e:b1:3d:ff", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d0a11b6-25", "ovs_interfaceid": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:14:14 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:14:14 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:14:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-538134777',display_name='tempest-ServerActionsTestOtherA-server-538134777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-538134777',id=6,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGV8yvKXomaZF0BD7dR1o4bDaZdfuwtMvfH2u8DYsuFF6EZbmfxZGzCOIo9eDRbRFMNzHBU8sLiuRkxRud23xuRO+aBfUN0XRumVbmJ/zSOioI/76XwN4XIsuXVKkxna2w==',key_name='tempest-keypair-1041116715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dcdb40f067540dab36661ea0586f1d5',ramdisk_id='',reservation_id='r-tk2u5nsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1623992712',owner_user_name='tempest-ServerActionsTestOtherA-1623992712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b6a8eff61f4d6ba2e83d7939143112',uuid=d63f3726-27df-455f-bda0-3ddca95b70d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "address": "fa:16:3e:b1:3d:ff", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d0a11b6-25", "ovs_interfaceid": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converting VIF {"id": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "address": "fa:16:3e:b1:3d:ff", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d0a11b6-25", "ovs_interfaceid": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:3d:ff,bridge_name='br-int',has_traffic_filtering=True,id=0d0a11b6-25c5-4478-8c6f-40ac41f83b3d,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d0a11b6-25') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.objects.instance [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lazy-loading 'pci_devices' on Instance uuid d63f3726-27df-455f-bda0-3ddca95b70d9 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.network.neutron [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Successfully updated port: 94bbd0d6-bf79-45aa-b274-8a9b44dd26ab {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:14:15 user nova-compute[74805]:   <uuid>d63f3726-27df-455f-bda0-3ddca95b70d9</uuid>
Nov 15 04:14:15 user nova-compute[74805]:   <name>instance-00000006</name>
Nov 15 04:14:15 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:14:15 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:14:15 user nova-compute[74805]:   <metadata>
Nov 15 04:14:15 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:14:15 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:14:15 user nova-compute[74805]:       <nova:name>tempest-ServerActionsTestOtherA-server-538134777</nova:name>
Nov 15 04:14:15 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:14:14</nova:creationTime>
Nov 15 04:14:15 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:14:15 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:14:15 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:14:15 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:14:15 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:14:15 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:14:15 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:14:15 user nova-compute[74805]:       <nova:owner>
Nov 15 04:14:15 user nova-compute[74805]:         <nova:user uuid="d0b6a8eff61f4d6ba2e83d7939143112">tempest-ServerActionsTestOtherA-1623992712-project-member</nova:user>
Nov 15 04:14:15 user nova-compute[74805]:         <nova:project uuid="6dcdb40f067540dab36661ea0586f1d5">tempest-ServerActionsTestOtherA-1623992712</nova:project>
Nov 15 04:14:15 user nova-compute[74805]:       </nova:owner>
Nov 15 04:14:15 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:14:15 user nova-compute[74805]:       <nova:ports>
Nov 15 04:14:15 user nova-compute[74805]:         <nova:port uuid="0d0a11b6-25c5-4478-8c6f-40ac41f83b3d">
Nov 15 04:14:15 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 04:14:15 user nova-compute[74805]:         </nova:port>
Nov 15 04:14:15 user nova-compute[74805]:       </nova:ports>
Nov 15 04:14:15 user nova-compute[74805]:     </nova:instance>
Nov 15 04:14:15 user nova-compute[74805]:   </metadata>
Nov 15 04:14:15 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:14:15 user nova-compute[74805]:     <system>
Nov 15 04:14:15 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:14:15 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:14:15 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:14:15 user nova-compute[74805]:       <entry name="serial">d63f3726-27df-455f-bda0-3ddca95b70d9</entry>
Nov 15 04:14:15 user nova-compute[74805]:       <entry name="uuid">d63f3726-27df-455f-bda0-3ddca95b70d9</entry>
Nov 15 04:14:15 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:14:15 user nova-compute[74805]:     </system>
Nov 15 04:14:15 user nova-compute[74805]:   </sysinfo>
Nov 15 04:14:15 user nova-compute[74805]:   <os>
Nov 15 04:14:15 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:14:15 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:14:15 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:14:15 user nova-compute[74805]:   </os>
Nov 15 04:14:15 user nova-compute[74805]:   <features>
Nov 15 04:14:15 user nova-compute[74805]:     <acpi/>
Nov 15 04:14:15 user nova-compute[74805]:     <apic/>
Nov 15 04:14:15 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:14:15 user nova-compute[74805]:   </features>
Nov 15 04:14:15 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:14:15 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:14:15 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:14:15 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:14:15 user nova-compute[74805]:   </clock>
Nov 15 04:14:15 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:14:15 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:14:15 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:14:15 user nova-compute[74805]:   </cpu>
Nov 15 04:14:15 user nova-compute[74805]:   <devices>
Nov 15 04:14:15 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:14:15 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:14:15 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk"/>
Nov 15 04:14:15 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:14:15 user nova-compute[74805]:     </disk>
Nov 15 04:14:15 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:14:15 user nova-compute[74805]:       <mac address="fa:16:3e:b1:3d:ff"/>
Nov 15 04:14:15 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:14:15 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:14:15 user nova-compute[74805]:       <target dev="tap0d0a11b6-25"/>
Nov 15 04:14:15 user nova-compute[74805]:     </interface>
Nov 15 04:14:15 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:14:15 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/console.log" append="off"/>
Nov 15 04:14:15 user nova-compute[74805]:     </serial>
Nov 15 04:14:15 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:14:15 user nova-compute[74805]:     <video>
Nov 15 04:14:15 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:14:15 user nova-compute[74805]:     </video>
Nov 15 04:14:15 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:14:15 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:14:15 user nova-compute[74805]:     </rng>
Nov 15 04:14:15 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:14:15 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:14:15 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:14:15 user nova-compute[74805]:     </memballoon>
Nov 15 04:14:15 user nova-compute[74805]:   </devices>
Nov 15 04:14:15 user nova-compute[74805]: </domain>
Nov 15 04:14:15 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-538134777',display_name='tempest-ServerActionsTestOtherA-server-538134777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-538134777',id=6,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGV8yvKXomaZF0BD7dR1o4bDaZdfuwtMvfH2u8DYsuFF6EZbmfxZGzCOIo9eDRbRFMNzHBU8sLiuRkxRud23xuRO+aBfUN0XRumVbmJ/zSOioI/76XwN4XIsuXVKkxna2w==',key_name='tempest-keypair-1041116715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dcdb40f067540dab36661ea0586f1d5',ramdisk_id='',reservation_id='r-tk2u5nsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1623992712',owner_user_name='tempest-ServerActionsTestOtherA-1623992712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b6a8eff61f4d6ba2e83d7939143112',uuid=d63f3726-27df-455f-bda0-3ddca95b70d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "address": "fa:16:3e:b1:3d:ff", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d0a11b6-25", "ovs_interfaceid": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converting VIF {"id": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "address": "fa:16:3e:b1:3d:ff", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d0a11b6-25", "ovs_interfaceid": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:3d:ff,bridge_name='br-int',has_traffic_filtering=True,id=0d0a11b6-25c5-4478-8c6f-40ac41f83b3d,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d0a11b6-25') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG os_vif [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:3d:ff,bridge_name='br-int',has_traffic_filtering=True,id=0d0a11b6-25c5-4478-8c6f-40ac41f83b3d,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d0a11b6-25') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "refresh_cache-1eb9b315-77a9-40f7-8a43-8c40186a0dca" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquired lock "refresh_cache-1eb9b315-77a9-40f7-8a43-8c40186a0dca" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.network.neutron [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c69bfb9f-07bc-5c52-8de9-02035c1dbafa', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.compute.manager [req-d9597eeb-e896-4ef4-87e6-41530a0b42a1 req-bf5857b5-7be4-47df-bedb-3e81508eefd0 service nova] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Received event network-changed-94bbd0d6-bf79-45aa-b274-8a9b44dd26ab {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.compute.manager [req-d9597eeb-e896-4ef4-87e6-41530a0b42a1 req-bf5857b5-7be4-47df-bedb-3e81508eefd0 service nova] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Refreshing instance network info cache due to event network-changed-94bbd0d6-bf79-45aa-b274-8a9b44dd26ab. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d9597eeb-e896-4ef4-87e6-41530a0b42a1 req-bf5857b5-7be4-47df-bedb-3e81508eefd0 service nova] Acquiring lock "refresh_cache-1eb9b315-77a9-40f7-8a43-8c40186a0dca" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d0a11b6-25, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0d0a11b6-25, col_values=(('qos', UUID('bd2fcab0-541f-4205-a07c-bbdcb0f3db29')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0d0a11b6-25, col_values=(('external_ids', {'iface-id': '0d0a11b6-25c5-4478-8c6f-40ac41f83b3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:3d:ff', 'vm-uuid': 'd63f3726-27df-455f-bda0-3ddca95b70d9'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:15 user nova-compute[74805]: INFO os_vif [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:3d:ff,bridge_name='br-int',has_traffic_filtering=True,id=0d0a11b6-25c5-4478-8c6f-40ac41f83b3d,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d0a11b6-25')
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] No VIF found with MAC fa:16:3e:b1:3d:ff, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.network.neutron [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.network.neutron [req-2db971aa-c8ce-4b94-b92c-42e0bd1b2603 req-a053b74e-4780-421c-9742-46960e39b32a service nova] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Updated VIF entry in instance network info cache for port 0d0a11b6-25c5-4478-8c6f-40ac41f83b3d. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.network.neutron [req-2db971aa-c8ce-4b94-b92c-42e0bd1b2603 req-a053b74e-4780-421c-9742-46960e39b32a service nova] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Updating instance_info_cache with network_info: [{"id": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "address": "fa:16:3e:b1:3d:ff", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d0a11b6-25", "ovs_interfaceid": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2db971aa-c8ce-4b94-b92c-42e0bd1b2603 req-a053b74e-4780-421c-9742-46960e39b32a service nova] Releasing lock "refresh_cache-d63f3726-27df-455f-bda0-3ddca95b70d9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.network.neutron [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Updating instance_info_cache with network_info: [{"id": "94bbd0d6-bf79-45aa-b274-8a9b44dd26ab", "address": "fa:16:3e:80:32:cf", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94bbd0d6-bf", "ovs_interfaceid": "94bbd0d6-bf79-45aa-b274-8a9b44dd26ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Releasing lock "refresh_cache-1eb9b315-77a9-40f7-8a43-8c40186a0dca" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.compute.manager [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Instance network_info: |[{"id": "94bbd0d6-bf79-45aa-b274-8a9b44dd26ab", "address": "fa:16:3e:80:32:cf", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94bbd0d6-bf", "ovs_interfaceid": "94bbd0d6-bf79-45aa-b274-8a9b44dd26ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d9597eeb-e896-4ef4-87e6-41530a0b42a1 req-bf5857b5-7be4-47df-bedb-3e81508eefd0 service nova] Acquired lock "refresh_cache-1eb9b315-77a9-40f7-8a43-8c40186a0dca" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.network.neutron [req-d9597eeb-e896-4ef4-87e6-41530a0b42a1 req-bf5857b5-7be4-47df-bedb-3e81508eefd0 service nova] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Refreshing network info cache for port 94bbd0d6-bf79-45aa-b274-8a9b44dd26ab {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Start _get_guest_xml network_info=[{"id": "94bbd0d6-bf79-45aa-b274-8a9b44dd26ab", "address": "fa:16:3e:80:32:cf", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94bbd0d6-bf", "ovs_interfaceid": "94bbd0d6-bf79-45aa-b274-8a9b44dd26ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:14:15 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:14:15 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-182608907',display_name='tempest-AttachVolumeNegativeTest-server-182608907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-182608907',id=4,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUB6ZnABifX60Rx7aCctgxR0goJQCmaMO1REZVKR3evnyv0kCHcFwrrK+URZjiYPRnnqsZ27OpGG6l7q+iF9UuxPqWjfT46yC7PEfUNo4XSgR1dPGrG1THwQSF3ONDPuQ==',key_name='tempest-keypair-1757814916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8280c6302b2e42998c7c436522c47e79',ramdisk_id='',reservation_id='r-be0d6xkj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-6184130',owner_user_name='tempest-AttachVolumeNegativeTest-6184130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba1bcf1e429045129d379293cc490bde',uuid=1eb9b315-77a9-40f7-8a43-8c40186a0dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94bbd0d6-bf79-45aa-b274-8a9b44dd26ab", "address": "fa:16:3e:80:32:cf", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94bbd0d6-bf", "ovs_interfaceid": "94bbd0d6-bf79-45aa-b274-8a9b44dd26ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Converting VIF {"id": "94bbd0d6-bf79-45aa-b274-8a9b44dd26ab", "address": "fa:16:3e:80:32:cf", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94bbd0d6-bf", "ovs_interfaceid": "94bbd0d6-bf79-45aa-b274-8a9b44dd26ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:32:cf,bridge_name='br-int',has_traffic_filtering=True,id=94bbd0d6-bf79-45aa-b274-8a9b44dd26ab,network=Network(3454b4d8-1ff9-4f3c-9a93-499645affcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94bbd0d6-bf') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.objects.instance [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lazy-loading 'pci_devices' on Instance uuid 1eb9b315-77a9-40f7-8a43-8c40186a0dca {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:14:15 user nova-compute[74805]:   <uuid>1eb9b315-77a9-40f7-8a43-8c40186a0dca</uuid>
Nov 15 04:14:15 user nova-compute[74805]:   <name>instance-00000004</name>
Nov 15 04:14:15 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:14:15 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:14:15 user nova-compute[74805]:   <metadata>
Nov 15 04:14:15 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:14:15 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:14:15 user nova-compute[74805]:       <nova:name>tempest-AttachVolumeNegativeTest-server-182608907</nova:name>
Nov 15 04:14:15 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:14:15</nova:creationTime>
Nov 15 04:14:15 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:14:15 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:14:15 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:14:15 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:14:15 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:14:15 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:14:15 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:14:15 user nova-compute[74805]:       <nova:owner>
Nov 15 04:14:15 user nova-compute[74805]:         <nova:user uuid="ba1bcf1e429045129d379293cc490bde">tempest-AttachVolumeNegativeTest-6184130-project-member</nova:user>
Nov 15 04:14:15 user nova-compute[74805]:         <nova:project uuid="8280c6302b2e42998c7c436522c47e79">tempest-AttachVolumeNegativeTest-6184130</nova:project>
Nov 15 04:14:15 user nova-compute[74805]:       </nova:owner>
Nov 15 04:14:15 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:14:15 user nova-compute[74805]:       <nova:ports>
Nov 15 04:14:15 user nova-compute[74805]:         <nova:port uuid="94bbd0d6-bf79-45aa-b274-8a9b44dd26ab">
Nov 15 04:14:15 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 04:14:15 user nova-compute[74805]:         </nova:port>
Nov 15 04:14:15 user nova-compute[74805]:       </nova:ports>
Nov 15 04:14:15 user nova-compute[74805]:     </nova:instance>
Nov 15 04:14:15 user nova-compute[74805]:   </metadata>
Nov 15 04:14:15 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:14:15 user nova-compute[74805]:     <system>
Nov 15 04:14:15 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:14:15 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:14:15 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:14:15 user nova-compute[74805]:       <entry name="serial">1eb9b315-77a9-40f7-8a43-8c40186a0dca</entry>
Nov 15 04:14:15 user nova-compute[74805]:       <entry name="uuid">1eb9b315-77a9-40f7-8a43-8c40186a0dca</entry>
Nov 15 04:14:15 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:14:15 user nova-compute[74805]:     </system>
Nov 15 04:14:15 user nova-compute[74805]:   </sysinfo>
Nov 15 04:14:15 user nova-compute[74805]:   <os>
Nov 15 04:14:15 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:14:15 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:14:15 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:14:15 user nova-compute[74805]:   </os>
Nov 15 04:14:15 user nova-compute[74805]:   <features>
Nov 15 04:14:15 user nova-compute[74805]:     <acpi/>
Nov 15 04:14:15 user nova-compute[74805]:     <apic/>
Nov 15 04:14:15 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:14:15 user nova-compute[74805]:   </features>
Nov 15 04:14:15 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:14:15 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:14:15 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:14:15 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:14:15 user nova-compute[74805]:   </clock>
Nov 15 04:14:15 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:14:15 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:14:15 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:14:15 user nova-compute[74805]:   </cpu>
Nov 15 04:14:15 user nova-compute[74805]:   <devices>
Nov 15 04:14:15 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:14:15 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:14:15 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk"/>
Nov 15 04:14:15 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:14:15 user nova-compute[74805]:     </disk>
Nov 15 04:14:15 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:14:15 user nova-compute[74805]:       <mac address="fa:16:3e:80:32:cf"/>
Nov 15 04:14:15 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:14:15 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:14:15 user nova-compute[74805]:       <target dev="tap94bbd0d6-bf"/>
Nov 15 04:14:15 user nova-compute[74805]:     </interface>
Nov 15 04:14:15 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:14:15 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/console.log" append="off"/>
Nov 15 04:14:15 user nova-compute[74805]:     </serial>
Nov 15 04:14:15 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:14:15 user nova-compute[74805]:     <video>
Nov 15 04:14:15 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:14:15 user nova-compute[74805]:     </video>
Nov 15 04:14:15 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:14:15 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:14:15 user nova-compute[74805]:     </rng>
Nov 15 04:14:15 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:14:15 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:14:15 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:14:15 user nova-compute[74805]:     </memballoon>
Nov 15 04:14:15 user nova-compute[74805]:   </devices>
Nov 15 04:14:15 user nova-compute[74805]: </domain>
Nov 15 04:14:15 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-182608907',display_name='tempest-AttachVolumeNegativeTest-server-182608907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-182608907',id=4,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUB6ZnABifX60Rx7aCctgxR0goJQCmaMO1REZVKR3evnyv0kCHcFwrrK+URZjiYPRnnqsZ27OpGG6l7q+iF9UuxPqWjfT46yC7PEfUNo4XSgR1dPGrG1THwQSF3ONDPuQ==',key_name='tempest-keypair-1757814916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8280c6302b2e42998c7c436522c47e79',ramdisk_id='',reservation_id='r-be0d6xkj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-6184130',owner_user_name='tempest-AttachVolumeNegativeTest-6184130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba1bcf1e429045129d379293cc490bde',uuid=1eb9b315-77a9-40f7-8a43-8c40186a0dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94bbd0d6-bf79-45aa-b274-8a9b44dd26ab", "address": "fa:16:3e:80:32:cf", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94bbd0d6-bf", "ovs_interfaceid": "94bbd0d6-bf79-45aa-b274-8a9b44dd26ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Converting VIF {"id": "94bbd0d6-bf79-45aa-b274-8a9b44dd26ab", "address": "fa:16:3e:80:32:cf", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94bbd0d6-bf", "ovs_interfaceid": "94bbd0d6-bf79-45aa-b274-8a9b44dd26ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:32:cf,bridge_name='br-int',has_traffic_filtering=True,id=94bbd0d6-bf79-45aa-b274-8a9b44dd26ab,network=Network(3454b4d8-1ff9-4f3c-9a93-499645affcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94bbd0d6-bf') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG os_vif [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:32:cf,bridge_name='br-int',has_traffic_filtering=True,id=94bbd0d6-bf79-45aa-b274-8a9b44dd26ab,network=Network(3454b4d8-1ff9-4f3c-9a93-499645affcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94bbd0d6-bf') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '84503fce-0723-5015-8c9d-45777c4c0e70', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94bbd0d6-bf, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94bbd0d6-bf, col_values=(('qos', UUID('deb5d9f2-1b83-4f91-81e6-749673a4b8a1')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94bbd0d6-bf, col_values=(('external_ids', {'iface-id': '94bbd0d6-bf79-45aa-b274-8a9b44dd26ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:32:cf', 'vm-uuid': '1eb9b315-77a9-40f7-8a43-8c40186a0dca'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:14:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:16 user nova-compute[74805]: INFO os_vif [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:32:cf,bridge_name='br-int',has_traffic_filtering=True,id=94bbd0d6-bf79-45aa-b274-8a9b44dd26ab,network=Network(3454b4d8-1ff9-4f3c-9a93-499645affcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94bbd0d6-bf')
Nov 15 04:14:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:14:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] No VIF found with MAC fa:16:3e:80:32:cf, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:14:16 user nova-compute[74805]: DEBUG nova.network.neutron [req-8ed907d3-3b24-4b05-a53e-967ca7fd709c req-ed13b97b-2449-42d8-acfe-28978a18fe14 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Updated VIF entry in instance network info cache for port 2bdff360-1f21-4ce8-9c04-a5115a3316b2. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:14:16 user nova-compute[74805]: DEBUG nova.network.neutron [req-8ed907d3-3b24-4b05-a53e-967ca7fd709c req-ed13b97b-2449-42d8-acfe-28978a18fe14 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Updating instance_info_cache with network_info: [{"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:14:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8ed907d3-3b24-4b05-a53e-967ca7fd709c req-ed13b97b-2449-42d8-acfe-28978a18fe14 service nova] Releasing lock "refresh_cache-39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:14:16 user nova-compute[74805]: DEBUG nova.network.neutron [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Successfully updated port: 9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:14:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Acquiring lock "refresh_cache-0de78a8a-d66a-4703-a044-89c2f2006860" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:14:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Acquired lock "refresh_cache-0de78a8a-d66a-4703-a044-89c2f2006860" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:14:16 user nova-compute[74805]: DEBUG nova.network.neutron [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:14:16 user nova-compute[74805]: DEBUG nova.compute.manager [req-f2a0f709-54c4-4725-bedf-d316efc948c4 req-2b61f3b2-a0a7-4dc7-bcc1-3783a5d91443 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Received event network-changed-9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:14:16 user nova-compute[74805]: DEBUG nova.compute.manager [req-f2a0f709-54c4-4725-bedf-d316efc948c4 req-2b61f3b2-a0a7-4dc7-bcc1-3783a5d91443 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Refreshing instance network info cache due to event network-changed-9f426f7d-ce70-41ba-affa-652a4f62a571. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:14:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f2a0f709-54c4-4725-bedf-d316efc948c4 req-2b61f3b2-a0a7-4dc7-bcc1-3783a5d91443 service nova] Acquiring lock "refresh_cache-0de78a8a-d66a-4703-a044-89c2f2006860" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:14:16 user nova-compute[74805]: DEBUG nova.network.neutron [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:14:16 user nova-compute[74805]: DEBUG nova.network.neutron [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Updating instance_info_cache with network_info: [{"id": "9f426f7d-ce70-41ba-affa-652a4f62a571", "address": "fa:16:3e:74:98:ab", "network": {"id": "e6f9095e-b477-4654-9fb7-7322e7bb3b9d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1108878484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc936c67de2046ff82115c5ebdb8c844", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f426f7d-ce", "ovs_interfaceid": "9f426f7d-ce70-41ba-affa-652a4f62a571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:14:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Releasing lock "refresh_cache-0de78a8a-d66a-4703-a044-89c2f2006860" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:14:16 user nova-compute[74805]: DEBUG nova.compute.manager [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Instance network_info: |[{"id": "9f426f7d-ce70-41ba-affa-652a4f62a571", "address": "fa:16:3e:74:98:ab", "network": {"id": "e6f9095e-b477-4654-9fb7-7322e7bb3b9d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1108878484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc936c67de2046ff82115c5ebdb8c844", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f426f7d-ce", "ovs_interfaceid": "9f426f7d-ce70-41ba-affa-652a4f62a571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:14:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f2a0f709-54c4-4725-bedf-d316efc948c4 req-2b61f3b2-a0a7-4dc7-bcc1-3783a5d91443 service nova] Acquired lock "refresh_cache-0de78a8a-d66a-4703-a044-89c2f2006860" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:14:16 user nova-compute[74805]: DEBUG nova.network.neutron [req-f2a0f709-54c4-4725-bedf-d316efc948c4 req-2b61f3b2-a0a7-4dc7-bcc1-3783a5d91443 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Refreshing network info cache for port 9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:14:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Start _get_guest_xml network_info=[{"id": "9f426f7d-ce70-41ba-affa-652a4f62a571", "address": "fa:16:3e:74:98:ab", "network": {"id": "e6f9095e-b477-4654-9fb7-7322e7bb3b9d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1108878484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc936c67de2046ff82115c5ebdb8c844", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f426f7d-ce", "ovs_interfaceid": "9f426f7d-ce70-41ba-affa-652a4f62a571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:14:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:17 user nova-compute[74805]: DEBUG nova.network.neutron [req-d9597eeb-e896-4ef4-87e6-41530a0b42a1 req-bf5857b5-7be4-47df-bedb-3e81508eefd0 service nova] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Updated VIF entry in instance network info cache for port 94bbd0d6-bf79-45aa-b274-8a9b44dd26ab. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:14:17 user nova-compute[74805]: DEBUG nova.network.neutron [req-d9597eeb-e896-4ef4-87e6-41530a0b42a1 req-bf5857b5-7be4-47df-bedb-3e81508eefd0 service nova] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Updating instance_info_cache with network_info: [{"id": "94bbd0d6-bf79-45aa-b274-8a9b44dd26ab", "address": "fa:16:3e:80:32:cf", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94bbd0d6-bf", "ovs_interfaceid": "94bbd0d6-bf79-45aa-b274-8a9b44dd26ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:14:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d9597eeb-e896-4ef4-87e6-41530a0b42a1 req-bf5857b5-7be4-47df-bedb-3e81508eefd0 service nova] Releasing lock "refresh_cache-1eb9b315-77a9-40f7-8a43-8c40186a0dca" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:14:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:17 user nova-compute[74805]: DEBUG nova.network.neutron [req-f2a0f709-54c4-4725-bedf-d316efc948c4 req-2b61f3b2-a0a7-4dc7-bcc1-3783a5d91443 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Updated VIF entry in instance network info cache for port 9f426f7d-ce70-41ba-affa-652a4f62a571. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:14:17 user nova-compute[74805]: DEBUG nova.network.neutron [req-f2a0f709-54c4-4725-bedf-d316efc948c4 req-2b61f3b2-a0a7-4dc7-bcc1-3783a5d91443 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Updating instance_info_cache with network_info: [{"id": "9f426f7d-ce70-41ba-affa-652a4f62a571", "address": "fa:16:3e:74:98:ab", "network": {"id": "e6f9095e-b477-4654-9fb7-7322e7bb3b9d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1108878484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc936c67de2046ff82115c5ebdb8c844", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f426f7d-ce", "ovs_interfaceid": "9f426f7d-ce70-41ba-affa-652a4f62a571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:14:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f2a0f709-54c4-4725-bedf-d316efc948c4 req-2b61f3b2-a0a7-4dc7-bcc1-3783a5d91443 service nova] Releasing lock "refresh_cache-0de78a8a-d66a-4703-a044-89c2f2006860" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:14:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:14:22 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Instance spawned successfully.
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:14:22 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:14:22 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-245989285',display_name='tempest-ServerStableDeviceRescueTest-server-245989285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-245989285',id=5,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE2W8hpxsH+Gx6uZHNfH48qELq4dB6yQZcCESM+knrhVIpfQxBPyOS7IitFzr8Zvm+MZl66RxoPJJ44CmxBQaN/PxK9MK0YRtI4voa1XFvjw53ch4lAnIci9EzvGLMftA==',key_name='tempest-keypair-1768731695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc936c67de2046ff82115c5ebdb8c844',ramdisk_id='',reservation_id='r-ztm7khyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1093147709',owner_user_name='tempest-ServerStableDeviceRescueTest-1093147709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2cddbf10a1342f3a29972aecfb8f67d',uuid=0de78a8a-d66a-4703-a044-89c2f2006860,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f426f7d-ce70-41ba-affa-652a4f62a571", "address": "fa:16:3e:74:98:ab", "network": {"id": "e6f9095e-b477-4654-9fb7-7322e7bb3b9d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1108878484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc936c67de2046ff82115c5ebdb8c844", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f426f7d-ce", "ovs_interfaceid": "9f426f7d-ce70-41ba-affa-652a4f62a571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Converting VIF {"id": "9f426f7d-ce70-41ba-affa-652a4f62a571", "address": "fa:16:3e:74:98:ab", "network": {"id": "e6f9095e-b477-4654-9fb7-7322e7bb3b9d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1108878484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc936c67de2046ff82115c5ebdb8c844", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f426f7d-ce", "ovs_interfaceid": "9f426f7d-ce70-41ba-affa-652a4f62a571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:98:ab,bridge_name='br-int',has_traffic_filtering=True,id=9f426f7d-ce70-41ba-affa-652a4f62a571,network=Network(e6f9095e-b477-4654-9fb7-7322e7bb3b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f426f7d-ce') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.objects.instance [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lazy-loading 'pci_devices' on Instance uuid 0de78a8a-d66a-4703-a044-89c2f2006860 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:14:22 user nova-compute[74805]:   <uuid>0de78a8a-d66a-4703-a044-89c2f2006860</uuid>
Nov 15 04:14:22 user nova-compute[74805]:   <name>instance-00000005</name>
Nov 15 04:14:22 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:14:22 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:14:22 user nova-compute[74805]:   <metadata>
Nov 15 04:14:22 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:14:22 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:14:22 user nova-compute[74805]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-245989285</nova:name>
Nov 15 04:14:22 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:14:22</nova:creationTime>
Nov 15 04:14:22 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:14:22 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:14:22 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:14:22 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:14:22 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:14:22 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:14:22 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:14:22 user nova-compute[74805]:       <nova:owner>
Nov 15 04:14:22 user nova-compute[74805]:         <nova:user uuid="b2cddbf10a1342f3a29972aecfb8f67d">tempest-ServerStableDeviceRescueTest-1093147709-project-member</nova:user>
Nov 15 04:14:22 user nova-compute[74805]:         <nova:project uuid="fc936c67de2046ff82115c5ebdb8c844">tempest-ServerStableDeviceRescueTest-1093147709</nova:project>
Nov 15 04:14:22 user nova-compute[74805]:       </nova:owner>
Nov 15 04:14:22 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:14:22 user nova-compute[74805]:       <nova:ports>
Nov 15 04:14:22 user nova-compute[74805]:         <nova:port uuid="9f426f7d-ce70-41ba-affa-652a4f62a571">
Nov 15 04:14:22 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 04:14:22 user nova-compute[74805]:         </nova:port>
Nov 15 04:14:22 user nova-compute[74805]:       </nova:ports>
Nov 15 04:14:22 user nova-compute[74805]:     </nova:instance>
Nov 15 04:14:22 user nova-compute[74805]:   </metadata>
Nov 15 04:14:22 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:14:22 user nova-compute[74805]:     <system>
Nov 15 04:14:22 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:14:22 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:14:22 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:14:22 user nova-compute[74805]:       <entry name="serial">0de78a8a-d66a-4703-a044-89c2f2006860</entry>
Nov 15 04:14:22 user nova-compute[74805]:       <entry name="uuid">0de78a8a-d66a-4703-a044-89c2f2006860</entry>
Nov 15 04:14:22 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:14:22 user nova-compute[74805]:     </system>
Nov 15 04:14:22 user nova-compute[74805]:   </sysinfo>
Nov 15 04:14:22 user nova-compute[74805]:   <os>
Nov 15 04:14:22 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:14:22 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:14:22 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:14:22 user nova-compute[74805]:   </os>
Nov 15 04:14:22 user nova-compute[74805]:   <features>
Nov 15 04:14:22 user nova-compute[74805]:     <acpi/>
Nov 15 04:14:22 user nova-compute[74805]:     <apic/>
Nov 15 04:14:22 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:14:22 user nova-compute[74805]:   </features>
Nov 15 04:14:22 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:14:22 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:14:22 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:14:22 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:14:22 user nova-compute[74805]:   </clock>
Nov 15 04:14:22 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:14:22 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:14:22 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:14:22 user nova-compute[74805]:   </cpu>
Nov 15 04:14:22 user nova-compute[74805]:   <devices>
Nov 15 04:14:22 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:14:22 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:14:22 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk"/>
Nov 15 04:14:22 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:14:22 user nova-compute[74805]:     </disk>
Nov 15 04:14:22 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:14:22 user nova-compute[74805]:       <mac address="fa:16:3e:74:98:ab"/>
Nov 15 04:14:22 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:14:22 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:14:22 user nova-compute[74805]:       <target dev="tap9f426f7d-ce"/>
Nov 15 04:14:22 user nova-compute[74805]:     </interface>
Nov 15 04:14:22 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:14:22 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/console.log" append="off"/>
Nov 15 04:14:22 user nova-compute[74805]:     </serial>
Nov 15 04:14:22 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:14:22 user nova-compute[74805]:     <video>
Nov 15 04:14:22 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:14:22 user nova-compute[74805]:     </video>
Nov 15 04:14:22 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:14:22 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:14:22 user nova-compute[74805]:     </rng>
Nov 15 04:14:22 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:14:22 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:14:22 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:14:22 user nova-compute[74805]:     </memballoon>
Nov 15 04:14:22 user nova-compute[74805]:   </devices>
Nov 15 04:14:22 user nova-compute[74805]: </domain>
Nov 15 04:14:22 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-245989285',display_name='tempest-ServerStableDeviceRescueTest-server-245989285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-245989285',id=5,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE2W8hpxsH+Gx6uZHNfH48qELq4dB6yQZcCESM+knrhVIpfQxBPyOS7IitFzr8Zvm+MZl66RxoPJJ44CmxBQaN/PxK9MK0YRtI4voa1XFvjw53ch4lAnIci9EzvGLMftA==',key_name='tempest-keypair-1768731695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc936c67de2046ff82115c5ebdb8c844',ramdisk_id='',reservation_id='r-ztm7khyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1093147709',owner_user_name='tempest-ServerStableDeviceRescueTest-1093147709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2cddbf10a1342f3a29972aecfb8f67d',uuid=0de78a8a-d66a-4703-a044-89c2f2006860,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f426f7d-ce70-41ba-affa-652a4f62a571", "address": "fa:16:3e:74:98:ab", "network": {"id": "e6f9095e-b477-4654-9fb7-7322e7bb3b9d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1108878484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc936c67de2046ff82115c5ebdb8c844", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f426f7d-ce", "ovs_interfaceid": "9f426f7d-ce70-41ba-affa-652a4f62a571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Converting VIF {"id": "9f426f7d-ce70-41ba-affa-652a4f62a571", "address": "fa:16:3e:74:98:ab", "network": {"id": "e6f9095e-b477-4654-9fb7-7322e7bb3b9d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1108878484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc936c67de2046ff82115c5ebdb8c844", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f426f7d-ce", "ovs_interfaceid": "9f426f7d-ce70-41ba-affa-652a4f62a571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:98:ab,bridge_name='br-int',has_traffic_filtering=True,id=9f426f7d-ce70-41ba-affa-652a4f62a571,network=Network(e6f9095e-b477-4654-9fb7-7322e7bb3b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f426f7d-ce') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG os_vif [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:98:ab,bridge_name='br-int',has_traffic_filtering=True,id=9f426f7d-ce70-41ba-affa-652a4f62a571,network=Network(e6f9095e-b477-4654-9fb7-7322e7bb3b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f426f7d-ce') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f638174-cc79-5346-b0b1-4654c92c453b', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f426f7d-ce, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f426f7d-ce, col_values=(('qos', UUID('cb1c0377-c065-4cec-a2ea-ff9192f22f52')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f426f7d-ce, col_values=(('external_ids', {'iface-id': '9f426f7d-ce70-41ba-affa-652a4f62a571', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:98:ab', 'vm-uuid': '0de78a8a-d66a-4703-a044-89c2f2006860'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:22 user nova-compute[74805]: INFO os_vif [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:98:ab,bridge_name='br-int',has_traffic_filtering=True,id=9f426f7d-ce70-41ba-affa-652a4f62a571,network=Network(e6f9095e-b477-4654-9fb7-7322e7bb3b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f426f7d-ce')
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] No VIF found with MAC fa:16:3e:74:98:ab, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:14:22 user nova-compute[74805]: INFO nova.compute.manager [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Took 18.55 seconds to spawn the instance on the hypervisor.
Nov 15 04:14:22 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:14:23 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Instance spawned successfully.
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:23 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Instance spawned successfully.
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.compute.manager [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:14:23 user nova-compute[74805]: INFO nova.compute.manager [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Took 20.63 seconds to build instance.
Nov 15 04:14:23 user nova-compute[74805]: INFO nova.compute.manager [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Took 17.09 seconds to spawn the instance on the hypervisor.
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.compute.manager [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:14:23 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Instance spawned successfully.
Nov 15 04:14:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0195986e-b732-4a1c-835a-c5ca1f5f1517 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.962s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:23 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Instance spawned successfully.
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:23 user nova-compute[74805]: INFO nova.compute.manager [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Took 15.08 seconds to spawn the instance on the hypervisor.
Nov 15 04:14:23 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:14:23 user nova-compute[74805]: INFO nova.compute.manager [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Took 17.94 seconds to build instance.
Nov 15 04:14:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b80c3ff7-5ebe-427f-9894-de3705e51776 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lock "2921f743-66d5-47c1-b2e4-1b6957a2d550" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.116s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:23 user nova-compute[74805]: INFO nova.compute.manager [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Took 11.86 seconds to spawn the instance on the hypervisor.
Nov 15 04:14:24 user nova-compute[74805]: DEBUG nova.compute.manager [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:14:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:24 user nova-compute[74805]: INFO nova.compute.manager [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Took 14.34 seconds to spawn the instance on the hypervisor.
Nov 15 04:14:24 user nova-compute[74805]: DEBUG nova.compute.manager [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:14:24 user nova-compute[74805]: INFO nova.compute.manager [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Took 12.87 seconds to build instance.
Nov 15 04:14:24 user nova-compute[74805]: INFO nova.compute.manager [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Took 16.17 seconds to build instance.
Nov 15 04:14:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-02a8d40a-53a2-4685-9f73-0e82affb95bb tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "d63f3726-27df-455f-bda0-3ddca95b70d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.113s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:24 user nova-compute[74805]: INFO nova.compute.manager [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Took 15.61 seconds to build instance.
Nov 15 04:14:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cc23c632-8dbd-4809-9431-ebf7c204df0d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.383s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dcb7a4f9-65ee-41aa-8409-d90fda571532 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.753s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:28 user nova-compute[74805]: DEBUG nova.compute.manager [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:14:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:14:28 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Instance spawned successfully.
Nov 15 04:14:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:14:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:28 user nova-compute[74805]: INFO nova.compute.manager [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Took 17.83 seconds to spawn the instance on the hypervisor.
Nov 15 04:14:28 user nova-compute[74805]: DEBUG nova.compute.manager [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:14:28 user nova-compute[74805]: DEBUG nova.compute.manager [req-f1192bde-6c1a-4a1a-aa98-1725cefef478 req-ff7b85f0-cd61-4bef-9d40-4865c20f0351 service nova] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Received event network-vif-plugged-ffbc1668-bf57-488c-b543-d7a288eab7a7 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:14:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f1192bde-6c1a-4a1a-aa98-1725cefef478 req-ff7b85f0-cd61-4bef-9d40-4865c20f0351 service nova] Acquiring lock "2921f743-66d5-47c1-b2e4-1b6957a2d550-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f1192bde-6c1a-4a1a-aa98-1725cefef478 req-ff7b85f0-cd61-4bef-9d40-4865c20f0351 service nova] Lock "2921f743-66d5-47c1-b2e4-1b6957a2d550-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f1192bde-6c1a-4a1a-aa98-1725cefef478 req-ff7b85f0-cd61-4bef-9d40-4865c20f0351 service nova] Lock "2921f743-66d5-47c1-b2e4-1b6957a2d550-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:28 user nova-compute[74805]: DEBUG nova.compute.manager [req-f1192bde-6c1a-4a1a-aa98-1725cefef478 req-ff7b85f0-cd61-4bef-9d40-4865c20f0351 service nova] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] No waiting events found dispatching network-vif-plugged-ffbc1668-bf57-488c-b543-d7a288eab7a7 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:14:28 user nova-compute[74805]: WARNING nova.compute.manager [req-f1192bde-6c1a-4a1a-aa98-1725cefef478 req-ff7b85f0-cd61-4bef-9d40-4865c20f0351 service nova] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Received unexpected event network-vif-plugged-ffbc1668-bf57-488c-b543-d7a288eab7a7 for instance with vm_state active and task_state None.
Nov 15 04:14:29 user nova-compute[74805]: INFO nova.compute.manager [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Took 18.93 seconds to build instance.
Nov 15 04:14:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-35da7c72-6b98-4281-ae28-de72d832c436 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "0de78a8a-d66a-4703-a044-89c2f2006860" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.065s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Acquiring lock "e91a656c-66d6-4a70-a115-8c03ed964f94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "e91a656c-66d6-4a70-a115-8c03ed964f94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:29 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:14:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:29 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:14:29 user nova-compute[74805]: INFO nova.compute.claims [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Claim successful on node user
Nov 15 04:14:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:30 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:14:30 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:14:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.003s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:30 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:14:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:31 user nova-compute[74805]: DEBUG nova.compute.manager [req-10a211cd-e24d-4a53-b6a7-ab04c802b2b2 req-48a4ab88-1106-46bb-a96c-9d23d56d6ad3 service nova] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Received event network-vif-plugged-ffbc1668-bf57-488c-b543-d7a288eab7a7 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:14:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-10a211cd-e24d-4a53-b6a7-ab04c802b2b2 req-48a4ab88-1106-46bb-a96c-9d23d56d6ad3 service nova] Acquiring lock "2921f743-66d5-47c1-b2e4-1b6957a2d550-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-10a211cd-e24d-4a53-b6a7-ab04c802b2b2 req-48a4ab88-1106-46bb-a96c-9d23d56d6ad3 service nova] Lock "2921f743-66d5-47c1-b2e4-1b6957a2d550-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-10a211cd-e24d-4a53-b6a7-ab04c802b2b2 req-48a4ab88-1106-46bb-a96c-9d23d56d6ad3 service nova] Lock "2921f743-66d5-47c1-b2e4-1b6957a2d550-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:31 user nova-compute[74805]: DEBUG nova.compute.manager [req-10a211cd-e24d-4a53-b6a7-ab04c802b2b2 req-48a4ab88-1106-46bb-a96c-9d23d56d6ad3 service nova] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] No waiting events found dispatching network-vif-plugged-ffbc1668-bf57-488c-b543-d7a288eab7a7 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:14:31 user nova-compute[74805]: WARNING nova.compute.manager [req-10a211cd-e24d-4a53-b6a7-ab04c802b2b2 req-48a4ab88-1106-46bb-a96c-9d23d56d6ad3 service nova] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Received unexpected event network-vif-plugged-ffbc1668-bf57-488c-b543-d7a288eab7a7 for instance with vm_state active and task_state None.
Nov 15 04:14:31 user nova-compute[74805]: DEBUG nova.compute.manager [req-10a211cd-e24d-4a53-b6a7-ab04c802b2b2 req-48a4ab88-1106-46bb-a96c-9d23d56d6ad3 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Received event network-vif-plugged-9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:14:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-10a211cd-e24d-4a53-b6a7-ab04c802b2b2 req-48a4ab88-1106-46bb-a96c-9d23d56d6ad3 service nova] Acquiring lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-10a211cd-e24d-4a53-b6a7-ab04c802b2b2 req-48a4ab88-1106-46bb-a96c-9d23d56d6ad3 service nova] Lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-10a211cd-e24d-4a53-b6a7-ab04c802b2b2 req-48a4ab88-1106-46bb-a96c-9d23d56d6ad3 service nova] Lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:31 user nova-compute[74805]: DEBUG nova.compute.manager [req-10a211cd-e24d-4a53-b6a7-ab04c802b2b2 req-48a4ab88-1106-46bb-a96c-9d23d56d6ad3 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] No waiting events found dispatching network-vif-plugged-9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:14:31 user nova-compute[74805]: WARNING nova.compute.manager [req-10a211cd-e24d-4a53-b6a7-ab04c802b2b2 req-48a4ab88-1106-46bb-a96c-9d23d56d6ad3 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Received unexpected event network-vif-plugged-9f426f7d-ce70-41ba-affa-652a4f62a571 for instance with vm_state active and task_state None.
Nov 15 04:14:31 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:14:31 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:14:31 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:14:31 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:14:31 user nova-compute[74805]: INFO nova.virt.block_device [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Booting with volume b384dac9-f81c-4c7a-bfc7-93966c62f43d at /dev/vda
Nov 15 04:14:31 user nova-compute[74805]: DEBUG nova.policy [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7ec9f2afcee4c23883d572235bfa437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22eb863a050454fb1998acbaae47f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:14:31 user nova-compute[74805]: DEBUG os_brick.utils [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:14:31 user nova-compute[74805]: INFO oslo.privsep.daemon [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmptt7rpmel/privsep.sock']
Nov 15 04:14:31 user sudo[85024]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmptt7rpmel/privsep.sock
Nov 15 04:14:31 user sudo[85024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 04:14:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:32 user nova-compute[74805]: DEBUG nova.compute.manager [req-6eb8c932-4ed9-4086-a5ad-0d6cc50f2806 req-574f52d4-adf2-4446-8af4-449a901dcf06 service nova] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Received event network-vif-plugged-29f069d7-6837-470c-a8b7-5cb6225bba4e {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:14:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6eb8c932-4ed9-4086-a5ad-0d6cc50f2806 req-574f52d4-adf2-4446-8af4-449a901dcf06 service nova] Acquiring lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6eb8c932-4ed9-4086-a5ad-0d6cc50f2806 req-574f52d4-adf2-4446-8af4-449a901dcf06 service nova] Lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6eb8c932-4ed9-4086-a5ad-0d6cc50f2806 req-574f52d4-adf2-4446-8af4-449a901dcf06 service nova] Lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:32 user nova-compute[74805]: DEBUG nova.compute.manager [req-6eb8c932-4ed9-4086-a5ad-0d6cc50f2806 req-574f52d4-adf2-4446-8af4-449a901dcf06 service nova] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] No waiting events found dispatching network-vif-plugged-29f069d7-6837-470c-a8b7-5cb6225bba4e {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:14:32 user nova-compute[74805]: WARNING nova.compute.manager [req-6eb8c932-4ed9-4086-a5ad-0d6cc50f2806 req-574f52d4-adf2-4446-8af4-449a901dcf06 service nova] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Received unexpected event network-vif-plugged-29f069d7-6837-470c-a8b7-5cb6225bba4e for instance with vm_state active and task_state None.
Nov 15 04:14:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Acquiring lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:32 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:14:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:33 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:14:33 user nova-compute[74805]: INFO nova.compute.claims [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Claim successful on node user
Nov 15 04:14:33 user nova-compute[74805]: DEBUG nova.compute.manager [req-be3c5491-5471-40ed-ad66-5b66d8f593df req-71339aa5-e3c5-404b-bbc1-33a29668aa3f service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Received event network-vif-plugged-9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:14:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-be3c5491-5471-40ed-ad66-5b66d8f593df req-71339aa5-e3c5-404b-bbc1-33a29668aa3f service nova] Acquiring lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-be3c5491-5471-40ed-ad66-5b66d8f593df req-71339aa5-e3c5-404b-bbc1-33a29668aa3f service nova] Lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-be3c5491-5471-40ed-ad66-5b66d8f593df req-71339aa5-e3c5-404b-bbc1-33a29668aa3f service nova] Lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:33 user nova-compute[74805]: DEBUG nova.compute.manager [req-be3c5491-5471-40ed-ad66-5b66d8f593df req-71339aa5-e3c5-404b-bbc1-33a29668aa3f service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] No waiting events found dispatching network-vif-plugged-9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:14:33 user nova-compute[74805]: WARNING nova.compute.manager [req-be3c5491-5471-40ed-ad66-5b66d8f593df req-71339aa5-e3c5-404b-bbc1-33a29668aa3f service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Received unexpected event network-vif-plugged-9f426f7d-ce70-41ba-affa-652a4f62a571 for instance with vm_state active and task_state None.
Nov 15 04:14:33 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Successfully created port: 78ef9969-b62c-4730-8bbf-e5a8d2c75010 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:14:33 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:14:33 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:14:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.850s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:33 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:14:33 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:14:33 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:14:34 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:14:34 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:14:34 user sudo[85024]: pam_unix(sudo:session): session closed for user root
Nov 15 04:14:34 user nova-compute[74805]: INFO oslo.privsep.daemon [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Spawned new privsep daemon via rootwrap
Nov 15 04:14:34 user nova-compute[74805]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 04:14:34 user nova-compute[74805]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 04:14:34 user nova-compute[74805]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 15 04:14:34 user nova-compute[74805]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85029
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Acquiring lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.014s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cfa88c-1af5-4656-93bf-a73ee846830d]: (2,) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG nova.compute.manager [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:14:34 user nova-compute[74805]: INFO nova.compute.claims [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Claim successful on node user
Nov 15 04:14:34 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:14:34 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Creating image(s)
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Acquiring lock "/opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "/opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "/opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bba5e7-e52e-4da2-9d67-9daa8cee83a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:14:34 user nova-compute[74805]: WARNING os_brick.initiator.connectors.nvmeof [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.049s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17a8af7-b2c9-4611-92d9-3290ffccdb44]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65d881e-82d6-4aab-8f02-3d81872c87df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cdf4b8-7219-43af-b854-d5e81a6399f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG nova.policy [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6fca23f109447409a8f31b925071ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5fa2f59063040d9a58de745e87380a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG nova.compute.manager [req-96c7ece6-94a4-4768-8afb-ba269df80be1 req-f5b12ec0-d22d-44a4-bfed-7ac720dee11d service nova] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Received event network-vif-plugged-29f069d7-6837-470c-a8b7-5cb6225bba4e {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-96c7ece6-94a4-4768-8afb-ba269df80be1 req-f5b12ec0-d22d-44a4-bfed-7ac720dee11d service nova] Acquiring lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-96c7ece6-94a4-4768-8afb-ba269df80be1 req-f5b12ec0-d22d-44a4-bfed-7ac720dee11d service nova] Lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-96c7ece6-94a4-4768-8afb-ba269df80be1 req-f5b12ec0-d22d-44a4-bfed-7ac720dee11d service nova] Lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG nova.compute.manager [req-96c7ece6-94a4-4768-8afb-ba269df80be1 req-f5b12ec0-d22d-44a4-bfed-7ac720dee11d service nova] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] No waiting events found dispatching network-vif-plugged-29f069d7-6837-470c-a8b7-5cb6225bba4e {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:14:34 user nova-compute[74805]: WARNING nova.compute.manager [req-96c7ece6-94a4-4768-8afb-ba269df80be1 req-f5b12ec0-d22d-44a4-bfed-7ac720dee11d service nova] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Received unexpected event network-vif-plugged-29f069d7-6837-470c-a8b7-5cb6225bba4e for instance with vm_state active and task_state None.
Nov 15 04:14:34 user nova-compute[74805]: DEBUG nova.compute.manager [req-96c7ece6-94a4-4768-8afb-ba269df80be1 req-f5b12ec0-d22d-44a4-bfed-7ac720dee11d service nova] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Received event network-vif-plugged-0d0a11b6-25c5-4478-8c6f-40ac41f83b3d {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-96c7ece6-94a4-4768-8afb-ba269df80be1 req-f5b12ec0-d22d-44a4-bfed-7ac720dee11d service nova] Acquiring lock "d63f3726-27df-455f-bda0-3ddca95b70d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-96c7ece6-94a4-4768-8afb-ba269df80be1 req-f5b12ec0-d22d-44a4-bfed-7ac720dee11d service nova] Lock "d63f3726-27df-455f-bda0-3ddca95b70d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-96c7ece6-94a4-4768-8afb-ba269df80be1 req-f5b12ec0-d22d-44a4-bfed-7ac720dee11d service nova] Lock "d63f3726-27df-455f-bda0-3ddca95b70d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG nova.compute.manager [req-96c7ece6-94a4-4768-8afb-ba269df80be1 req-f5b12ec0-d22d-44a4-bfed-7ac720dee11d service nova] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] No waiting events found dispatching network-vif-plugged-0d0a11b6-25c5-4478-8c6f-40ac41f83b3d {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:14:34 user nova-compute[74805]: WARNING nova.compute.manager [req-96c7ece6-94a4-4768-8afb-ba269df80be1 req-f5b12ec0-d22d-44a4-bfed-7ac720dee11d service nova] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Received unexpected event network-vif-plugged-0d0a11b6-25c5-4478-8c6f-40ac41f83b3d for instance with vm_state active and task_state None.
Nov 15 04:14:34 user nova-compute[74805]: DEBUG nova.compute.manager [req-96c7ece6-94a4-4768-8afb-ba269df80be1 req-f5b12ec0-d22d-44a4-bfed-7ac720dee11d service nova] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Received event network-vif-plugged-0d0a11b6-25c5-4478-8c6f-40ac41f83b3d {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-96c7ece6-94a4-4768-8afb-ba269df80be1 req-f5b12ec0-d22d-44a4-bfed-7ac720dee11d service nova] Acquiring lock "d63f3726-27df-455f-bda0-3ddca95b70d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-96c7ece6-94a4-4768-8afb-ba269df80be1 req-f5b12ec0-d22d-44a4-bfed-7ac720dee11d service nova] Lock "d63f3726-27df-455f-bda0-3ddca95b70d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-96c7ece6-94a4-4768-8afb-ba269df80be1 req-f5b12ec0-d22d-44a4-bfed-7ac720dee11d service nova] Lock "d63f3726-27df-455f-bda0-3ddca95b70d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG nova.compute.manager [req-96c7ece6-94a4-4768-8afb-ba269df80be1 req-f5b12ec0-d22d-44a4-bfed-7ac720dee11d service nova] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] No waiting events found dispatching network-vif-plugged-0d0a11b6-25c5-4478-8c6f-40ac41f83b3d {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:14:34 user nova-compute[74805]: WARNING nova.compute.manager [req-96c7ece6-94a4-4768-8afb-ba269df80be1 req-f5b12ec0-d22d-44a4-bfed-7ac720dee11d service nova] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Received unexpected event network-vif-plugged-0d0a11b6-25c5-4478-8c6f-40ac41f83b3d for instance with vm_state active and task_state None.
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:14:34 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[214a9cf0-8d0c-4aba-b714-83a4cab5cef1]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.398s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG os_brick.utils [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] <== get_connector_properties: return (3207ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Updating existing volume attachment record: bd5be7a4-793d-4655-8b21-9d0c614ceca9 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:35 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Successfully updated port: 78ef9969-b62c-4730-8bbf-e5a8d2c75010 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:14:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Acquiring lock "refresh_cache-e91a656c-66d6-4a70-a115-8c03ed964f94" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:14:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Acquired lock "refresh_cache-e91a656c-66d6-4a70-a115-8c03ed964f94" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:14:35 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:14:35 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.312s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:35 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:35 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:14:35 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk 1073741824" returned: 0 in 0.121s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.437s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:35 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:35 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:14:35 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:14:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.249s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:35 user nova-compute[74805]: DEBUG nova.compute.manager [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:14:35 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.407s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:35 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:14:35 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:35 user nova-compute[74805]: DEBUG nova.compute.manager [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:14:35 user nova-compute[74805]: DEBUG nova.network.neutron [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:14:35 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:14:35 user nova-compute[74805]: DEBUG nova.compute.manager [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Cannot resize image /opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Ensure instance console log exists: /opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Successfully created port: 51834a6c-a2bb-4135-b3b3-beb4e689e876 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG nova.compute.manager [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:14:36 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Creating image(s)
Nov 15 04:14:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Acquiring lock "/opt/stack/data/nova/instances/fdf3e90f-4fd8-4da4-a888-48c7a80fb209/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lock "/opt/stack/data/nova/instances/fdf3e90f-4fd8-4da4-a888-48c7a80fb209/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lock "/opt/stack/data/nova/instances/fdf3e90f-4fd8-4da4-a888-48c7a80fb209/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Updating instance_info_cache with network_info: [{"id": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "address": "fa:16:3e:d0:6e:1b", "network": {"id": "b3051571-47ed-471a-9d88-051306ee18e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-707580808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b22eb863a050454fb1998acbaae47f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ef9969-b6", "ovs_interfaceid": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG nova.policy [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b4f7d19d481d452d9fbd4c7db2e7eb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354b7353cecf4f7e8bd6fbc058dd15fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Releasing lock "refresh_cache-e91a656c-66d6-4a70-a115-8c03ed964f94" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Instance network_info: |[{"id": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "address": "fa:16:3e:d0:6e:1b", "network": {"id": "b3051571-47ed-471a-9d88-051306ee18e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-707580808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b22eb863a050454fb1998acbaae47f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ef9969-b6", "ovs_interfaceid": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.214s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.207s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/fdf3e90f-4fd8-4da4-a888-48c7a80fb209/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/fdf3e90f-4fd8-4da4-a888-48c7a80fb209/disk 1073741824" returned: 0 in 0.163s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.378s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG nova.compute.manager [req-3bf2600e-1129-49de-803f-684728d38d01 req-180245bf-2f94-4a8d-a776-9d85105d2094 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Received event network-vif-plugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3bf2600e-1129-49de-803f-684728d38d01 req-180245bf-2f94-4a8d-a776-9d85105d2094 service nova] Acquiring lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3bf2600e-1129-49de-803f-684728d38d01 req-180245bf-2f94-4a8d-a776-9d85105d2094 service nova] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3bf2600e-1129-49de-803f-684728d38d01 req-180245bf-2f94-4a8d-a776-9d85105d2094 service nova] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG nova.compute.manager [req-3bf2600e-1129-49de-803f-684728d38d01 req-180245bf-2f94-4a8d-a776-9d85105d2094 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] No waiting events found dispatching network-vif-plugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:14:36 user nova-compute[74805]: WARNING nova.compute.manager [req-3bf2600e-1129-49de-803f-684728d38d01 req-180245bf-2f94-4a8d-a776-9d85105d2094 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Received unexpected event network-vif-plugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 for instance with vm_state active and task_state None.
Nov 15 04:14:36 user nova-compute[74805]: DEBUG nova.compute.manager [req-3bf2600e-1129-49de-803f-684728d38d01 req-180245bf-2f94-4a8d-a776-9d85105d2094 service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Received event network-changed-78ef9969-b62c-4730-8bbf-e5a8d2c75010 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG nova.compute.manager [req-3bf2600e-1129-49de-803f-684728d38d01 req-180245bf-2f94-4a8d-a776-9d85105d2094 service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Refreshing instance network info cache due to event network-changed-78ef9969-b62c-4730-8bbf-e5a8d2c75010. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3bf2600e-1129-49de-803f-684728d38d01 req-180245bf-2f94-4a8d-a776-9d85105d2094 service nova] Acquiring lock "refresh_cache-e91a656c-66d6-4a70-a115-8c03ed964f94" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3bf2600e-1129-49de-803f-684728d38d01 req-180245bf-2f94-4a8d-a776-9d85105d2094 service nova] Acquired lock "refresh_cache-e91a656c-66d6-4a70-a115-8c03ed964f94" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG nova.network.neutron [req-3bf2600e-1129-49de-803f-684728d38d01 req-180245bf-2f94-4a8d-a776-9d85105d2094 service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Refreshing network info cache for port 78ef9969-b62c-4730-8bbf-e5a8d2c75010 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.248s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fdf3e90f-4fd8-4da4-a888-48c7a80fb209/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:14:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdf3e90f-4fd8-4da4-a888-48c7a80fb209/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:37 user nova-compute[74805]: DEBUG nova.network.neutron [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Successfully created port: 88133a1b-c635-48f8-b84d-891f943b38f2 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:14:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdf3e90f-4fd8-4da4-a888-48c7a80fb209/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:37 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Cannot resize image /opt/stack/data/nova/instances/fdf3e90f-4fd8-4da4-a888-48c7a80fb209/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:14:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:14:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Ensure instance console log exists: /opt/stack/data/nova/instances/fdf3e90f-4fd8-4da4-a888-48c7a80fb209/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:14:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:37 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Successfully updated port: 51834a6c-a2bb-4135-b3b3-beb4e689e876 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:14:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Acquiring lock "refresh_cache-05f49324-4b7a-4cd4-ada5-9450b9bf1d70" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:14:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Acquired lock "refresh_cache-05f49324-4b7a-4cd4-ada5-9450b9bf1d70" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:14:37 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:14:37 user nova-compute[74805]: DEBUG nova.compute.manager [req-1b7ea8c3-e70a-4af4-bbd3-5fb8b3f3b04c req-7f488d3f-b33b-4568-935f-104f88de2e44 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Received event network-changed-51834a6c-a2bb-4135-b3b3-beb4e689e876 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:14:37 user nova-compute[74805]: DEBUG nova.compute.manager [req-1b7ea8c3-e70a-4af4-bbd3-5fb8b3f3b04c req-7f488d3f-b33b-4568-935f-104f88de2e44 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Refreshing instance network info cache due to event network-changed-51834a6c-a2bb-4135-b3b3-beb4e689e876. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:14:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1b7ea8c3-e70a-4af4-bbd3-5fb8b3f3b04c req-7f488d3f-b33b-4568-935f-104f88de2e44 service nova] Acquiring lock "refresh_cache-05f49324-4b7a-4cd4-ada5-9450b9bf1d70" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:14:37 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Updating instance_info_cache with network_info: [{"id": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "address": "fa:16:3e:c4:ea:ce", "network": {"id": "faafe4eb-0b41-4c3a-bce5-3d65543bc634", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-431209234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5fa2f59063040d9a58de745e87380a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51834a6c-a2", "ovs_interfaceid": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.network.neutron [req-3bf2600e-1129-49de-803f-684728d38d01 req-180245bf-2f94-4a8d-a776-9d85105d2094 service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Updated VIF entry in instance network info cache for port 78ef9969-b62c-4730-8bbf-e5a8d2c75010. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.network.neutron [req-3bf2600e-1129-49de-803f-684728d38d01 req-180245bf-2f94-4a8d-a776-9d85105d2094 service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Updating instance_info_cache with network_info: [{"id": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "address": "fa:16:3e:d0:6e:1b", "network": {"id": "b3051571-47ed-471a-9d88-051306ee18e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-707580808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b22eb863a050454fb1998acbaae47f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ef9969-b6", "ovs_interfaceid": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Releasing lock "refresh_cache-05f49324-4b7a-4cd4-ada5-9450b9bf1d70" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Instance network_info: |[{"id": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "address": "fa:16:3e:c4:ea:ce", "network": {"id": "faafe4eb-0b41-4c3a-bce5-3d65543bc634", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-431209234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5fa2f59063040d9a58de745e87380a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51834a6c-a2", "ovs_interfaceid": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1b7ea8c3-e70a-4af4-bbd3-5fb8b3f3b04c req-7f488d3f-b33b-4568-935f-104f88de2e44 service nova] Acquired lock "refresh_cache-05f49324-4b7a-4cd4-ada5-9450b9bf1d70" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.network.neutron [req-1b7ea8c3-e70a-4af4-bbd3-5fb8b3f3b04c req-7f488d3f-b33b-4568-935f-104f88de2e44 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Refreshing network info cache for port 51834a6c-a2bb-4135-b3b3-beb4e689e876 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Start _get_guest_xml network_info=[{"id": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "address": "fa:16:3e:c4:ea:ce", "network": {"id": "faafe4eb-0b41-4c3a-bce5-3d65543bc634", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-431209234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5fa2f59063040d9a58de745e87380a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51834a6c-a2", "ovs_interfaceid": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3bf2600e-1129-49de-803f-684728d38d01 req-180245bf-2f94-4a8d-a776-9d85105d2094 service nova] Releasing lock "refresh_cache-e91a656c-66d6-4a70-a115-8c03ed964f94" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.compute.manager [req-3bf2600e-1129-49de-803f-684728d38d01 req-180245bf-2f94-4a8d-a776-9d85105d2094 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Received event network-vif-plugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3bf2600e-1129-49de-803f-684728d38d01 req-180245bf-2f94-4a8d-a776-9d85105d2094 service nova] Acquiring lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3bf2600e-1129-49de-803f-684728d38d01 req-180245bf-2f94-4a8d-a776-9d85105d2094 service nova] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3bf2600e-1129-49de-803f-684728d38d01 req-180245bf-2f94-4a8d-a776-9d85105d2094 service nova] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.compute.manager [req-3bf2600e-1129-49de-803f-684728d38d01 req-180245bf-2f94-4a8d-a776-9d85105d2094 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] No waiting events found dispatching network-vif-plugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:14:38 user nova-compute[74805]: WARNING nova.compute.manager [req-3bf2600e-1129-49de-803f-684728d38d01 req-180245bf-2f94-4a8d-a776-9d85105d2094 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Received unexpected event network-vif-plugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 for instance with vm_state active and task_state None.
Nov 15 04:14:38 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:14:38 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-175864182',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-175864182',id=8,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqVjB/VXeAAXbcPR9EXCBQSbi0fxJNcG8/LYTw94OkTxRdq8BS1Qip4iGD0FJLZzAa8glLWaInjyzM+FwK314PVqp4xOkTB5SsVxL+0dMsk7No3KOKU2UWDKovL9DtDJQ==',key_name='tempest-keypair-792239620',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5fa2f59063040d9a58de745e87380a6',ramdisk_id='',reservation_id='r-it125hzz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-986558879',owner_user_name='tempest-TaggedAttachmentsTest-986558879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6fca23f109447409a8f31b925071ca7',uuid=05f49324-4b7a-4cd4-ada5-9450b9bf1d70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "address": "fa:16:3e:c4:ea:ce", "network": {"id": "faafe4eb-0b41-4c3a-bce5-3d65543bc634", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-431209234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5fa2f59063040d9a58de745e87380a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51834a6c-a2", "ovs_interfaceid": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Converting VIF {"id": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "address": "fa:16:3e:c4:ea:ce", "network": {"id": "faafe4eb-0b41-4c3a-bce5-3d65543bc634", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-431209234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5fa2f59063040d9a58de745e87380a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51834a6c-a2", "ovs_interfaceid": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:ea:ce,bridge_name='br-int',has_traffic_filtering=True,id=51834a6c-a2bb-4135-b3b3-beb4e689e876,network=Network(faafe4eb-0b41-4c3a-bce5-3d65543bc634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51834a6c-a2') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.objects.instance [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lazy-loading 'pci_devices' on Instance uuid 05f49324-4b7a-4cd4-ada5-9450b9bf1d70 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:14:38 user nova-compute[74805]:   <uuid>05f49324-4b7a-4cd4-ada5-9450b9bf1d70</uuid>
Nov 15 04:14:38 user nova-compute[74805]:   <name>instance-00000008</name>
Nov 15 04:14:38 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:14:38 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:14:38 user nova-compute[74805]:   <metadata>
Nov 15 04:14:38 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:14:38 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:14:38 user nova-compute[74805]:       <nova:name>tempest-device-tagging-server-175864182</nova:name>
Nov 15 04:14:38 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:14:38</nova:creationTime>
Nov 15 04:14:38 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:14:38 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:14:38 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:14:38 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:14:38 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:14:38 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:14:38 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:14:38 user nova-compute[74805]:       <nova:owner>
Nov 15 04:14:38 user nova-compute[74805]:         <nova:user uuid="e6fca23f109447409a8f31b925071ca7">tempest-TaggedAttachmentsTest-986558879-project-member</nova:user>
Nov 15 04:14:38 user nova-compute[74805]:         <nova:project uuid="a5fa2f59063040d9a58de745e87380a6">tempest-TaggedAttachmentsTest-986558879</nova:project>
Nov 15 04:14:38 user nova-compute[74805]:       </nova:owner>
Nov 15 04:14:38 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:14:38 user nova-compute[74805]:       <nova:ports>
Nov 15 04:14:38 user nova-compute[74805]:         <nova:port uuid="51834a6c-a2bb-4135-b3b3-beb4e689e876">
Nov 15 04:14:38 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 04:14:38 user nova-compute[74805]:         </nova:port>
Nov 15 04:14:38 user nova-compute[74805]:       </nova:ports>
Nov 15 04:14:38 user nova-compute[74805]:     </nova:instance>
Nov 15 04:14:38 user nova-compute[74805]:   </metadata>
Nov 15 04:14:38 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:14:38 user nova-compute[74805]:     <system>
Nov 15 04:14:38 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:14:38 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:14:38 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:14:38 user nova-compute[74805]:       <entry name="serial">05f49324-4b7a-4cd4-ada5-9450b9bf1d70</entry>
Nov 15 04:14:38 user nova-compute[74805]:       <entry name="uuid">05f49324-4b7a-4cd4-ada5-9450b9bf1d70</entry>
Nov 15 04:14:38 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:14:38 user nova-compute[74805]:     </system>
Nov 15 04:14:38 user nova-compute[74805]:   </sysinfo>
Nov 15 04:14:38 user nova-compute[74805]:   <os>
Nov 15 04:14:38 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:14:38 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:14:38 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:14:38 user nova-compute[74805]:   </os>
Nov 15 04:14:38 user nova-compute[74805]:   <features>
Nov 15 04:14:38 user nova-compute[74805]:     <acpi/>
Nov 15 04:14:38 user nova-compute[74805]:     <apic/>
Nov 15 04:14:38 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:14:38 user nova-compute[74805]:   </features>
Nov 15 04:14:38 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:14:38 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:14:38 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:14:38 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:14:38 user nova-compute[74805]:   </clock>
Nov 15 04:14:38 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:14:38 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:14:38 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:14:38 user nova-compute[74805]:   </cpu>
Nov 15 04:14:38 user nova-compute[74805]:   <devices>
Nov 15 04:14:38 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:14:38 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:14:38 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk"/>
Nov 15 04:14:38 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:14:38 user nova-compute[74805]:     </disk>
Nov 15 04:14:38 user nova-compute[74805]:     <disk type="file" device="cdrom">
Nov 15 04:14:38 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 04:14:38 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk.config"/>
Nov 15 04:14:38 user nova-compute[74805]:       <target dev="hda" bus="ide"/>
Nov 15 04:14:38 user nova-compute[74805]:     </disk>
Nov 15 04:14:38 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:14:38 user nova-compute[74805]:       <mac address="fa:16:3e:c4:ea:ce"/>
Nov 15 04:14:38 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:14:38 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:14:38 user nova-compute[74805]:       <target dev="tap51834a6c-a2"/>
Nov 15 04:14:38 user nova-compute[74805]:     </interface>
Nov 15 04:14:38 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:14:38 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/console.log" append="off"/>
Nov 15 04:14:38 user nova-compute[74805]:     </serial>
Nov 15 04:14:38 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:14:38 user nova-compute[74805]:     <video>
Nov 15 04:14:38 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:14:38 user nova-compute[74805]:     </video>
Nov 15 04:14:38 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:14:38 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:14:38 user nova-compute[74805]:     </rng>
Nov 15 04:14:38 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:14:38 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:14:38 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:14:38 user nova-compute[74805]:     </memballoon>
Nov 15 04:14:38 user nova-compute[74805]:   </devices>
Nov 15 04:14:38 user nova-compute[74805]: </domain>
Nov 15 04:14:38 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-175864182',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-175864182',id=8,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqVjB/VXeAAXbcPR9EXCBQSbi0fxJNcG8/LYTw94OkTxRdq8BS1Qip4iGD0FJLZzAa8glLWaInjyzM+FwK314PVqp4xOkTB5SsVxL+0dMsk7No3KOKU2UWDKovL9DtDJQ==',key_name='tempest-keypair-792239620',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5fa2f59063040d9a58de745e87380a6',ramdisk_id='',reservation_id='r-it125hzz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-986558879',owner_user_name='tempest-TaggedAttachmentsTest-986558879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6fca23f109447409a8f31b925071ca7',uuid=05f49324-4b7a-4cd4-ada5-9450b9bf1d70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "address": "fa:16:3e:c4:ea:ce", "network": {"id": "faafe4eb-0b41-4c3a-bce5-3d65543bc634", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-431209234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5fa2f59063040d9a58de745e87380a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51834a6c-a2", "ovs_interfaceid": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Converting VIF {"id": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "address": "fa:16:3e:c4:ea:ce", "network": {"id": "faafe4eb-0b41-4c3a-bce5-3d65543bc634", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-431209234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5fa2f59063040d9a58de745e87380a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51834a6c-a2", "ovs_interfaceid": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:ea:ce,bridge_name='br-int',has_traffic_filtering=True,id=51834a6c-a2bb-4135-b3b3-beb4e689e876,network=Network(faafe4eb-0b41-4c3a-bce5-3d65543bc634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51834a6c-a2') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG os_vif [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:ea:ce,bridge_name='br-int',has_traffic_filtering=True,id=51834a6c-a2bb-4135-b3b3-beb4e689e876,network=Network(faafe4eb-0b41-4c3a-bce5-3d65543bc634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51834a6c-a2') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0b2ed01-5d30-5c61-9c9e-408df4dd37d6', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51834a6c-a2, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51834a6c-a2, col_values=(('qos', UUID('31e21fdc-f8fe-43ca-ac96-9ef73d9c23ba')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51834a6c-a2, col_values=(('external_ids', {'iface-id': '51834a6c-a2bb-4135-b3b3-beb4e689e876', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:ea:ce', 'vm-uuid': '05f49324-4b7a-4cd4-ada5-9450b9bf1d70'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:14:38 user nova-compute[74805]: INFO os_vif [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:ea:ce,bridge_name='br-int',has_traffic_filtering=True,id=51834a6c-a2bb-4135-b3b3-beb4e689e876,network=Network(faafe4eb-0b41-4c3a-bce5-3d65543bc634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51834a6c-a2')
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] No BDM found with device name hda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] No VIF found with MAC fa:16:3e:c4:ea:ce, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:14:38 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Using config drive
Nov 15 04:14:38 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Creating config drive at /opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk.config
Nov 15 04:14:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpporqfqox {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpporqfqox" returned: 0 in 0.064s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:39 user nova-compute[74805]: DEBUG nova.network.neutron [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Successfully updated port: 88133a1b-c635-48f8-b84d-891f943b38f2 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:14:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Acquiring lock "refresh_cache-fdf3e90f-4fd8-4da4-a888-48c7a80fb209" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:14:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Acquired lock "refresh_cache-fdf3e90f-4fd8-4da4-a888-48c7a80fb209" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:14:39 user nova-compute[74805]: DEBUG nova.network.neutron [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:14:39 user nova-compute[74805]: DEBUG nova.network.neutron [req-1b7ea8c3-e70a-4af4-bbd3-5fb8b3f3b04c req-7f488d3f-b33b-4568-935f-104f88de2e44 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Updated VIF entry in instance network info cache for port 51834a6c-a2bb-4135-b3b3-beb4e689e876. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:14:39 user nova-compute[74805]: DEBUG nova.network.neutron [req-1b7ea8c3-e70a-4af4-bbd3-5fb8b3f3b04c req-7f488d3f-b33b-4568-935f-104f88de2e44 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Updating instance_info_cache with network_info: [{"id": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "address": "fa:16:3e:c4:ea:ce", "network": {"id": "faafe4eb-0b41-4c3a-bce5-3d65543bc634", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-431209234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5fa2f59063040d9a58de745e87380a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51834a6c-a2", "ovs_interfaceid": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:14:39 user nova-compute[74805]: DEBUG nova.compute.manager [req-6c8b7c06-f996-4f24-a391-56a8b843bdbd req-ce3b04d2-d78e-4a10-b1b6-343e56df8bf0 service nova] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Received event network-changed-88133a1b-c635-48f8-b84d-891f943b38f2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:14:39 user nova-compute[74805]: DEBUG nova.compute.manager [req-6c8b7c06-f996-4f24-a391-56a8b843bdbd req-ce3b04d2-d78e-4a10-b1b6-343e56df8bf0 service nova] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Refreshing instance network info cache due to event network-changed-88133a1b-c635-48f8-b84d-891f943b38f2. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:14:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6c8b7c06-f996-4f24-a391-56a8b843bdbd req-ce3b04d2-d78e-4a10-b1b6-343e56df8bf0 service nova] Acquiring lock "refresh_cache-fdf3e90f-4fd8-4da4-a888-48c7a80fb209" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:14:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1b7ea8c3-e70a-4af4-bbd3-5fb8b3f3b04c req-7f488d3f-b33b-4568-935f-104f88de2e44 service nova] Releasing lock "refresh_cache-05f49324-4b7a-4cd4-ada5-9450b9bf1d70" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:14:39 user nova-compute[74805]: DEBUG nova.network.neutron [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:14:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Acquiring lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:39 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:14:39 user nova-compute[74805]: DEBUG nova.network.neutron [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Updating instance_info_cache with network_info: [{"id": "88133a1b-c635-48f8-b84d-891f943b38f2", "address": "fa:16:3e:bb:68:f4", "network": {"id": "e5fa9b51-eaad-4687-9ae5-01132e7768e0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-778141578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "354b7353cecf4f7e8bd6fbc058dd15fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88133a1b-c6", "ovs_interfaceid": "88133a1b-c635-48f8-b84d-891f943b38f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Releasing lock "refresh_cache-fdf3e90f-4fd8-4da4-a888-48c7a80fb209" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.compute.manager [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Instance network_info: |[{"id": "88133a1b-c635-48f8-b84d-891f943b38f2", "address": "fa:16:3e:bb:68:f4", "network": {"id": "e5fa9b51-eaad-4687-9ae5-01132e7768e0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-778141578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "354b7353cecf4f7e8bd6fbc058dd15fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88133a1b-c6", "ovs_interfaceid": "88133a1b-c635-48f8-b84d-891f943b38f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6c8b7c06-f996-4f24-a391-56a8b843bdbd req-ce3b04d2-d78e-4a10-b1b6-343e56df8bf0 service nova] Acquired lock "refresh_cache-fdf3e90f-4fd8-4da4-a888-48c7a80fb209" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.network.neutron [req-6c8b7c06-f996-4f24-a391-56a8b843bdbd req-ce3b04d2-d78e-4a10-b1b6-343e56df8bf0 service nova] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Refreshing network info cache for port 88133a1b-c635-48f8-b84d-891f943b38f2 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Start _get_guest_xml network_info=[{"id": "88133a1b-c635-48f8-b84d-891f943b38f2", "address": "fa:16:3e:bb:68:f4", "network": {"id": "e5fa9b51-eaad-4687-9ae5-01132e7768e0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-778141578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "354b7353cecf4f7e8bd6fbc058dd15fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88133a1b-c6", "ovs_interfaceid": "88133a1b-c635-48f8-b84d-891f943b38f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:14:40 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:14:40 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:14:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.011s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:14:40 user nova-compute[74805]: INFO nova.compute.claims [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Claim successful on node user
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-82558028',display_name='tempest-TestVolumeSwap-server-82558028',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-82558028',id=9,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdj0iY6WOn05o9jSVyj5DqblOKivlMowh4ipI5M3rq0VQ7A3SjCc5Og+2VaHGf+eoJ3GUfju1oHWs4wB45XQejYHEr5DOMxDhMt6yCWfc5CAAhiCl8OiH9GSPrsVH0Gcw==',key_name='tempest-keypair-1613958558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='354b7353cecf4f7e8bd6fbc058dd15fc',ramdisk_id='',reservation_id='r-sub53257',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1057016380',owner_user_name='tempest-TestVolumeSwap-1057016380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4f7d19d481d452d9fbd4c7db2e7eb10',uuid=fdf3e90f-4fd8-4da4-a888-48c7a80fb209,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88133a1b-c635-48f8-b84d-891f943b38f2", "address": "fa:16:3e:bb:68:f4", "network": {"id": "e5fa9b51-eaad-4687-9ae5-01132e7768e0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-778141578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "354b7353cecf4f7e8bd6fbc058dd15fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88133a1b-c6", "ovs_interfaceid": "88133a1b-c635-48f8-b84d-891f943b38f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Converting VIF {"id": "88133a1b-c635-48f8-b84d-891f943b38f2", "address": "fa:16:3e:bb:68:f4", "network": {"id": "e5fa9b51-eaad-4687-9ae5-01132e7768e0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-778141578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "354b7353cecf4f7e8bd6fbc058dd15fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88133a1b-c6", "ovs_interfaceid": "88133a1b-c635-48f8-b84d-891f943b38f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:68:f4,bridge_name='br-int',has_traffic_filtering=True,id=88133a1b-c635-48f8-b84d-891f943b38f2,network=Network(e5fa9b51-eaad-4687-9ae5-01132e7768e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88133a1b-c6') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.objects.instance [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lazy-loading 'pci_devices' on Instance uuid fdf3e90f-4fd8-4da4-a888-48c7a80fb209 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:14:40 user nova-compute[74805]:   <uuid>fdf3e90f-4fd8-4da4-a888-48c7a80fb209</uuid>
Nov 15 04:14:40 user nova-compute[74805]:   <name>instance-00000009</name>
Nov 15 04:14:40 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:14:40 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:14:40 user nova-compute[74805]:   <metadata>
Nov 15 04:14:40 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:14:40 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:14:40 user nova-compute[74805]:       <nova:name>tempest-TestVolumeSwap-server-82558028</nova:name>
Nov 15 04:14:40 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:14:40</nova:creationTime>
Nov 15 04:14:40 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:14:40 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:14:40 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:14:40 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:14:40 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:14:40 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:14:40 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:14:40 user nova-compute[74805]:       <nova:owner>
Nov 15 04:14:40 user nova-compute[74805]:         <nova:user uuid="b4f7d19d481d452d9fbd4c7db2e7eb10">tempest-TestVolumeSwap-1057016380-project-member</nova:user>
Nov 15 04:14:40 user nova-compute[74805]:         <nova:project uuid="354b7353cecf4f7e8bd6fbc058dd15fc">tempest-TestVolumeSwap-1057016380</nova:project>
Nov 15 04:14:40 user nova-compute[74805]:       </nova:owner>
Nov 15 04:14:40 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:14:40 user nova-compute[74805]:       <nova:ports>
Nov 15 04:14:40 user nova-compute[74805]:         <nova:port uuid="88133a1b-c635-48f8-b84d-891f943b38f2">
Nov 15 04:14:40 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 04:14:40 user nova-compute[74805]:         </nova:port>
Nov 15 04:14:40 user nova-compute[74805]:       </nova:ports>
Nov 15 04:14:40 user nova-compute[74805]:     </nova:instance>
Nov 15 04:14:40 user nova-compute[74805]:   </metadata>
Nov 15 04:14:40 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:14:40 user nova-compute[74805]:     <system>
Nov 15 04:14:40 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:14:40 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:14:40 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:14:40 user nova-compute[74805]:       <entry name="serial">fdf3e90f-4fd8-4da4-a888-48c7a80fb209</entry>
Nov 15 04:14:40 user nova-compute[74805]:       <entry name="uuid">fdf3e90f-4fd8-4da4-a888-48c7a80fb209</entry>
Nov 15 04:14:40 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:14:40 user nova-compute[74805]:     </system>
Nov 15 04:14:40 user nova-compute[74805]:   </sysinfo>
Nov 15 04:14:40 user nova-compute[74805]:   <os>
Nov 15 04:14:40 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:14:40 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:14:40 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:14:40 user nova-compute[74805]:   </os>
Nov 15 04:14:40 user nova-compute[74805]:   <features>
Nov 15 04:14:40 user nova-compute[74805]:     <acpi/>
Nov 15 04:14:40 user nova-compute[74805]:     <apic/>
Nov 15 04:14:40 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:14:40 user nova-compute[74805]:   </features>
Nov 15 04:14:40 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:14:40 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:14:40 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:14:40 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:14:40 user nova-compute[74805]:   </clock>
Nov 15 04:14:40 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:14:40 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:14:40 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:14:40 user nova-compute[74805]:   </cpu>
Nov 15 04:14:40 user nova-compute[74805]:   <devices>
Nov 15 04:14:40 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:14:40 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:14:40 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/fdf3e90f-4fd8-4da4-a888-48c7a80fb209/disk"/>
Nov 15 04:14:40 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:14:40 user nova-compute[74805]:     </disk>
Nov 15 04:14:40 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:14:40 user nova-compute[74805]:       <mac address="fa:16:3e:bb:68:f4"/>
Nov 15 04:14:40 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:14:40 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:14:40 user nova-compute[74805]:       <target dev="tap88133a1b-c6"/>
Nov 15 04:14:40 user nova-compute[74805]:     </interface>
Nov 15 04:14:40 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:14:40 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/fdf3e90f-4fd8-4da4-a888-48c7a80fb209/console.log" append="off"/>
Nov 15 04:14:40 user nova-compute[74805]:     </serial>
Nov 15 04:14:40 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:14:40 user nova-compute[74805]:     <video>
Nov 15 04:14:40 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:14:40 user nova-compute[74805]:     </video>
Nov 15 04:14:40 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:14:40 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:14:40 user nova-compute[74805]:     </rng>
Nov 15 04:14:40 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:14:40 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:14:40 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:14:40 user nova-compute[74805]:     </memballoon>
Nov 15 04:14:40 user nova-compute[74805]:   </devices>
Nov 15 04:14:40 user nova-compute[74805]: </domain>
Nov 15 04:14:40 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-82558028',display_name='tempest-TestVolumeSwap-server-82558028',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-82558028',id=9,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdj0iY6WOn05o9jSVyj5DqblOKivlMowh4ipI5M3rq0VQ7A3SjCc5Og+2VaHGf+eoJ3GUfju1oHWs4wB45XQejYHEr5DOMxDhMt6yCWfc5CAAhiCl8OiH9GSPrsVH0Gcw==',key_name='tempest-keypair-1613958558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='354b7353cecf4f7e8bd6fbc058dd15fc',ramdisk_id='',reservation_id='r-sub53257',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1057016380',owner_user_name='tempest-TestVolumeSwap-1057016380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4f7d19d481d452d9fbd4c7db2e7eb10',uuid=fdf3e90f-4fd8-4da4-a888-48c7a80fb209,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88133a1b-c635-48f8-b84d-891f943b38f2", "address": "fa:16:3e:bb:68:f4", "network": {"id": "e5fa9b51-eaad-4687-9ae5-01132e7768e0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-778141578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "354b7353cecf4f7e8bd6fbc058dd15fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88133a1b-c6", "ovs_interfaceid": "88133a1b-c635-48f8-b84d-891f943b38f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Converting VIF {"id": "88133a1b-c635-48f8-b84d-891f943b38f2", "address": "fa:16:3e:bb:68:f4", "network": {"id": "e5fa9b51-eaad-4687-9ae5-01132e7768e0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-778141578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "354b7353cecf4f7e8bd6fbc058dd15fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88133a1b-c6", "ovs_interfaceid": "88133a1b-c635-48f8-b84d-891f943b38f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:68:f4,bridge_name='br-int',has_traffic_filtering=True,id=88133a1b-c635-48f8-b84d-891f943b38f2,network=Network(e5fa9b51-eaad-4687-9ae5-01132e7768e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88133a1b-c6') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG os_vif [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:68:f4,bridge_name='br-int',has_traffic_filtering=True,id=88133a1b-c635-48f8-b84d-891f943b38f2,network=Network(e5fa9b51-eaad-4687-9ae5-01132e7768e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88133a1b-c6') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0cfc86f9-691f-52c2-9edb-88fa825e6fa6', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88133a1b-c6, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap88133a1b-c6, col_values=(('qos', UUID('6d114250-09b6-4b69-bf22-ca8e875a2ad0')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap88133a1b-c6, col_values=(('external_ids', {'iface-id': '88133a1b-c635-48f8-b84d-891f943b38f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:68:f4', 'vm-uuid': 'fdf3e90f-4fd8-4da4-a888-48c7a80fb209'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:40 user nova-compute[74805]: INFO os_vif [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:68:f4,bridge_name='br-int',has_traffic_filtering=True,id=88133a1b-c635-48f8-b84d-891f943b38f2,network=Network(e5fa9b51-eaad-4687-9ae5-01132e7768e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88133a1b-c6')
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] No VIF found with MAC fa:16:3e:bb:68:f4, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.network.neutron [req-6c8b7c06-f996-4f24-a391-56a8b843bdbd req-ce3b04d2-d78e-4a10-b1b6-343e56df8bf0 service nova] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Updated VIF entry in instance network info cache for port 88133a1b-c635-48f8-b84d-891f943b38f2. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG nova.network.neutron [req-6c8b7c06-f996-4f24-a391-56a8b843bdbd req-ce3b04d2-d78e-4a10-b1b6-343e56df8bf0 service nova] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Updating instance_info_cache with network_info: [{"id": "88133a1b-c635-48f8-b84d-891f943b38f2", "address": "fa:16:3e:bb:68:f4", "network": {"id": "e5fa9b51-eaad-4687-9ae5-01132e7768e0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-778141578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "354b7353cecf4f7e8bd6fbc058dd15fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88133a1b-c6", "ovs_interfaceid": "88133a1b-c635-48f8-b84d-891f943b38f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6c8b7c06-f996-4f24-a391-56a8b843bdbd req-ce3b04d2-d78e-4a10-b1b6-343e56df8bf0 service nova] Releasing lock "refresh_cache-fdf3e90f-4fd8-4da4-a888-48c7a80fb209" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:41 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:14:41 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:14:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.152s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:41 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:14:41 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:14:41 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:14:41 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:14:41 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:14:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:41 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:14:41 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:14:41 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Creating image(s)
Nov 15 04:14:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Acquiring lock "/opt/stack/data/nova/instances/89dcacb0-6864-4529-903d-ae46a2dc3bdd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Lock "/opt/stack/data/nova/instances/89dcacb0-6864-4529-903d-ae46a2dc3bdd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Lock "/opt/stack/data/nova/instances/89dcacb0-6864-4529-903d-ae46a2dc3bdd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:41 user nova-compute[74805]: DEBUG nova.policy [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d4ea132d2434552a89e95d35060dbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc0430dda414f238788cc4d75813097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:14:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.233s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.187s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/89dcacb0-6864-4529-903d-ae46a2dc3bdd/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/89dcacb0-6864-4529-903d-ae46a2dc3bdd/disk 1073741824" returned: 0 in 0.146s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.347s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:42 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89dcacb0-6864-4529-903d-ae46a2dc3bdd/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:14:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89dcacb0-6864-4529-903d-ae46a2dc3bdd/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89dcacb0-6864-4529-903d-ae46a2dc3bdd/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:42 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Cannot resize image /opt/stack/data/nova/instances/89dcacb0-6864-4529-903d-ae46a2dc3bdd/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:14:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:14:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Ensure instance console log exists: /opt/stack/data/nova/instances/89dcacb0-6864-4529-903d-ae46a2dc3bdd/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:14:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG nova.compute.manager [req-5b93d0b8-51b1-4f90-b890-5d0d73003b22 req-398cda98-a1b9-43ad-9c4e-d289c3313e8e service nova] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Received event network-vif-plugged-88133a1b-c635-48f8-b84d-891f943b38f2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5b93d0b8-51b1-4f90-b890-5d0d73003b22 req-398cda98-a1b9-43ad-9c4e-d289c3313e8e service nova] Acquiring lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5b93d0b8-51b1-4f90-b890-5d0d73003b22 req-398cda98-a1b9-43ad-9c4e-d289c3313e8e service nova] Lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5b93d0b8-51b1-4f90-b890-5d0d73003b22 req-398cda98-a1b9-43ad-9c4e-d289c3313e8e service nova] Lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG nova.compute.manager [req-5b93d0b8-51b1-4f90-b890-5d0d73003b22 req-398cda98-a1b9-43ad-9c4e-d289c3313e8e service nova] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] No waiting events found dispatching network-vif-plugged-88133a1b-c635-48f8-b84d-891f943b38f2 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:14:43 user nova-compute[74805]: WARNING nova.compute.manager [req-5b93d0b8-51b1-4f90-b890-5d0d73003b22 req-398cda98-a1b9-43ad-9c4e-d289c3313e8e service nova] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Received unexpected event network-vif-plugged-88133a1b-c635-48f8-b84d-891f943b38f2 for instance with vm_state building and task_state spawning.
Nov 15 04:14:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Successfully created port: 8008b41a-f1bc-4a16-b839-17f69eea93e5 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:14:43 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Creating image(s)
Nov 15 04:14:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Did not create local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Ensure instance console log exists: /opt/stack/data/nova/instances/e91a656c-66d6-4a70-a115-8c03ed964f94/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Start _get_guest_xml network_info=[{"id": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "address": "fa:16:3e:d0:6e:1b", "network": {"id": "b3051571-47ed-471a-9d88-051306ee18e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-707580808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b22eb863a050454fb1998acbaae47f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ef9969-b6", "ovs_interfaceid": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQvEqwlU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e91a656c-66d6-4a70-a115-8c03ed964f94', 'attached_at': '', 'detached_at': '', 'volume_id': 'b384dac9-f81c-4c7a-bfc7-93966c62f43d', 'serial': 'b384dac9-f81c-4c7a-bfc7-93966c62f43d'}, 'delete_on_termination': True, 'attachment_id': 'bd5be7a4-793d-4655-8b21-9d0c614ceca9', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:14:43 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:14:43 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:14:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG os_brick.initiator.connector [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Factory for ISCSI on None {{(pid=74805) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.009s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQvEqwlU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:14:43 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:14:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:14:43 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:14:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:14:43 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:14:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae17eae-1bdb-43f1-a619-7958cbeec692]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:14:43 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f28f4a-ed77-4a4b-9dcb-19e9be7bb754]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d] added
Nov 15 04:14:43 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b82d89-a784-40d2-94c1-7a805261a942]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac114b6-7dba-4b74-a8a0-f605a1a67a08]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:14:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xQvEqwlU {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xQvEqwlU" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c23a952-4965-4358-8af8-ef829c7e69e3]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xQvEqwlU'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4fbd8b-d813-4ad7-84b0-0843caca88ad]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8623e28-29e2-47e9-8fda-f2f6eef4e313]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 04:14:44 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 04:14:44 user nova-compute[74805]:  {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:14:44 user nova-compute[74805]: WARNING os_brick.initiator.connectors.iscsi [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 04:14:44 user nova-compute[74805]: 
Nov 15 04:14:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf4c149-5130-41ce-a52d-be9b6668b564]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d, portal: 172.16.0.220,3260]
Nov 15 04:14:44 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d, portal: 172.16.0.220,3260] successful.
Nov 15 04:14:44 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b598d68e-8978-4584-a2d4-5e6ee398a63f]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aca4fae-d539-4a7e-88a8-38164b1c1c07]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:14:44 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:14:44 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[774c79ec-d876-4541-bcdf-fa9d93d9e618]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQvEqwlU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Successfully updated port: 8008b41a-f1bc-4a16-b839-17f69eea93e5 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Acquiring lock "refresh_cache-89dcacb0-6864-4529-903d-ae46a2dc3bdd" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Acquired lock "refresh_cache-89dcacb0-6864-4529-903d-ae46a2dc3bdd" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:14:44 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Instance spawned successfully.
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Updating instance_info_cache with network_info: [{"id": "8008b41a-f1bc-4a16-b839-17f69eea93e5", "address": "fa:16:3e:ea:64:39", "network": {"id": "6765ab2e-ca61-4ee7-873b-c41ae0c8f751", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-335552907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc0430dda414f238788cc4d75813097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8008b41a-f1", "ovs_interfaceid": "8008b41a-f1bc-4a16-b839-17f69eea93e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Releasing lock "refresh_cache-89dcacb0-6864-4529-903d-ae46a2dc3bdd" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Instance network_info: |[{"id": "8008b41a-f1bc-4a16-b839-17f69eea93e5", "address": "fa:16:3e:ea:64:39", "network": {"id": "6765ab2e-ca61-4ee7-873b-c41ae0c8f751", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-335552907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc0430dda414f238788cc4d75813097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8008b41a-f1", "ovs_interfaceid": "8008b41a-f1bc-4a16-b839-17f69eea93e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Start _get_guest_xml network_info=[{"id": "8008b41a-f1bc-4a16-b839-17f69eea93e5", "address": "fa:16:3e:ea:64:39", "network": {"id": "6765ab2e-ca61-4ee7-873b-c41ae0c8f751", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-335552907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc0430dda414f238788cc4d75813097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8008b41a-f1", "ovs_interfaceid": "8008b41a-f1bc-4a16-b839-17f69eea93e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:14:44 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:14:44 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-104897397',display_name='tempest-VolumesAssistedSnapshotsTest-server-104897397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-104897397',id=10,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJc1Yu6QkUOn79rDuAwEWVcecQCBh1BjhfHf4zoamr8WEqOwZNXEamWJK+plVdnQsiM8kgBOcZty0zODYPowPa3i+V6obYHycYZT74cwzcBaI/AUfQaYj+qwMGu8xFSDFg==',key_name='tempest-keypair-113998826',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ddc0430dda414f238788cc4d75813097',ramdisk_id='',reservation_id='r-w7w4u5q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-2010741569',owner_user_name='tempest-VolumesAssistedSnapshotsTest-2010741569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d4ea132d2434552a89e95d35060dbd6',uuid=89dcacb0-6864-4529-903d-ae46a2dc3bdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8008b41a-f1bc-4a16-b839-17f69eea93e5", "address": "fa:16:3e:ea:64:39", "network": {"id": "6765ab2e-ca61-4ee7-873b-c41ae0c8f751", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-335552907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc0430dda414f238788cc4d75813097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8008b41a-f1", "ovs_interfaceid": "8008b41a-f1bc-4a16-b839-17f69eea93e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Converting VIF {"id": "8008b41a-f1bc-4a16-b839-17f69eea93e5", "address": "fa:16:3e:ea:64:39", "network": {"id": "6765ab2e-ca61-4ee7-873b-c41ae0c8f751", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-335552907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc0430dda414f238788cc4d75813097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8008b41a-f1", "ovs_interfaceid": "8008b41a-f1bc-4a16-b839-17f69eea93e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:64:39,bridge_name='br-int',has_traffic_filtering=True,id=8008b41a-f1bc-4a16-b839-17f69eea93e5,network=Network(6765ab2e-ca61-4ee7-873b-c41ae0c8f751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8008b41a-f1') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.objects.instance [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Lazy-loading 'pci_devices' on Instance uuid 89dcacb0-6864-4529-903d-ae46a2dc3bdd {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:14:44 user nova-compute[74805]: INFO nova.compute.manager [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Took 10.35 seconds to spawn the instance on the hypervisor.
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:14:44 user nova-compute[74805]:   <uuid>89dcacb0-6864-4529-903d-ae46a2dc3bdd</uuid>
Nov 15 04:14:44 user nova-compute[74805]:   <name>instance-0000000a</name>
Nov 15 04:14:44 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:14:44 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:14:44 user nova-compute[74805]:   <metadata>
Nov 15 04:14:44 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:14:44 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:14:44 user nova-compute[74805]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-104897397</nova:name>
Nov 15 04:14:44 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:14:44</nova:creationTime>
Nov 15 04:14:44 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:14:44 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:14:44 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:14:44 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:14:44 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:14:44 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:14:44 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:14:44 user nova-compute[74805]:       <nova:owner>
Nov 15 04:14:44 user nova-compute[74805]:         <nova:user uuid="3d4ea132d2434552a89e95d35060dbd6">tempest-VolumesAssistedSnapshotsTest-2010741569-project-member</nova:user>
Nov 15 04:14:44 user nova-compute[74805]:         <nova:project uuid="ddc0430dda414f238788cc4d75813097">tempest-VolumesAssistedSnapshotsTest-2010741569</nova:project>
Nov 15 04:14:44 user nova-compute[74805]:       </nova:owner>
Nov 15 04:14:44 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:14:44 user nova-compute[74805]:       <nova:ports>
Nov 15 04:14:44 user nova-compute[74805]:         <nova:port uuid="8008b41a-f1bc-4a16-b839-17f69eea93e5">
Nov 15 04:14:44 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 04:14:44 user nova-compute[74805]:         </nova:port>
Nov 15 04:14:44 user nova-compute[74805]:       </nova:ports>
Nov 15 04:14:44 user nova-compute[74805]:     </nova:instance>
Nov 15 04:14:44 user nova-compute[74805]:   </metadata>
Nov 15 04:14:44 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:14:44 user nova-compute[74805]:     <system>
Nov 15 04:14:44 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:14:44 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:14:44 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:14:44 user nova-compute[74805]:       <entry name="serial">89dcacb0-6864-4529-903d-ae46a2dc3bdd</entry>
Nov 15 04:14:44 user nova-compute[74805]:       <entry name="uuid">89dcacb0-6864-4529-903d-ae46a2dc3bdd</entry>
Nov 15 04:14:44 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:14:44 user nova-compute[74805]:     </system>
Nov 15 04:14:44 user nova-compute[74805]:   </sysinfo>
Nov 15 04:14:44 user nova-compute[74805]:   <os>
Nov 15 04:14:44 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:14:44 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:14:44 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:14:44 user nova-compute[74805]:   </os>
Nov 15 04:14:44 user nova-compute[74805]:   <features>
Nov 15 04:14:44 user nova-compute[74805]:     <acpi/>
Nov 15 04:14:44 user nova-compute[74805]:     <apic/>
Nov 15 04:14:44 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:14:44 user nova-compute[74805]:   </features>
Nov 15 04:14:44 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:14:44 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:14:44 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:14:44 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:14:44 user nova-compute[74805]:   </clock>
Nov 15 04:14:44 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:14:44 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:14:44 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:14:44 user nova-compute[74805]:   </cpu>
Nov 15 04:14:44 user nova-compute[74805]:   <devices>
Nov 15 04:14:44 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:14:44 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:14:44 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/89dcacb0-6864-4529-903d-ae46a2dc3bdd/disk"/>
Nov 15 04:14:44 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:14:44 user nova-compute[74805]:     </disk>
Nov 15 04:14:44 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:14:44 user nova-compute[74805]:       <mac address="fa:16:3e:ea:64:39"/>
Nov 15 04:14:44 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:14:44 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:14:44 user nova-compute[74805]:       <target dev="tap8008b41a-f1"/>
Nov 15 04:14:44 user nova-compute[74805]:     </interface>
Nov 15 04:14:44 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:14:44 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/89dcacb0-6864-4529-903d-ae46a2dc3bdd/console.log" append="off"/>
Nov 15 04:14:44 user nova-compute[74805]:     </serial>
Nov 15 04:14:44 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:14:44 user nova-compute[74805]:     <video>
Nov 15 04:14:44 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:14:44 user nova-compute[74805]:     </video>
Nov 15 04:14:44 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:14:44 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:14:44 user nova-compute[74805]:     </rng>
Nov 15 04:14:44 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:14:44 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:14:44 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:14:44 user nova-compute[74805]:     </memballoon>
Nov 15 04:14:44 user nova-compute[74805]:   </devices>
Nov 15 04:14:44 user nova-compute[74805]: </domain>
Nov 15 04:14:44 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-104897397',display_name='tempest-VolumesAssistedSnapshotsTest-server-104897397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-104897397',id=10,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJc1Yu6QkUOn79rDuAwEWVcecQCBh1BjhfHf4zoamr8WEqOwZNXEamWJK+plVdnQsiM8kgBOcZty0zODYPowPa3i+V6obYHycYZT74cwzcBaI/AUfQaYj+qwMGu8xFSDFg==',key_name='tempest-keypair-113998826',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ddc0430dda414f238788cc4d75813097',ramdisk_id='',reservation_id='r-w7w4u5q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-2010741569',owner_user_name='tempest-VolumesAssistedSnapshotsTest-2010741569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d4ea132d2434552a89e95d35060dbd6',uuid=89dcacb0-6864-4529-903d-ae46a2dc3bdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8008b41a-f1bc-4a16-b839-17f69eea93e5", "address": "fa:16:3e:ea:64:39", "network": {"id": "6765ab2e-ca61-4ee7-873b-c41ae0c8f751", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-335552907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc0430dda414f238788cc4d75813097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8008b41a-f1", "ovs_interfaceid": "8008b41a-f1bc-4a16-b839-17f69eea93e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Converting VIF {"id": "8008b41a-f1bc-4a16-b839-17f69eea93e5", "address": "fa:16:3e:ea:64:39", "network": {"id": "6765ab2e-ca61-4ee7-873b-c41ae0c8f751", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-335552907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc0430dda414f238788cc4d75813097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8008b41a-f1", "ovs_interfaceid": "8008b41a-f1bc-4a16-b839-17f69eea93e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:64:39,bridge_name='br-int',has_traffic_filtering=True,id=8008b41a-f1bc-4a16-b839-17f69eea93e5,network=Network(6765ab2e-ca61-4ee7-873b-c41ae0c8f751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8008b41a-f1') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG os_vif [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:64:39,bridge_name='br-int',has_traffic_filtering=True,id=8008b41a-f1bc-4a16-b839-17f69eea93e5,network=Network(6765ab2e-ca61-4ee7-873b-c41ae0c8f751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8008b41a-f1') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e852660-ce69-580b-afde-5556c9e6a642', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8008b41a-f1, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8008b41a-f1, col_values=(('qos', UUID('f9ea709f-b2cd-457a-bc1f-f91827cef7aa')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8008b41a-f1, col_values=(('external_ids', {'iface-id': '8008b41a-f1bc-4a16-b839-17f69eea93e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:64:39', 'vm-uuid': '89dcacb0-6864-4529-903d-ae46a2dc3bdd'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:44 user nova-compute[74805]: INFO os_vif [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:64:39,bridge_name='br-int',has_traffic_filtering=True,id=8008b41a-f1bc-4a16-b839-17f69eea93e5,network=Network(6765ab2e-ca61-4ee7-873b-c41ae0c8f751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8008b41a-f1')
Nov 15 04:14:44 user nova-compute[74805]: INFO nova.compute.manager [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Took 12.01 seconds to build instance.
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:14:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] No VIF found with MAC fa:16:3e:ea:64:39, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d5d27344-4df7-43f9-93fb-55efd90a18b6 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.164s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-03b1ad16-7cc3-4ef8-829a-6eda70762e31 req-a1fe9032-90de-4202-b9d6-f7e745841ec8 service nova] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Received event network-vif-plugged-88133a1b-c635-48f8-b84d-891f943b38f2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-03b1ad16-7cc3-4ef8-829a-6eda70762e31 req-a1fe9032-90de-4202-b9d6-f7e745841ec8 service nova] Acquiring lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-03b1ad16-7cc3-4ef8-829a-6eda70762e31 req-a1fe9032-90de-4202-b9d6-f7e745841ec8 service nova] Lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-03b1ad16-7cc3-4ef8-829a-6eda70762e31 req-a1fe9032-90de-4202-b9d6-f7e745841ec8 service nova] Lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-03b1ad16-7cc3-4ef8-829a-6eda70762e31 req-a1fe9032-90de-4202-b9d6-f7e745841ec8 service nova] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] No waiting events found dispatching network-vif-plugged-88133a1b-c635-48f8-b84d-891f943b38f2 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:14:45 user nova-compute[74805]: WARNING nova.compute.manager [req-03b1ad16-7cc3-4ef8-829a-6eda70762e31 req-a1fe9032-90de-4202-b9d6-f7e745841ec8 service nova] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Received unexpected event network-vif-plugged-88133a1b-c635-48f8-b84d-891f943b38f2 for instance with vm_state building and task_state spawning.
Nov 15 04:14:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-03b1ad16-7cc3-4ef8-829a-6eda70762e31 req-a1fe9032-90de-4202-b9d6-f7e745841ec8 service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Received event network-changed-8008b41a-f1bc-4a16-b839-17f69eea93e5 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-03b1ad16-7cc3-4ef8-829a-6eda70762e31 req-a1fe9032-90de-4202-b9d6-f7e745841ec8 service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Refreshing instance network info cache due to event network-changed-8008b41a-f1bc-4a16-b839-17f69eea93e5. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-03b1ad16-7cc3-4ef8-829a-6eda70762e31 req-a1fe9032-90de-4202-b9d6-f7e745841ec8 service nova] Acquiring lock "refresh_cache-89dcacb0-6864-4529-903d-ae46a2dc3bdd" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-03b1ad16-7cc3-4ef8-829a-6eda70762e31 req-a1fe9032-90de-4202-b9d6-f7e745841ec8 service nova] Acquired lock "refresh_cache-89dcacb0-6864-4529-903d-ae46a2dc3bdd" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG nova.network.neutron [req-03b1ad16-7cc3-4ef8-829a-6eda70762e31 req-a1fe9032-90de-4202-b9d6-f7e745841ec8 service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Refreshing network info cache for port 8008b41a-f1bc-4a16-b839-17f69eea93e5 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG nova.compute.manager [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23232393664333833', 'path': '/dev/sdb'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232393664333833', 'path': '/dev/sdb'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:14:45 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Instance spawned successfully.
Nov 15 04:14:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1742924084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1742924084',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlMPSTIiQVE0Cg8/bE0RixmymMVDkL6CLvmQNksg244N0w4rCZu1JDjdz8UBU0xRiR4zxHQg+y5pVbvwhdP+A3FI8Akdh2Dzal25VcHo1J+LBfq6srezgKC8edvUX0D8Q==',key_name='tempest-keypair-430392767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b22eb863a050454fb1998acbaae47f23',ramdisk_id='',reservation_id='r-uvt06p7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1378822471',owner_user_name='tempest-ServerActionsV293TestJSON-1378822471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7ec9f2afcee4c23883d572235bfa437',uuid=e91a656c-66d6-4a70-a115-8c03ed964f94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "address": "fa:16:3e:d0:6e:1b", "network": {"id": "b3051571-47ed-471a-9d88-051306ee18e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-707580808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b22eb863a050454fb1998acbaae47f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ef9969-b6", "ovs_interfaceid": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Converting VIF {"id": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "address": "fa:16:3e:d0:6e:1b", "network": {"id": "b3051571-47ed-471a-9d88-051306ee18e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-707580808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b22eb863a050454fb1998acbaae47f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ef9969-b6", "ovs_interfaceid": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:6e:1b,bridge_name='br-int',has_traffic_filtering=True,id=78ef9969-b62c-4730-8bbf-e5a8d2c75010,network=Network(b3051571-47ed-471a-9d88-051306ee18e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ef9969-b6') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG nova.objects.instance [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lazy-loading 'pci_devices' on Instance uuid e91a656c-66d6-4a70-a115-8c03ed964f94 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:14:45 user nova-compute[74805]:   <uuid>e91a656c-66d6-4a70-a115-8c03ed964f94</uuid>
Nov 15 04:14:45 user nova-compute[74805]:   <name>instance-00000007</name>
Nov 15 04:14:45 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:14:45 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:14:45 user nova-compute[74805]:   <metadata>
Nov 15 04:14:45 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:14:45 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:14:45 user nova-compute[74805]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1742924084</nova:name>
Nov 15 04:14:45 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:14:43</nova:creationTime>
Nov 15 04:14:45 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:14:45 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:14:45 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:14:45 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:14:45 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:14:45 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:14:45 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:14:45 user nova-compute[74805]:       <nova:owner>
Nov 15 04:14:45 user nova-compute[74805]:         <nova:user uuid="d7ec9f2afcee4c23883d572235bfa437">tempest-ServerActionsV293TestJSON-1378822471-project-member</nova:user>
Nov 15 04:14:45 user nova-compute[74805]:         <nova:project uuid="b22eb863a050454fb1998acbaae47f23">tempest-ServerActionsV293TestJSON-1378822471</nova:project>
Nov 15 04:14:45 user nova-compute[74805]:       </nova:owner>
Nov 15 04:14:45 user nova-compute[74805]:       <nova:ports>
Nov 15 04:14:45 user nova-compute[74805]:         <nova:port uuid="78ef9969-b62c-4730-8bbf-e5a8d2c75010">
Nov 15 04:14:45 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 04:14:45 user nova-compute[74805]:         </nova:port>
Nov 15 04:14:45 user nova-compute[74805]:       </nova:ports>
Nov 15 04:14:45 user nova-compute[74805]:     </nova:instance>
Nov 15 04:14:45 user nova-compute[74805]:   </metadata>
Nov 15 04:14:45 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:14:45 user nova-compute[74805]:     <system>
Nov 15 04:14:45 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:14:45 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:14:45 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:14:45 user nova-compute[74805]:       <entry name="serial">e91a656c-66d6-4a70-a115-8c03ed964f94</entry>
Nov 15 04:14:45 user nova-compute[74805]:       <entry name="uuid">e91a656c-66d6-4a70-a115-8c03ed964f94</entry>
Nov 15 04:14:45 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:14:45 user nova-compute[74805]:     </system>
Nov 15 04:14:45 user nova-compute[74805]:   </sysinfo>
Nov 15 04:14:45 user nova-compute[74805]:   <os>
Nov 15 04:14:45 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:14:45 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:14:45 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:14:45 user nova-compute[74805]:   </os>
Nov 15 04:14:45 user nova-compute[74805]:   <features>
Nov 15 04:14:45 user nova-compute[74805]:     <acpi/>
Nov 15 04:14:45 user nova-compute[74805]:     <apic/>
Nov 15 04:14:45 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:14:45 user nova-compute[74805]:   </features>
Nov 15 04:14:45 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:14:45 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:14:45 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:14:45 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:14:45 user nova-compute[74805]:   </clock>
Nov 15 04:14:45 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:14:45 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:14:45 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:14:45 user nova-compute[74805]:   </cpu>
Nov 15 04:14:45 user nova-compute[74805]:   <devices>
Nov 15 04:14:45 user nova-compute[74805]:     <disk type="block" device="disk">
Nov 15 04:14:45 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:14:45 user nova-compute[74805]:       <source dev="/dev/sdb"/>
Nov 15 04:14:45 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:14:45 user nova-compute[74805]:       <serial>b384dac9-f81c-4c7a-bfc7-93966c62f43d</serial>
Nov 15 04:14:45 user nova-compute[74805]:     </disk>
Nov 15 04:14:45 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:14:45 user nova-compute[74805]:       <mac address="fa:16:3e:d0:6e:1b"/>
Nov 15 04:14:45 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:14:45 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:14:45 user nova-compute[74805]:       <target dev="tap78ef9969-b6"/>
Nov 15 04:14:45 user nova-compute[74805]:     </interface>
Nov 15 04:14:45 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:14:45 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/e91a656c-66d6-4a70-a115-8c03ed964f94/console.log" append="off"/>
Nov 15 04:14:45 user nova-compute[74805]:     </serial>
Nov 15 04:14:45 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:14:45 user nova-compute[74805]:     <video>
Nov 15 04:14:45 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:14:45 user nova-compute[74805]:     </video>
Nov 15 04:14:45 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:14:45 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:14:45 user nova-compute[74805]:     </rng>
Nov 15 04:14:45 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:14:45 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:14:45 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:14:45 user nova-compute[74805]:     </memballoon>
Nov 15 04:14:45 user nova-compute[74805]:   </devices>
Nov 15 04:14:45 user nova-compute[74805]: </domain>
Nov 15 04:14:45 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1742924084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1742924084',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlMPSTIiQVE0Cg8/bE0RixmymMVDkL6CLvmQNksg244N0w4rCZu1JDjdz8UBU0xRiR4zxHQg+y5pVbvwhdP+A3FI8Akdh2Dzal25VcHo1J+LBfq6srezgKC8edvUX0D8Q==',key_name='tempest-keypair-430392767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b22eb863a050454fb1998acbaae47f23',ramdisk_id='',reservation_id='r-uvt06p7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1378822471',owner_user_name='tempest-ServerActionsV293TestJSON-1378822471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7ec9f2afcee4c23883d572235bfa437',uuid=e91a656c-66d6-4a70-a115-8c03ed964f94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "address": "fa:16:3e:d0:6e:1b", "network": {"id": "b3051571-47ed-471a-9d88-051306ee18e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-707580808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b22eb863a050454fb1998acbaae47f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ef9969-b6", "ovs_interfaceid": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Converting VIF {"id": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "address": "fa:16:3e:d0:6e:1b", "network": {"id": "b3051571-47ed-471a-9d88-051306ee18e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-707580808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b22eb863a050454fb1998acbaae47f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ef9969-b6", "ovs_interfaceid": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:6e:1b,bridge_name='br-int',has_traffic_filtering=True,id=78ef9969-b62c-4730-8bbf-e5a8d2c75010,network=Network(b3051571-47ed-471a-9d88-051306ee18e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ef9969-b6') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG os_vif [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:6e:1b,bridge_name='br-int',has_traffic_filtering=True,id=78ef9969-b62c-4730-8bbf-e5a8d2c75010,network=Network(b3051571-47ed-471a-9d88-051306ee18e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ef9969-b6') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ad6daee-3535-5aa0-958c-d6e8859f88c9', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78ef9969-b6, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78ef9969-b6, col_values=(('qos', UUID('38880ec7-d4f9-46a6-b372-dd41bdc61691')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78ef9969-b6, col_values=(('external_ids', {'iface-id': '78ef9969-b62c-4730-8bbf-e5a8d2c75010', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:6e:1b', 'vm-uuid': 'e91a656c-66d6-4a70-a115-8c03ed964f94'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:45 user nova-compute[74805]: INFO os_vif [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:6e:1b,bridge_name='br-int',has_traffic_filtering=True,id=78ef9969-b62c-4730-8bbf-e5a8d2c75010,network=Network(b3051571-47ed-471a-9d88-051306ee18e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ef9969-b6')
Nov 15 04:14:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] No VIF found with MAC fa:16:3e:d0:6e:1b, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:14:45 user nova-compute[74805]: INFO nova.compute.manager [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Took 9.38 seconds to spawn the instance on the hypervisor.
Nov 15 04:14:45 user nova-compute[74805]: DEBUG nova.compute.manager [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:14:45 user nova-compute[74805]: INFO nova.compute.manager [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Took 11.23 seconds to build instance.
Nov 15 04:14:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-59fbce5c-6f7b-4b31-86e5-a6ed0e66ff5a tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.404s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG nova.network.neutron [req-03b1ad16-7cc3-4ef8-829a-6eda70762e31 req-a1fe9032-90de-4202-b9d6-f7e745841ec8 service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Updated VIF entry in instance network info cache for port 8008b41a-f1bc-4a16-b839-17f69eea93e5. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG nova.network.neutron [req-03b1ad16-7cc3-4ef8-829a-6eda70762e31 req-a1fe9032-90de-4202-b9d6-f7e745841ec8 service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Updating instance_info_cache with network_info: [{"id": "8008b41a-f1bc-4a16-b839-17f69eea93e5", "address": "fa:16:3e:ea:64:39", "network": {"id": "6765ab2e-ca61-4ee7-873b-c41ae0c8f751", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-335552907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc0430dda414f238788cc4d75813097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8008b41a-f1", "ovs_interfaceid": "8008b41a-f1bc-4a16-b839-17f69eea93e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:14:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-03b1ad16-7cc3-4ef8-829a-6eda70762e31 req-a1fe9032-90de-4202-b9d6-f7e745841ec8 service nova] Releasing lock "refresh_cache-89dcacb0-6864-4529-903d-ae46a2dc3bdd" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:14:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:50 user nova-compute[74805]: DEBUG nova.compute.manager [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:14:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:50 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:14:50 user nova-compute[74805]: INFO nova.compute.claims [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Claim successful on node user
Nov 15 04:14:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:50 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:14:51 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Instance spawned successfully.
Nov 15 04:14:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.873s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG nova.compute.manager [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:14:51 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Instance spawned successfully.
Nov 15 04:14:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG nova.compute.manager [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG nova.network.neutron [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:14:51 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:14:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:14:51 user nova-compute[74805]: INFO nova.compute.manager [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Took 7.55 seconds to spawn the instance on the hypervisor.
Nov 15 04:14:51 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:14:51 user nova-compute[74805]: INFO nova.compute.manager [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Took 21.61 seconds to build instance.
Nov 15 04:14:51 user nova-compute[74805]: DEBUG nova.compute.manager [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ad32dd48-f945-49ba-8f11-8fb827c8cef9 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "e91a656c-66d6-4a70-a115-8c03ed964f94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.976s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:51 user nova-compute[74805]: INFO nova.compute.manager [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Took 9.80 seconds to spawn the instance on the hypervisor.
Nov 15 04:14:51 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:14:51 user nova-compute[74805]: INFO nova.virt.block_device [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Booting with volume 5c533429-7f55-4f56-a45f-e02c2f0dd651 at /dev/vda
Nov 15 04:14:51 user nova-compute[74805]: DEBUG nova.policy [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52d077ca42b442e9913fc83e1cc73436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b57aff3d714da1a9872ecec24524ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:14:51 user nova-compute[74805]: INFO nova.compute.manager [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Took 11.57 seconds to build instance.
Nov 15 04:14:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b716fea4-04b6-4e05-8c82-7ef094e4f16a tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.826s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG os_brick.utils [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9a5573-d400-4830-8322-89201cdaa323]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[62312ce5-9a3e-4022-b983-7fc4c3e8fac4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd363d0e-e0de-461f-a7eb-1c4b326a0707]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc398b5b-102a-4b12-b992-9f840b891ab5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:14:51 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:14:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f55caa-983c-4010-8303-40a3c033a6f8]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG os_brick.utils [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:14:51 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Updating existing volume attachment record: 75d9e76e-d16f-402a-824e-f3cb9f036bd6 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:14:52 user nova-compute[74805]: DEBUG nova.network.neutron [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Successfully created port: 8fb4ff06-71a7-4fe2-81b0-e4d980e75a23 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:14:53 user nova-compute[74805]: DEBUG nova.network.neutron [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Successfully created port: 45598f97-ca9c-423f-bf8e-e7ce6aba0073 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:14:53 user nova-compute[74805]: DEBUG nova.network.neutron [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Successfully created port: 39f4ba29-3df3-4389-ae97-476675222a14 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:14:54 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:54 user nova-compute[74805]: DEBUG nova.network.neutron [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Successfully created port: c2cf28e2-46e0-450c-a153-23e6ef6da5f2 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:14:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:55 user nova-compute[74805]: DEBUG nova.network.neutron [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Successfully created port: 705a958d-3fb6-4fe9-ba7e-e69d242dde68 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:14:56 user nova-compute[74805]: DEBUG nova.network.neutron [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Successfully updated port: 8fb4ff06-71a7-4fe2-81b0-e4d980e75a23 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:14:56 user nova-compute[74805]: DEBUG nova.compute.manager [req-522f0d0f-9da8-42e6-be54-a4b059b1feb2 req-e05a2001-f6d7-4487-8294-59ebc07c30bc service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-changed-8fb4ff06-71a7-4fe2-81b0-e4d980e75a23 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:14:56 user nova-compute[74805]: DEBUG nova.compute.manager [req-522f0d0f-9da8-42e6-be54-a4b059b1feb2 req-e05a2001-f6d7-4487-8294-59ebc07c30bc service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Refreshing instance network info cache due to event network-changed-8fb4ff06-71a7-4fe2-81b0-e4d980e75a23. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:14:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-522f0d0f-9da8-42e6-be54-a4b059b1feb2 req-e05a2001-f6d7-4487-8294-59ebc07c30bc service nova] Acquiring lock "refresh_cache-e1a3273f-42d2-4582-b539-3c7c6111cf3c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:14:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-522f0d0f-9da8-42e6-be54-a4b059b1feb2 req-e05a2001-f6d7-4487-8294-59ebc07c30bc service nova] Acquired lock "refresh_cache-e1a3273f-42d2-4582-b539-3c7c6111cf3c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:14:56 user nova-compute[74805]: DEBUG nova.network.neutron [req-522f0d0f-9da8-42e6-be54-a4b059b1feb2 req-e05a2001-f6d7-4487-8294-59ebc07c30bc service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Refreshing network info cache for port 8fb4ff06-71a7-4fe2-81b0-e4d980e75a23 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:14:56 user nova-compute[74805]: DEBUG nova.compute.manager [req-ea422b38-dc02-43ed-848d-fc777000d1e6 req-f180cd0c-f863-4f06-b042-ce5a193f4e2f service nova] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Received event network-vif-plugged-94bbd0d6-bf79-45aa-b274-8a9b44dd26ab {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:14:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ea422b38-dc02-43ed-848d-fc777000d1e6 req-f180cd0c-f863-4f06-b042-ce5a193f4e2f service nova] Acquiring lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ea422b38-dc02-43ed-848d-fc777000d1e6 req-f180cd0c-f863-4f06-b042-ce5a193f4e2f service nova] Lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ea422b38-dc02-43ed-848d-fc777000d1e6 req-f180cd0c-f863-4f06-b042-ce5a193f4e2f service nova] Lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:56 user nova-compute[74805]: DEBUG nova.compute.manager [req-ea422b38-dc02-43ed-848d-fc777000d1e6 req-f180cd0c-f863-4f06-b042-ce5a193f4e2f service nova] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] No waiting events found dispatching network-vif-plugged-94bbd0d6-bf79-45aa-b274-8a9b44dd26ab {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:14:56 user nova-compute[74805]: WARNING nova.compute.manager [req-ea422b38-dc02-43ed-848d-fc777000d1e6 req-f180cd0c-f863-4f06-b042-ce5a193f4e2f service nova] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Received unexpected event network-vif-plugged-94bbd0d6-bf79-45aa-b274-8a9b44dd26ab for instance with vm_state active and task_state None.
Nov 15 04:14:56 user nova-compute[74805]: DEBUG nova.network.neutron [req-522f0d0f-9da8-42e6-be54-a4b059b1feb2 req-e05a2001-f6d7-4487-8294-59ebc07c30bc service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:14:57 user nova-compute[74805]: DEBUG nova.network.neutron [req-522f0d0f-9da8-42e6-be54-a4b059b1feb2 req-e05a2001-f6d7-4487-8294-59ebc07c30bc service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:14:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-522f0d0f-9da8-42e6-be54-a4b059b1feb2 req-e05a2001-f6d7-4487-8294-59ebc07c30bc service nova] Releasing lock "refresh_cache-e1a3273f-42d2-4582-b539-3c7c6111cf3c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:14:57 user nova-compute[74805]: DEBUG nova.network.neutron [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Successfully updated port: 2fd61de8-594b-4c85-957d-db3f622ffdc2 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Cleaning up deleted instances {{(pid=74805) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] There are 0 instances to clean {{(pid=74805) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74805) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:14:58 user nova-compute[74805]: INFO nova.virt.block_device [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Booting with volume 38401583-d453-48d5-b5c6-9b7bddfc9730 at /dev/vdb
Nov 15 04:14:58 user nova-compute[74805]: DEBUG os_brick.utils [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[25134367-6db2-4c42-92d7-fdc2750e6ef1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c0450c-58d6-4f49-96dd-c2688807f852]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd260505-3d45-4234-a043-c425f0abe13a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3718c2e-105d-4556-b745-3b1f956e3200]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG nova.network.neutron [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Successfully updated port: 4f5678db-1255-42ae-84ca-4d1b3b5dac84 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG nova.compute.manager [req-291d7d46-b0ba-457c-9c51-e3ce26717430 req-f80cfd29-793b-4057-8401-60992bd706be service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-changed-2fd61de8-594b-4c85-957d-db3f622ffdc2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG nova.compute.manager [req-291d7d46-b0ba-457c-9c51-e3ce26717430 req-f80cfd29-793b-4057-8401-60992bd706be service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Refreshing instance network info cache due to event network-changed-2fd61de8-594b-4c85-957d-db3f622ffdc2. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-291d7d46-b0ba-457c-9c51-e3ce26717430 req-f80cfd29-793b-4057-8401-60992bd706be service nova] Acquiring lock "refresh_cache-e1a3273f-42d2-4582-b539-3c7c6111cf3c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-291d7d46-b0ba-457c-9c51-e3ce26717430 req-f80cfd29-793b-4057-8401-60992bd706be service nova] Acquired lock "refresh_cache-e1a3273f-42d2-4582-b539-3c7c6111cf3c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG nova.network.neutron [req-291d7d46-b0ba-457c-9c51-e3ce26717430 req-f80cfd29-793b-4057-8401-60992bd706be service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Refreshing network info cache for port 2fd61de8-594b-4c85-957d-db3f622ffdc2 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:14:58 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:14:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[db16e4d7-8c21-498f-a059-0e1dd3c09eb8]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG os_brick.utils [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Updating existing volume attachment record: b99ed960-195d-420e-b535-2e77c7f39688 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG nova.network.neutron [req-291d7d46-b0ba-457c-9c51-e3ce26717430 req-f80cfd29-793b-4057-8401-60992bd706be service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG nova.compute.manager [req-6661d23c-d064-4c6a-8dca-15885506ccdc req-b6eea30f-e719-43e1-8184-4d7d1927d605 service nova] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Received event network-vif-plugged-94bbd0d6-bf79-45aa-b274-8a9b44dd26ab {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6661d23c-d064-4c6a-8dca-15885506ccdc req-b6eea30f-e719-43e1-8184-4d7d1927d605 service nova] Acquiring lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6661d23c-d064-4c6a-8dca-15885506ccdc req-b6eea30f-e719-43e1-8184-4d7d1927d605 service nova] Lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6661d23c-d064-4c6a-8dca-15885506ccdc req-b6eea30f-e719-43e1-8184-4d7d1927d605 service nova] Lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG nova.compute.manager [req-6661d23c-d064-4c6a-8dca-15885506ccdc req-b6eea30f-e719-43e1-8184-4d7d1927d605 service nova] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] No waiting events found dispatching network-vif-plugged-94bbd0d6-bf79-45aa-b274-8a9b44dd26ab {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:14:58 user nova-compute[74805]: WARNING nova.compute.manager [req-6661d23c-d064-4c6a-8dca-15885506ccdc req-b6eea30f-e719-43e1-8184-4d7d1927d605 service nova] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Received unexpected event network-vif-plugged-94bbd0d6-bf79-45aa-b274-8a9b44dd26ab for instance with vm_state active and task_state None.
Nov 15 04:14:58 user nova-compute[74805]: DEBUG nova.network.neutron [req-291d7d46-b0ba-457c-9c51-e3ce26717430 req-f80cfd29-793b-4057-8401-60992bd706be service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:14:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-291d7d46-b0ba-457c-9c51-e3ce26717430 req-f80cfd29-793b-4057-8401-60992bd706be service nova] Releasing lock "refresh_cache-e1a3273f-42d2-4582-b539-3c7c6111cf3c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:14:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:14:59 user nova-compute[74805]: DEBUG nova.network.neutron [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Successfully updated port: 45598f97-ca9c-423f-bf8e-e7ce6aba0073 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:15:00 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:15:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:00 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:15:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:00 user nova-compute[74805]: DEBUG nova.network.neutron [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Successfully updated port: 39f4ba29-3df3-4389-ae97-476675222a14 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:15:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-e0f40c77-e1fc-4004-9f12-b26f1ab96dc9 req-6a386fd3-c623-4141-bccf-cc507fa0322c service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-changed-4f5678db-1255-42ae-84ca-4d1b3b5dac84 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-e0f40c77-e1fc-4004-9f12-b26f1ab96dc9 req-6a386fd3-c623-4141-bccf-cc507fa0322c service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Refreshing instance network info cache due to event network-changed-4f5678db-1255-42ae-84ca-4d1b3b5dac84. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:15:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e0f40c77-e1fc-4004-9f12-b26f1ab96dc9 req-6a386fd3-c623-4141-bccf-cc507fa0322c service nova] Acquiring lock "refresh_cache-e1a3273f-42d2-4582-b539-3c7c6111cf3c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:15:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e0f40c77-e1fc-4004-9f12-b26f1ab96dc9 req-6a386fd3-c623-4141-bccf-cc507fa0322c service nova] Acquired lock "refresh_cache-e1a3273f-42d2-4582-b539-3c7c6111cf3c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:15:00 user nova-compute[74805]: DEBUG nova.network.neutron [req-e0f40c77-e1fc-4004-9f12-b26f1ab96dc9 req-6a386fd3-c623-4141-bccf-cc507fa0322c service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Refreshing network info cache for port 4f5678db-1255-42ae-84ca-4d1b3b5dac84 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:15:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:15:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:00 user nova-compute[74805]: DEBUG nova.network.neutron [req-e0f40c77-e1fc-4004-9f12-b26f1ab96dc9 req-6a386fd3-c623-4141-bccf-cc507fa0322c service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:15:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:00 user nova-compute[74805]: DEBUG nova.network.neutron [req-e0f40c77-e1fc-4004-9f12-b26f1ab96dc9 req-6a386fd3-c623-4141-bccf-cc507fa0322c service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:15:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2921f743-66d5-47c1-b2e4-1b6957a2d550/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e0f40c77-e1fc-4004-9f12-b26f1ab96dc9 req-6a386fd3-c623-4141-bccf-cc507fa0322c service nova] Releasing lock "refresh_cache-e1a3273f-42d2-4582-b539-3c7c6111cf3c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:15:01 user nova-compute[74805]: DEBUG nova.compute.manager [req-e0f40c77-e1fc-4004-9f12-b26f1ab96dc9 req-6a386fd3-c623-4141-bccf-cc507fa0322c service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-changed-45598f97-ca9c-423f-bf8e-e7ce6aba0073 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:01 user nova-compute[74805]: DEBUG nova.compute.manager [req-e0f40c77-e1fc-4004-9f12-b26f1ab96dc9 req-6a386fd3-c623-4141-bccf-cc507fa0322c service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Refreshing instance network info cache due to event network-changed-45598f97-ca9c-423f-bf8e-e7ce6aba0073. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:15:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e0f40c77-e1fc-4004-9f12-b26f1ab96dc9 req-6a386fd3-c623-4141-bccf-cc507fa0322c service nova] Acquiring lock "refresh_cache-e1a3273f-42d2-4582-b539-3c7c6111cf3c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:15:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e0f40c77-e1fc-4004-9f12-b26f1ab96dc9 req-6a386fd3-c623-4141-bccf-cc507fa0322c service nova] Acquired lock "refresh_cache-e1a3273f-42d2-4582-b539-3c7c6111cf3c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:15:01 user nova-compute[74805]: DEBUG nova.network.neutron [req-e0f40c77-e1fc-4004-9f12-b26f1ab96dc9 req-6a386fd3-c623-4141-bccf-cc507fa0322c service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Refreshing network info cache for port 45598f97-ca9c-423f-bf8e-e7ce6aba0073 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:15:01 user nova-compute[74805]: DEBUG nova.network.neutron [req-e0f40c77-e1fc-4004-9f12-b26f1ab96dc9 req-6a386fd3-c623-4141-bccf-cc507fa0322c service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:15:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2921f743-66d5-47c1-b2e4-1b6957a2d550/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2921f743-66d5-47c1-b2e4-1b6957a2d550/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:01 user nova-compute[74805]: DEBUG nova.network.neutron [req-e0f40c77-e1fc-4004-9f12-b26f1ab96dc9 req-6a386fd3-c623-4141-bccf-cc507fa0322c service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:15:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2921f743-66d5-47c1-b2e4-1b6957a2d550/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e0f40c77-e1fc-4004-9f12-b26f1ab96dc9 req-6a386fd3-c623-4141-bccf-cc507fa0322c service nova] Releasing lock "refresh_cache-e1a3273f-42d2-4582-b539-3c7c6111cf3c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:15:01 user nova-compute[74805]: DEBUG nova.compute.manager [req-e0f40c77-e1fc-4004-9f12-b26f1ab96dc9 req-6a386fd3-c623-4141-bccf-cc507fa0322c service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-changed-39f4ba29-3df3-4389-ae97-476675222a14 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:01 user nova-compute[74805]: DEBUG nova.compute.manager [req-e0f40c77-e1fc-4004-9f12-b26f1ab96dc9 req-6a386fd3-c623-4141-bccf-cc507fa0322c service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Refreshing instance network info cache due to event network-changed-39f4ba29-3df3-4389-ae97-476675222a14. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:15:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e0f40c77-e1fc-4004-9f12-b26f1ab96dc9 req-6a386fd3-c623-4141-bccf-cc507fa0322c service nova] Acquiring lock "refresh_cache-e1a3273f-42d2-4582-b539-3c7c6111cf3c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:15:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e0f40c77-e1fc-4004-9f12-b26f1ab96dc9 req-6a386fd3-c623-4141-bccf-cc507fa0322c service nova] Acquired lock "refresh_cache-e1a3273f-42d2-4582-b539-3c7c6111cf3c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:15:01 user nova-compute[74805]: DEBUG nova.network.neutron [req-e0f40c77-e1fc-4004-9f12-b26f1ab96dc9 req-6a386fd3-c623-4141-bccf-cc507fa0322c service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Refreshing network info cache for port 39f4ba29-3df3-4389-ae97-476675222a14 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:15:01 user nova-compute[74805]: DEBUG nova.network.neutron [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Successfully updated port: c2cf28e2-46e0-450c-a153-23e6ef6da5f2 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:15:01 user nova-compute[74805]: DEBUG nova.network.neutron [req-e0f40c77-e1fc-4004-9f12-b26f1ab96dc9 req-6a386fd3-c623-4141-bccf-cc507fa0322c service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:15:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:01 user nova-compute[74805]: DEBUG nova.network.neutron [req-e0f40c77-e1fc-4004-9f12-b26f1ab96dc9 req-6a386fd3-c623-4141-bccf-cc507fa0322c service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:15:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e0f40c77-e1fc-4004-9f12-b26f1ab96dc9 req-6a386fd3-c623-4141-bccf-cc507fa0322c service nova] Releasing lock "refresh_cache-e1a3273f-42d2-4582-b539-3c7c6111cf3c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:15:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:02 user nova-compute[74805]: DEBUG nova.network.neutron [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Successfully updated port: 705a958d-3fb6-4fe9-ba7e-e69d242dde68 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:15:02 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Acquiring lock "refresh_cache-e1a3273f-42d2-4582-b539-3c7c6111cf3c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:15:02 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Acquired lock "refresh_cache-e1a3273f-42d2-4582-b539-3c7c6111cf3c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:15:02 user nova-compute[74805]: DEBUG nova.network.neutron [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:15:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:02 user nova-compute[74805]: DEBUG nova.network.neutron [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:15:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json" returned: 0 in 0.303s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:02 user nova-compute[74805]: DEBUG nova.compute.manager [req-2035a12d-9c10-4eed-8f9e-89ae58be7df0 req-0f56db8e-a05e-4fa8-b2cc-1408ed550ecb service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-changed-c2cf28e2-46e0-450c-a153-23e6ef6da5f2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:02 user nova-compute[74805]: DEBUG nova.compute.manager [req-2035a12d-9c10-4eed-8f9e-89ae58be7df0 req-0f56db8e-a05e-4fa8-b2cc-1408ed550ecb service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Refreshing instance network info cache due to event network-changed-c2cf28e2-46e0-450c-a153-23e6ef6da5f2. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:15:02 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2035a12d-9c10-4eed-8f9e-89ae58be7df0 req-0f56db8e-a05e-4fa8-b2cc-1408ed550ecb service nova] Acquiring lock "refresh_cache-e1a3273f-42d2-4582-b539-3c7c6111cf3c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:15:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdf3e90f-4fd8-4da4-a888-48c7a80fb209/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdf3e90f-4fd8-4da4-a888-48c7a80fb209/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdf3e90f-4fd8-4da4-a888-48c7a80fb209/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdf3e90f-4fd8-4da4-a888-48c7a80fb209/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:03 user nova-compute[74805]: DEBUG nova.compute.manager [req-e3945820-e6a7-422f-ac2d-e76ce56a820a req-c141226c-d7a3-4747-87e6-f04c53342865 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Received event network-vif-plugged-51834a6c-a2bb-4135-b3b3-beb4e689e876 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e3945820-e6a7-422f-ac2d-e76ce56a820a req-c141226c-d7a3-4747-87e6-f04c53342865 service nova] Acquiring lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e3945820-e6a7-422f-ac2d-e76ce56a820a req-c141226c-d7a3-4747-87e6-f04c53342865 service nova] Lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e3945820-e6a7-422f-ac2d-e76ce56a820a req-c141226c-d7a3-4747-87e6-f04c53342865 service nova] Lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:03 user nova-compute[74805]: DEBUG nova.compute.manager [req-e3945820-e6a7-422f-ac2d-e76ce56a820a req-c141226c-d7a3-4747-87e6-f04c53342865 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] No waiting events found dispatching network-vif-plugged-51834a6c-a2bb-4135-b3b3-beb4e689e876 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:15:03 user nova-compute[74805]: WARNING nova.compute.manager [req-e3945820-e6a7-422f-ac2d-e76ce56a820a req-c141226c-d7a3-4747-87e6-f04c53342865 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Received unexpected event network-vif-plugged-51834a6c-a2bb-4135-b3b3-beb4e689e876 for instance with vm_state active and task_state None.
Nov 15 04:15:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89dcacb0-6864-4529-903d-ae46a2dc3bdd/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89dcacb0-6864-4529-903d-ae46a2dc3bdd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89dcacb0-6864-4529-903d-ae46a2dc3bdd/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:04 user nova-compute[74805]: INFO nova.virt.block_device [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Booting with volume afd5bfde-5430-4032-b783-a72254443114 at /dev/vdc
Nov 15 04:15:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89dcacb0-6864-4529-903d-ae46a2dc3bdd/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:04 user nova-compute[74805]: DEBUG os_brick.utils [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:15:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:04 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[265bd77e-be3c-4e7a-825b-22d4a038ce69]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:04 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:15:04 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:15:04 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=7072MB free_disk=25.645957946777344GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:15:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:04 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5621224-d64d-4c34-aaf6-d785bbcae211]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:04 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[74af4085-7eee-45f7-ae68-587f976f2541]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:04 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[07882eb2-2adc-475e-90bf-9f0eac45699b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:15:04 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:15:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.network.neutron [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Updating instance_info_cache with network_info: [{"id": "8fb4ff06-71a7-4fe2-81b0-e4d980e75a23", "address": "fa:16:3e:4f:d9:b6", "network": {"id": "c9df097d-17ec-4bdd-aa5b-531b2f59c8e1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1457673667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb4ff06-71", "ovs_interfaceid": "8fb4ff06-71a7-4fe2-81b0-e4d980e75a23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2fd61de8-594b-4c85-957d-db3f622ffdc2", "address": "fa:16:3e:b6:83:57", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fd61de8-59", "ovs_interfaceid": "2fd61de8-594b-4c85-957d-db3f622ffdc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f5678db-1255-42ae-84ca-4d1b3b5dac84", "address": "fa:16:3e:60:3d:03", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f5678db-12", "ovs_interfaceid": "4f5678db-1255-42ae-84ca-4d1b3b5dac84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45598f97-ca9c-423f-bf8e-e7ce6aba0073", "address": "fa:16:3e:d0:dc:9e", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45598f97-ca", "ovs_interfaceid": "45598f97-ca9c-423f-bf8e-e7ce6aba0073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39f4ba29-3df3-4389-ae97-476675222a14", "address": "fa:16:3e:95:db:7d", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f4ba29-3d", "ovs_interfaceid": "39f4ba29-3df3-4389-ae97-476675222a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2cf28e2-46e0-450c-a153-23e6ef6da5f2", "address": "fa:16:3e:46:51:3c", "network": {"id": "da7f4cb9-5e5c-4598-a27b-94e6c59c582d", "bridge": "br-int", "label": "tempest-device-tagging-net2-610177095", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2cf28e2-46", "ovs_interfaceid": "c2cf28e2-46e0-450c-a153-23e6ef6da5f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "705a958d-3fb6-4fe9-ba7e-e69d242dde68", "address": "fa:16:3e:58:83:23", "network": {"id": "da7f4cb9-5e5c-4598-a27b-94e6c59c582d", "bridge": "br-int", "label": "tempest-device-tagging-net2-610177095", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705a958d-3f", "ovs_interfaceid": "705a958d-3fb6-4fe9-ba7e-e69d242dde68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:15:05 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:15:05 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d54154-f22e-4b7c-a731-c7b466082eee]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG os_brick.utils [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Updating existing volume attachment record: 5ad5e7cf-63d7-484e-9afd-b8b89af146d2 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Releasing lock "refresh_cache-e1a3273f-42d2-4582-b539-3c7c6111cf3c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.compute.manager [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Instance network_info: |[{"id": "8fb4ff06-71a7-4fe2-81b0-e4d980e75a23", "address": "fa:16:3e:4f:d9:b6", "network": {"id": "c9df097d-17ec-4bdd-aa5b-531b2f59c8e1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1457673667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb4ff06-71", "ovs_interfaceid": "8fb4ff06-71a7-4fe2-81b0-e4d980e75a23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2fd61de8-594b-4c85-957d-db3f622ffdc2", "address": "fa:16:3e:b6:83:57", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fd61de8-59", "ovs_interfaceid": "2fd61de8-594b-4c85-957d-db3f622ffdc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f5678db-1255-42ae-84ca-4d1b3b5dac84", "address": "fa:16:3e:60:3d:03", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f5678db-12", "ovs_interfaceid": "4f5678db-1255-42ae-84ca-4d1b3b5dac84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45598f97-ca9c-423f-bf8e-e7ce6aba0073", "address": "fa:16:3e:d0:dc:9e", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45598f97-ca", "ovs_interfaceid": "45598f97-ca9c-423f-bf8e-e7ce6aba0073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39f4ba29-3df3-4389-ae97-476675222a14", "address": "fa:16:3e:95:db:7d", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f4ba29-3d", "ovs_interfaceid": "39f4ba29-3df3-4389-ae97-476675222a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2cf28e2-46e0-450c-a153-23e6ef6da5f2", "address": "fa:16:3e:46:51:3c", "network": {"id": "da7f4cb9-5e5c-4598-a27b-94e6c59c582d", "bridge": "br-int", "label": "tempest-device-tagging-net2-610177095", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2cf28e2-46", "ovs_interfaceid": "c2cf28e2-46e0-450c-a153-23e6ef6da5f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "705a958d-3fb6-4fe9-ba7e-e69d242dde68", "address": "fa:16:3e:58:83:23", "network": {"id": "da7f4cb9-5e5c-4598-a27b-94e6c59c582d", "bridge": "br-int", "label": "tempest-device-tagging-net2-610177095", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705a958d-3f", "ovs_interfaceid": "705a958d-3fb6-4fe9-ba7e-e69d242dde68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2035a12d-9c10-4eed-8f9e-89ae58be7df0 req-0f56db8e-a05e-4fa8-b2cc-1408ed550ecb service nova] Acquired lock "refresh_cache-e1a3273f-42d2-4582-b539-3c7c6111cf3c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.network.neutron [req-2035a12d-9c10-4eed-8f9e-89ae58be7df0 req-0f56db8e-a05e-4fa8-b2cc-1408ed550ecb service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Refreshing network info cache for port c2cf28e2-46e0-450c-a153-23e6ef6da5f2 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 2b1e540c-6226-445a-bd45-5b7b8807e2b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 2921f743-66d5-47c1-b2e4-1b6957a2d550 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 1eb9b315-77a9-40f7-8a43-8c40186a0dca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 0de78a8a-d66a-4703-a044-89c2f2006860 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance d63f3726-27df-455f-bda0-3ddca95b70d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance e91a656c-66d6-4a70-a115-8c03ed964f94 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 05f49324-4b7a-4cd4-ada5-9450b9bf1d70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance fdf3e90f-4fd8-4da4-a888-48c7a80fb209 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 89dcacb0-6864-4529-903d-ae46a2dc3bdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance e1a3273f-42d2-4582-b539-3c7c6111cf3c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.network.neutron [req-2035a12d-9c10-4eed-8f9e-89ae58be7df0 req-0f56db8e-a05e-4fa8-b2cc-1408ed550ecb service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Updated VIF entry in instance network info cache for port c2cf28e2-46e0-450c-a153-23e6ef6da5f2. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.network.neutron [req-2035a12d-9c10-4eed-8f9e-89ae58be7df0 req-0f56db8e-a05e-4fa8-b2cc-1408ed550ecb service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Updating instance_info_cache with network_info: [{"id": "8fb4ff06-71a7-4fe2-81b0-e4d980e75a23", "address": "fa:16:3e:4f:d9:b6", "network": {"id": "c9df097d-17ec-4bdd-aa5b-531b2f59c8e1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1457673667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb4ff06-71", "ovs_interfaceid": "8fb4ff06-71a7-4fe2-81b0-e4d980e75a23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2fd61de8-594b-4c85-957d-db3f622ffdc2", "address": "fa:16:3e:b6:83:57", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fd61de8-59", "ovs_interfaceid": "2fd61de8-594b-4c85-957d-db3f622ffdc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f5678db-1255-42ae-84ca-4d1b3b5dac84", "address": "fa:16:3e:60:3d:03", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f5678db-12", "ovs_interfaceid": "4f5678db-1255-42ae-84ca-4d1b3b5dac84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45598f97-ca9c-423f-bf8e-e7ce6aba0073", "address": "fa:16:3e:d0:dc:9e", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45598f97-ca", "ovs_interfaceid": "45598f97-ca9c-423f-bf8e-e7ce6aba0073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39f4ba29-3df3-4389-ae97-476675222a14", "address": "fa:16:3e:95:db:7d", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f4ba29-3d", "ovs_interfaceid": "39f4ba29-3df3-4389-ae97-476675222a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2cf28e2-46e0-450c-a153-23e6ef6da5f2", "address": "fa:16:3e:46:51:3c", "network": {"id": "da7f4cb9-5e5c-4598-a27b-94e6c59c582d", "bridge": "br-int", "label": "tempest-device-tagging-net2-610177095", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2cf28e2-46", "ovs_interfaceid": "c2cf28e2-46e0-450c-a153-23e6ef6da5f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "705a958d-3fb6-4fe9-ba7e-e69d242dde68", "address": "fa:16:3e:58:83:23", "network": {"id": "da7f4cb9-5e5c-4598-a27b-94e6c59c582d", "bridge": "br-int", "label": "tempest-device-tagging-net2-610177095", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705a958d-3f", "ovs_interfaceid": "705a958d-3fb6-4fe9-ba7e-e69d242dde68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2035a12d-9c10-4eed-8f9e-89ae58be7df0 req-0f56db8e-a05e-4fa8-b2cc-1408ed550ecb service nova] Releasing lock "refresh_cache-e1a3273f-42d2-4582-b539-3c7c6111cf3c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.compute.manager [req-2035a12d-9c10-4eed-8f9e-89ae58be7df0 req-0f56db8e-a05e-4fa8-b2cc-1408ed550ecb service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-changed-705a958d-3fb6-4fe9-ba7e-e69d242dde68 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.compute.manager [req-2035a12d-9c10-4eed-8f9e-89ae58be7df0 req-0f56db8e-a05e-4fa8-b2cc-1408ed550ecb service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Refreshing instance network info cache due to event network-changed-705a958d-3fb6-4fe9-ba7e-e69d242dde68. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2035a12d-9c10-4eed-8f9e-89ae58be7df0 req-0f56db8e-a05e-4fa8-b2cc-1408ed550ecb service nova] Acquiring lock "refresh_cache-e1a3273f-42d2-4582-b539-3c7c6111cf3c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2035a12d-9c10-4eed-8f9e-89ae58be7df0 req-0f56db8e-a05e-4fa8-b2cc-1408ed550ecb service nova] Acquired lock "refresh_cache-e1a3273f-42d2-4582-b539-3c7c6111cf3c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.network.neutron [req-2035a12d-9c10-4eed-8f9e-89ae58be7df0 req-0f56db8e-a05e-4fa8-b2cc-1408ed550ecb service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Refreshing network info cache for port 705a958d-3fb6-4fe9-ba7e-e69d242dde68 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.compute.manager [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Received event network-vif-plugged-51834a6c-a2bb-4135-b3b3-beb4e689e876 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] Acquiring lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] Lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] Lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.compute.manager [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] No waiting events found dispatching network-vif-plugged-51834a6c-a2bb-4135-b3b3-beb4e689e876 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:15:05 user nova-compute[74805]: WARNING nova.compute.manager [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Received unexpected event network-vif-plugged-51834a6c-a2bb-4135-b3b3-beb4e689e876 for instance with vm_state active and task_state None.
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.compute.manager [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Received event network-vif-plugged-8008b41a-f1bc-4a16-b839-17f69eea93e5 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] Acquiring lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] Lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] Lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.compute.manager [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] No waiting events found dispatching network-vif-plugged-8008b41a-f1bc-4a16-b839-17f69eea93e5 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:15:05 user nova-compute[74805]: WARNING nova.compute.manager [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Received unexpected event network-vif-plugged-8008b41a-f1bc-4a16-b839-17f69eea93e5 for instance with vm_state active and task_state None.
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.compute.manager [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Received event network-vif-plugged-8008b41a-f1bc-4a16-b839-17f69eea93e5 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] Acquiring lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] Lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] Lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.compute.manager [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] No waiting events found dispatching network-vif-plugged-8008b41a-f1bc-4a16-b839-17f69eea93e5 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:15:05 user nova-compute[74805]: WARNING nova.compute.manager [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Received unexpected event network-vif-plugged-8008b41a-f1bc-4a16-b839-17f69eea93e5 for instance with vm_state active and task_state None.
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.compute.manager [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Received event network-vif-plugged-78ef9969-b62c-4730-8bbf-e5a8d2c75010 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] Acquiring lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] Lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] Lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.compute.manager [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] No waiting events found dispatching network-vif-plugged-78ef9969-b62c-4730-8bbf-e5a8d2c75010 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:15:05 user nova-compute[74805]: WARNING nova.compute.manager [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Received unexpected event network-vif-plugged-78ef9969-b62c-4730-8bbf-e5a8d2c75010 for instance with vm_state active and task_state None.
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.compute.manager [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Received event network-vif-plugged-78ef9969-b62c-4730-8bbf-e5a8d2c75010 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] Acquiring lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] Lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] Lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.compute.manager [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] No waiting events found dispatching network-vif-plugged-78ef9969-b62c-4730-8bbf-e5a8d2c75010 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:15:05 user nova-compute[74805]: WARNING nova.compute.manager [req-6ab726b2-22ff-4c27-8a38-085929bdc541 req-90282f9f-5d7a-4ab2-b8ac-e1ebb8516efe service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Received unexpected event network-vif-plugged-78ef9969-b62c-4730-8bbf-e5a8d2c75010 for instance with vm_state active and task_state None.
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.network.neutron [req-2035a12d-9c10-4eed-8f9e-89ae58be7df0 req-0f56db8e-a05e-4fa8-b2cc-1408ed550ecb service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Updated VIF entry in instance network info cache for port 705a958d-3fb6-4fe9-ba7e-e69d242dde68. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG nova.network.neutron [req-2035a12d-9c10-4eed-8f9e-89ae58be7df0 req-0f56db8e-a05e-4fa8-b2cc-1408ed550ecb service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Updating instance_info_cache with network_info: [{"id": "8fb4ff06-71a7-4fe2-81b0-e4d980e75a23", "address": "fa:16:3e:4f:d9:b6", "network": {"id": "c9df097d-17ec-4bdd-aa5b-531b2f59c8e1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1457673667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb4ff06-71", "ovs_interfaceid": "8fb4ff06-71a7-4fe2-81b0-e4d980e75a23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2fd61de8-594b-4c85-957d-db3f622ffdc2", "address": "fa:16:3e:b6:83:57", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fd61de8-59", "ovs_interfaceid": "2fd61de8-594b-4c85-957d-db3f622ffdc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f5678db-1255-42ae-84ca-4d1b3b5dac84", "address": "fa:16:3e:60:3d:03", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f5678db-12", "ovs_interfaceid": "4f5678db-1255-42ae-84ca-4d1b3b5dac84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45598f97-ca9c-423f-bf8e-e7ce6aba0073", "address": "fa:16:3e:d0:dc:9e", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45598f97-ca", "ovs_interfaceid": "45598f97-ca9c-423f-bf8e-e7ce6aba0073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39f4ba29-3df3-4389-ae97-476675222a14", "address": "fa:16:3e:95:db:7d", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f4ba29-3d", "ovs_interfaceid": "39f4ba29-3df3-4389-ae97-476675222a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2cf28e2-46e0-450c-a153-23e6ef6da5f2", "address": "fa:16:3e:46:51:3c", "network": {"id": "da7f4cb9-5e5c-4598-a27b-94e6c59c582d", "bridge": "br-int", "label": "tempest-device-tagging-net2-610177095", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2cf28e2-46", "ovs_interfaceid": "c2cf28e2-46e0-450c-a153-23e6ef6da5f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "705a958d-3fb6-4fe9-ba7e-e69d242dde68", "address": "fa:16:3e:58:83:23", "network": {"id": "da7f4cb9-5e5c-4598-a27b-94e6c59c582d", "bridge": "br-int", "label": "tempest-device-tagging-net2-610177095", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705a958d-3f", "ovs_interfaceid": "705a958d-3fb6-4fe9-ba7e-e69d242dde68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:15:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2035a12d-9c10-4eed-8f9e-89ae58be7df0 req-0f56db8e-a05e-4fa8-b2cc-1408ed550ecb service nova] Releasing lock "refresh_cache-e1a3273f-42d2-4582-b539-3c7c6111cf3c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:15:06 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:15:06 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:15:06 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:15:06 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Rebuilding the list of instances to heal {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 04:15:06 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Skipping network cache update for instance because it is Building. {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 04:15:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-2b1e540c-6226-445a-bd45-5b7b8807e2b9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:15:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-2b1e540c-6226-445a-bd45-5b7b8807e2b9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:15:06 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:15:06 user nova-compute[74805]: DEBUG nova.objects.instance [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lazy-loading 'info_cache' on Instance uuid 2b1e540c-6226-445a-bd45-5b7b8807e2b9 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:15:07 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Updating instance_info_cache with network_info: [{"id": "29f069d7-6837-470c-a8b7-5cb6225bba4e", "address": "fa:16:3e:d3:55:85", "network": {"id": "d6c12b22-58d0-4d38-aa41-0e08de44bb3a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1369824742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dc7dbc597f4befb565dcff5a92db74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f069d7-68", "ovs_interfaceid": "29f069d7-6837-470c-a8b7-5cb6225bba4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:15:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-2b1e540c-6226-445a-bd45-5b7b8807e2b9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:15:07 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:15:07 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:15:07 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:15:07 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:15:07 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:15:07 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:15:07 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:15:07 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:15:09 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG nova.compute.manager [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:15:10 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Creating image(s)
Nov 15 04:15:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Did not create local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Ensure instance console log exists: /opt/stack/data/nova/instances/e1a3273f-42d2-4582-b539-3c7c6111cf3c/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Start _get_guest_xml network_info=[{"id": "8fb4ff06-71a7-4fe2-81b0-e4d980e75a23", "address": "fa:16:3e:4f:d9:b6", "network": {"id": "c9df097d-17ec-4bdd-aa5b-531b2f59c8e1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1457673667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb4ff06-71", "ovs_interfaceid": "8fb4ff06-71a7-4fe2-81b0-e4d980e75a23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2fd61de8-594b-4c85-957d-db3f622ffdc2", "address": "fa:16:3e:b6:83:57", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fd61de8-59", "ovs_interfaceid": "2fd61de8-594b-4c85-957d-db3f622ffdc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f5678db-1255-42ae-84ca-4d1b3b5dac84", "address": "fa:16:3e:60:3d:03", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f5678db-12", "ovs_interfaceid": "4f5678db-1255-42ae-84ca-4d1b3b5dac84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45598f97-ca9c-423f-bf8e-e7ce6aba0073", "address": "fa:16:3e:d0:dc:9e", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45598f97-ca", "ovs_interfaceid": "45598f97-ca9c-423f-bf8e-e7ce6aba0073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39f4ba29-3df3-4389-ae97-476675222a14", "address": "fa:16:3e:95:db:7d", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f4ba29-3d", "ovs_interfaceid": "39f4ba29-3df3-4389-ae97-476675222a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2cf28e2-46e0-450c-a153-23e6ef6da5f2", "address": "fa:16:3e:46:51:3c", "network": {"id": "da7f4cb9-5e5c-4598-a27b-94e6c59c582d", "bridge": "br-int", "label": "tempest-device-tagging-net2-610177095", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2cf28e2-46", "ovs_interfaceid": "c2cf28e2-46e0-450c-a153-23e6ef6da5f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "705a958d-3fb6-4fe9-ba7e-e69d242dde68", "address": "fa:16:3e:58:83:23", "network": {"id": "da7f4cb9-5e5c-4598-a27b-94e6c59c582d", "bridge": "br-int", "label": "tempest-device-tagging-net2-610177095", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705a958d-3f", "ovs_interfaceid": "705a958d-3fb6-4fe9-ba7e-e69d242dde68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfiQBoCg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e1a3273f-42d2-4582-b539-3c7c6111cf3c', 'attached_at': '', 'detached_at': '', 'volume_id': '5c533429-7f55-4f56-a45f-e02c2f0dd651', 'serial': '5c533429-7f55-4f56-a45f-e02c2f0dd651'}, 'delete_on_termination': False, 'attachment_id': '75d9e76e-d16f-402a-824e-f3cb9f036bd6', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'REamgAJt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e1a3273f-42d2-4582-b539-3c7c6111cf3c', 'attached_at': '', 'detached_at': '', 'volume_id': '38401583-d453-48d5-b5c6-9b7bddfc9730', 'serial': '38401583-d453-48d5-b5c6-9b7bddfc9730'}, 'delete_on_termination': False, 'attachment_id': 'b99ed960-195d-420e-b535-2e77c7f39688', 'guest_format': None, 'device_type': 'disk', 'boot_index': 1, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cMIbZFjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e1a3273f-42d2-4582-b539-3c7c6111cf3c', 'attached_at': '', 'detached_at': '', 'volume_id': 'afd5bfde-5430-4032-b783-a72254443114', 'serial': 'afd5bfde-5430-4032-b783-a72254443114'}, 'delete_on_termination': False, 'attachment_id': '5ad5e7cf-63d7-484e-9afd-b8b89af146d2', 'guest_format': None, 'device_type': 'disk', 'boot_index': 2, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:15:10 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:15:10 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:15:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfiQBoCg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:15:10 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:15:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:15:10 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:15:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:15:10 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a3da1b-ae9e-425f-a72c-fe0c9283a84c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:15:10 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[498e8f70-67c8-4ffe-93ba-7265af24abfc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651] added
Nov 15 04:15:10 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c3ce8a-255c-48b3-9c43-e66e0f7adf7c]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a648e3-7cbe-480b-ae1b-5151fca4a9aa]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yfiQBoCg {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yfiQBoCg" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb8dd27-5735-44f2-8e10-fca8b1863e40]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yfiQBoCg'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d1faf8-c552-4bd7-8a81-8be331f213f6]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b467166f-ef4c-4819-b317-a3d03ba4d902]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:15:10 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:15:10 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0eb209-46c2-4271-a746-6512c6f593f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651, portal: 172.16.0.220,3260]
Nov 15 04:15:10 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651, portal: 172.16.0.220,3260] successful.
Nov 15 04:15:10 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a096ea8d-9a7d-48e0-8796-6eba86c31295]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7460fd84-2092-4ea1-bc0a-8f4fe81046a2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:15:10 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:15:10 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:15:10 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:15:10 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a3741e-0a68-4a54-89c9-113805337028]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:15:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfiQBoCg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26430663534383763', 'path': '/dev/sdc'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430663534383763', 'path': '/dev/sdc'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'REamgAJt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:15:11 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:15:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:15:11 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:15:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:15:11 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5306c307-9fd1-4244-bd48-ed4108855e74]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:15:11 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b5b882-7085-4e47-a953-d3c149e19398]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730] added
Nov 15 04:15:11 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0f703d-4382-445a-8678-acabd80fd298]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc04260-4408-4c0d-8296-70b808f3b1f2]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v REamgAJt {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v REamgAJt" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c78bb0-1452-4b69-80d2-6ffd0c39d6aa]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'REamgAJt'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db432ee-2777-425a-824a-8c296b9d58b8]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b304fb-4843-45bd-ae5e-59ce39b75004]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:15:11 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:15:11 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:15:11 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:15:11 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b92b21-cbe6-4894-a45e-093818670f4f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730, portal: 172.16.0.220,3260]
Nov 15 04:15:11 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730, portal: 172.16.0.220,3260] successful.
Nov 15 04:15:11 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef8da1a-e741-470e-a164-fb87d26e2c33]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6923a6f6-e140-455b-86fc-d7daed70df5d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:15:11 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:15:11 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:15:11 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:15:11 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:15:11 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:15:11 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c7a5db-2c91-4863-902e-504161cda8fb]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:15:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'REamgAJt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:15:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:15:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23636306530383335', 'path': '/dev/sdd'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:15:12 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636306530383335', 'path': '/dev/sdd'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:15:12 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:15:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cMIbZFjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:15:12 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:15:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:15:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:15:12 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:15:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:15:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:15:12 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:15:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:12 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bd6667-9f4d-40bb-a37a-14f890547b46]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:15:12 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:15:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:12 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c6a7bc-d036-4295-a71e-605e34785182]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114] added
Nov 15 04:15:12 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:15:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1150844-cc2f-4d9d-918a-36838334880d]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af6e486-37b0-4061-91c2-4ef1a8688390]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cMIbZFjY {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cMIbZFjY" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdd5c5e-9cdc-47c7-a977-46f806560bca]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cMIbZFjY'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e8fd83-754d-4b6c-96da-017d849e78a6]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8220e094-091c-4f53-80ab-df5a54e435eb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:15:13 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:15:13 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:15:13 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:15:13 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:15:13 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:15:13 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0005dce-7da8-4eb6-8da3-2dbeb7a52e26]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114, portal: 172.16.0.220,3260]
Nov 15 04:15:13 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114, portal: 172.16.0.220,3260] successful.
Nov 15 04:15:13 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f3ca9c-cefd-49f8-8683-dc3544b3eb8c]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1b7e5f-7d76-4ede-bcb9-2a83668ba6e2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:15:13 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:15:13 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:15:13 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:15:13 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:15:13 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:15:13 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:15:13 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:15:13 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce037bf-453f-4c42-801e-bbabfcf0fb3f]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:15:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cMIbZFjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26139396664653163', 'path': '/dev/sde'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139396664653163', 'path': '/dev/sde'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209991627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209991627',id=11,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL2p+ejOi8AQ04hPhdzGD7OzJ/dixq8QFeSc5qrTwC3wpMDZ0/iY+E0x5r4vEKcyTBCdkRv6GOAto/wSL59XHp3RSRI0zh0xWba9e42A7dyuK3bVVrQh2BApcmYL2JgNQ==',key_name='tempest-keypair-902492598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47b57aff3d714da1a9872ecec24524ae',ramdisk_id='',reservation_id='r-len0vorx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105776980',owner_user_name='tempest-TaggedBootDevicesTest-1105776980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52d077ca42b442e9913fc83e1cc73436',uuid=e1a3273f-42d2-4582-b539-3c7c6111cf3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fb4ff06-71a7-4fe2-81b0-e4d980e75a23", "address": "fa:16:3e:4f:d9:b6", "network": {"id": "c9df097d-17ec-4bdd-aa5b-531b2f59c8e1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1457673667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb4ff06-71", "ovs_interfaceid": "8fb4ff06-71a7-4fe2-81b0-e4d980e75a23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converting VIF {"id": "8fb4ff06-71a7-4fe2-81b0-e4d980e75a23", "address": "fa:16:3e:4f:d9:b6", "network": {"id": "c9df097d-17ec-4bdd-aa5b-531b2f59c8e1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1457673667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb4ff06-71", "ovs_interfaceid": "8fb4ff06-71a7-4fe2-81b0-e4d980e75a23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:d9:b6,bridge_name='br-int',has_traffic_filtering=True,id=8fb4ff06-71a7-4fe2-81b0-e4d980e75a23,network=Network(c9df097d-17ec-4bdd-aa5b-531b2f59c8e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fb4ff06-71') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209991627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209991627',id=11,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL2p+ejOi8AQ04hPhdzGD7OzJ/dixq8QFeSc5qrTwC3wpMDZ0/iY+E0x5r4vEKcyTBCdkRv6GOAto/wSL59XHp3RSRI0zh0xWba9e42A7dyuK3bVVrQh2BApcmYL2JgNQ==',key_name='tempest-keypair-902492598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47b57aff3d714da1a9872ecec24524ae',ramdisk_id='',reservation_id='r-len0vorx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105776980',owner_user_name='tempest-TaggedBootDevicesTest-1105776980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52d077ca42b442e9913fc83e1cc73436',uuid=e1a3273f-42d2-4582-b539-3c7c6111cf3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2fd61de8-594b-4c85-957d-db3f622ffdc2", "address": "fa:16:3e:b6:83:57", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fd61de8-59", "ovs_interfaceid": "2fd61de8-594b-4c85-957d-db3f622ffdc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converting VIF {"id": "2fd61de8-594b-4c85-957d-db3f622ffdc2", "address": "fa:16:3e:b6:83:57", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fd61de8-59", "ovs_interfaceid": "2fd61de8-594b-4c85-957d-db3f622ffdc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:83:57,bridge_name='br-int',has_traffic_filtering=True,id=2fd61de8-594b-4c85-957d-db3f622ffdc2,network=Network(6d4c82b5-fae6-47b6-a546-2146dc5391c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2fd61de8-59') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209991627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209991627',id=11,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL2p+ejOi8AQ04hPhdzGD7OzJ/dixq8QFeSc5qrTwC3wpMDZ0/iY+E0x5r4vEKcyTBCdkRv6GOAto/wSL59XHp3RSRI0zh0xWba9e42A7dyuK3bVVrQh2BApcmYL2JgNQ==',key_name='tempest-keypair-902492598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47b57aff3d714da1a9872ecec24524ae',ramdisk_id='',reservation_id='r-len0vorx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105776980',owner_user_name='tempest-TaggedBootDevicesTest-1105776980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52d077ca42b442e9913fc83e1cc73436',uuid=e1a3273f-42d2-4582-b539-3c7c6111cf3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f5678db-1255-42ae-84ca-4d1b3b5dac84", "address": "fa:16:3e:60:3d:03", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f5678db-12", "ovs_interfaceid": "4f5678db-1255-42ae-84ca-4d1b3b5dac84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converting VIF {"id": "4f5678db-1255-42ae-84ca-4d1b3b5dac84", "address": "fa:16:3e:60:3d:03", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f5678db-12", "ovs_interfaceid": "4f5678db-1255-42ae-84ca-4d1b3b5dac84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:3d:03,bridge_name='br-int',has_traffic_filtering=True,id=4f5678db-1255-42ae-84ca-4d1b3b5dac84,network=Network(6d4c82b5-fae6-47b6-a546-2146dc5391c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4f5678db-12') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209991627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209991627',id=11,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL2p+ejOi8AQ04hPhdzGD7OzJ/dixq8QFeSc5qrTwC3wpMDZ0/iY+E0x5r4vEKcyTBCdkRv6GOAto/wSL59XHp3RSRI0zh0xWba9e42A7dyuK3bVVrQh2BApcmYL2JgNQ==',key_name='tempest-keypair-902492598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47b57aff3d714da1a9872ecec24524ae',ramdisk_id='',reservation_id='r-len0vorx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105776980',owner_user_name='tempest-TaggedBootDevicesTest-1105776980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52d077ca42b442e9913fc83e1cc73436',uuid=e1a3273f-42d2-4582-b539-3c7c6111cf3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45598f97-ca9c-423f-bf8e-e7ce6aba0073", "address": "fa:16:3e:d0:dc:9e", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45598f97-ca", "ovs_interfaceid": "45598f97-ca9c-423f-bf8e-e7ce6aba0073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converting VIF {"id": "45598f97-ca9c-423f-bf8e-e7ce6aba0073", "address": "fa:16:3e:d0:dc:9e", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45598f97-ca", "ovs_interfaceid": "45598f97-ca9c-423f-bf8e-e7ce6aba0073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:dc:9e,bridge_name='br-int',has_traffic_filtering=True,id=45598f97-ca9c-423f-bf8e-e7ce6aba0073,network=Network(6d4c82b5-fae6-47b6-a546-2146dc5391c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45598f97-ca') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209991627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209991627',id=11,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL2p+ejOi8AQ04hPhdzGD7OzJ/dixq8QFeSc5qrTwC3wpMDZ0/iY+E0x5r4vEKcyTBCdkRv6GOAto/wSL59XHp3RSRI0zh0xWba9e42A7dyuK3bVVrQh2BApcmYL2JgNQ==',key_name='tempest-keypair-902492598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47b57aff3d714da1a9872ecec24524ae',ramdisk_id='',reservation_id='r-len0vorx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105776980',owner_user_name='tempest-TaggedBootDevicesTest-1105776980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52d077ca42b442e9913fc83e1cc73436',uuid=e1a3273f-42d2-4582-b539-3c7c6111cf3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39f4ba29-3df3-4389-ae97-476675222a14", "address": "fa:16:3e:95:db:7d", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f4ba29-3d", "ovs_interfaceid": "39f4ba29-3df3-4389-ae97-476675222a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converting VIF {"id": "39f4ba29-3df3-4389-ae97-476675222a14", "address": "fa:16:3e:95:db:7d", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f4ba29-3d", "ovs_interfaceid": "39f4ba29-3df3-4389-ae97-476675222a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:db:7d,bridge_name='br-int',has_traffic_filtering=True,id=39f4ba29-3df3-4389-ae97-476675222a14,network=Network(6d4c82b5-fae6-47b6-a546-2146dc5391c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f4ba29-3d') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209991627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209991627',id=11,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL2p+ejOi8AQ04hPhdzGD7OzJ/dixq8QFeSc5qrTwC3wpMDZ0/iY+E0x5r4vEKcyTBCdkRv6GOAto/wSL59XHp3RSRI0zh0xWba9e42A7dyuK3bVVrQh2BApcmYL2JgNQ==',key_name='tempest-keypair-902492598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47b57aff3d714da1a9872ecec24524ae',ramdisk_id='',reservation_id='r-len0vorx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105776980',owner_user_name='tempest-TaggedBootDevicesTest-1105776980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52d077ca42b442e9913fc83e1cc73436',uuid=e1a3273f-42d2-4582-b539-3c7c6111cf3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2cf28e2-46e0-450c-a153-23e6ef6da5f2", "address": "fa:16:3e:46:51:3c", "network": {"id": "da7f4cb9-5e5c-4598-a27b-94e6c59c582d", "bridge": "br-int", "label": "tempest-device-tagging-net2-610177095", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2cf28e2-46", "ovs_interfaceid": "c2cf28e2-46e0-450c-a153-23e6ef6da5f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converting VIF {"id": "c2cf28e2-46e0-450c-a153-23e6ef6da5f2", "address": "fa:16:3e:46:51:3c", "network": {"id": "da7f4cb9-5e5c-4598-a27b-94e6c59c582d", "bridge": "br-int", "label": "tempest-device-tagging-net2-610177095", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2cf28e2-46", "ovs_interfaceid": "c2cf28e2-46e0-450c-a153-23e6ef6da5f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:51:3c,bridge_name='br-int',has_traffic_filtering=True,id=c2cf28e2-46e0-450c-a153-23e6ef6da5f2,network=Network(da7f4cb9-5e5c-4598-a27b-94e6c59c582d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2cf28e2-46') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209991627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209991627',id=11,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL2p+ejOi8AQ04hPhdzGD7OzJ/dixq8QFeSc5qrTwC3wpMDZ0/iY+E0x5r4vEKcyTBCdkRv6GOAto/wSL59XHp3RSRI0zh0xWba9e42A7dyuK3bVVrQh2BApcmYL2JgNQ==',key_name='tempest-keypair-902492598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47b57aff3d714da1a9872ecec24524ae',ramdisk_id='',reservation_id='r-len0vorx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105776980',owner_user_name='tempest-TaggedBootDevicesTest-1105776980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52d077ca42b442e9913fc83e1cc73436',uuid=e1a3273f-42d2-4582-b539-3c7c6111cf3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "705a958d-3fb6-4fe9-ba7e-e69d242dde68", "address": "fa:16:3e:58:83:23", "network": {"id": "da7f4cb9-5e5c-4598-a27b-94e6c59c582d", "bridge": "br-int", "label": "tempest-device-tagging-net2-610177095", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705a958d-3f", "ovs_interfaceid": "705a958d-3fb6-4fe9-ba7e-e69d242dde68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converting VIF {"id": "705a958d-3fb6-4fe9-ba7e-e69d242dde68", "address": "fa:16:3e:58:83:23", "network": {"id": "da7f4cb9-5e5c-4598-a27b-94e6c59c582d", "bridge": "br-int", "label": "tempest-device-tagging-net2-610177095", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705a958d-3f", "ovs_interfaceid": "705a958d-3fb6-4fe9-ba7e-e69d242dde68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:83:23,bridge_name='br-int',has_traffic_filtering=True,id=705a958d-3fb6-4fe9-ba7e-e69d242dde68,network=Network(da7f4cb9-5e5c-4598-a27b-94e6c59c582d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap705a958d-3f') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.objects.instance [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lazy-loading 'pci_devices' on Instance uuid e1a3273f-42d2-4582-b539-3c7c6111cf3c {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:15:14 user nova-compute[74805]:   <uuid>e1a3273f-42d2-4582-b539-3c7c6111cf3c</uuid>
Nov 15 04:15:14 user nova-compute[74805]:   <name>instance-0000000b</name>
Nov 15 04:15:14 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:15:14 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:15:14 user nova-compute[74805]:   <metadata>
Nov 15 04:15:14 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:15:14 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:15:14 user nova-compute[74805]:       <nova:name>tempest-device-tagging-server-1209991627</nova:name>
Nov 15 04:15:14 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:15:10</nova:creationTime>
Nov 15 04:15:14 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:15:14 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:15:14 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:15:14 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:15:14 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:15:14 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:15:14 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:15:14 user nova-compute[74805]:       <nova:owner>
Nov 15 04:15:14 user nova-compute[74805]:         <nova:user uuid="52d077ca42b442e9913fc83e1cc73436">tempest-TaggedBootDevicesTest-1105776980-project-member</nova:user>
Nov 15 04:15:14 user nova-compute[74805]:         <nova:project uuid="47b57aff3d714da1a9872ecec24524ae">tempest-TaggedBootDevicesTest-1105776980</nova:project>
Nov 15 04:15:14 user nova-compute[74805]:       </nova:owner>
Nov 15 04:15:14 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:15:14 user nova-compute[74805]:       <nova:ports>
Nov 15 04:15:14 user nova-compute[74805]:         <nova:port uuid="8fb4ff06-71a7-4fe2-81b0-e4d980e75a23">
Nov 15 04:15:14 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 04:15:14 user nova-compute[74805]:         </nova:port>
Nov 15 04:15:14 user nova-compute[74805]:         <nova:port uuid="2fd61de8-594b-4c85-957d-db3f622ffdc2">
Nov 15 04:15:14 user nova-compute[74805]:           <nova:ip type="fixed" address="10.1.1.233" ipVersion="4"/>
Nov 15 04:15:14 user nova-compute[74805]:         </nova:port>
Nov 15 04:15:14 user nova-compute[74805]:         <nova:port uuid="4f5678db-1255-42ae-84ca-4d1b3b5dac84">
Nov 15 04:15:14 user nova-compute[74805]:           <nova:ip type="fixed" address="10.1.1.167" ipVersion="4"/>
Nov 15 04:15:14 user nova-compute[74805]:         </nova:port>
Nov 15 04:15:14 user nova-compute[74805]:         <nova:port uuid="45598f97-ca9c-423f-bf8e-e7ce6aba0073">
Nov 15 04:15:14 user nova-compute[74805]:           <nova:ip type="fixed" address="10.1.1.71" ipVersion="4"/>
Nov 15 04:15:14 user nova-compute[74805]:         </nova:port>
Nov 15 04:15:14 user nova-compute[74805]:         <nova:port uuid="39f4ba29-3df3-4389-ae97-476675222a14">
Nov 15 04:15:14 user nova-compute[74805]:           <nova:ip type="fixed" address="10.1.1.101" ipVersion="4"/>
Nov 15 04:15:14 user nova-compute[74805]:         </nova:port>
Nov 15 04:15:14 user nova-compute[74805]:         <nova:port uuid="c2cf28e2-46e0-450c-a153-23e6ef6da5f2">
Nov 15 04:15:14 user nova-compute[74805]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 15 04:15:14 user nova-compute[74805]:         </nova:port>
Nov 15 04:15:14 user nova-compute[74805]:         <nova:port uuid="705a958d-3fb6-4fe9-ba7e-e69d242dde68">
Nov 15 04:15:14 user nova-compute[74805]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 15 04:15:14 user nova-compute[74805]:         </nova:port>
Nov 15 04:15:14 user nova-compute[74805]:       </nova:ports>
Nov 15 04:15:14 user nova-compute[74805]:     </nova:instance>
Nov 15 04:15:14 user nova-compute[74805]:   </metadata>
Nov 15 04:15:14 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:15:14 user nova-compute[74805]:     <system>
Nov 15 04:15:14 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:15:14 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:15:14 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:15:14 user nova-compute[74805]:       <entry name="serial">e1a3273f-42d2-4582-b539-3c7c6111cf3c</entry>
Nov 15 04:15:14 user nova-compute[74805]:       <entry name="uuid">e1a3273f-42d2-4582-b539-3c7c6111cf3c</entry>
Nov 15 04:15:14 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:15:14 user nova-compute[74805]:     </system>
Nov 15 04:15:14 user nova-compute[74805]:   </sysinfo>
Nov 15 04:15:14 user nova-compute[74805]:   <os>
Nov 15 04:15:14 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:15:14 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:15:14 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:15:14 user nova-compute[74805]:   </os>
Nov 15 04:15:14 user nova-compute[74805]:   <features>
Nov 15 04:15:14 user nova-compute[74805]:     <acpi/>
Nov 15 04:15:14 user nova-compute[74805]:     <apic/>
Nov 15 04:15:14 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:15:14 user nova-compute[74805]:   </features>
Nov 15 04:15:14 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:15:14 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:15:14 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:15:14 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:15:14 user nova-compute[74805]:   </clock>
Nov 15 04:15:14 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:15:14 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:15:14 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:15:14 user nova-compute[74805]:   </cpu>
Nov 15 04:15:14 user nova-compute[74805]:   <devices>
Nov 15 04:15:14 user nova-compute[74805]:     <disk type="file" device="cdrom">
Nov 15 04:15:14 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 04:15:14 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/e1a3273f-42d2-4582-b539-3c7c6111cf3c/disk.config"/>
Nov 15 04:15:14 user nova-compute[74805]:       <target dev="hda" bus="ide"/>
Nov 15 04:15:14 user nova-compute[74805]:     </disk>
Nov 15 04:15:14 user nova-compute[74805]:     <disk type="block" device="disk">
Nov 15 04:15:14 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:15:14 user nova-compute[74805]:       <source dev="/dev/sdc"/>
Nov 15 04:15:14 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:15:14 user nova-compute[74805]:       <serial>5c533429-7f55-4f56-a45f-e02c2f0dd651</serial>
Nov 15 04:15:14 user nova-compute[74805]:     </disk>
Nov 15 04:15:14 user nova-compute[74805]:     <disk type="block" device="disk">
Nov 15 04:15:14 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:15:14 user nova-compute[74805]:       <source dev="/dev/sdd"/>
Nov 15 04:15:14 user nova-compute[74805]:       <target dev="vdb" bus="virtio"/>
Nov 15 04:15:14 user nova-compute[74805]:       <serial>38401583-d453-48d5-b5c6-9b7bddfc9730</serial>
Nov 15 04:15:14 user nova-compute[74805]:     </disk>
Nov 15 04:15:14 user nova-compute[74805]:     <disk type="block" device="disk">
Nov 15 04:15:14 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:15:14 user nova-compute[74805]:       <source dev="/dev/sde"/>
Nov 15 04:15:14 user nova-compute[74805]:       <target dev="vdc" bus="virtio"/>
Nov 15 04:15:14 user nova-compute[74805]:       <serial>afd5bfde-5430-4032-b783-a72254443114</serial>
Nov 15 04:15:14 user nova-compute[74805]:     </disk>
Nov 15 04:15:14 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:15:14 user nova-compute[74805]:       <mac address="fa:16:3e:4f:d9:b6"/>
Nov 15 04:15:14 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:15:14 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:15:14 user nova-compute[74805]:       <target dev="tap8fb4ff06-71"/>
Nov 15 04:15:14 user nova-compute[74805]:     </interface>
Nov 15 04:15:14 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:15:14 user nova-compute[74805]:       <mac address="fa:16:3e:b6:83:57"/>
Nov 15 04:15:14 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:15:14 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:15:14 user nova-compute[74805]:       <target dev="tap2fd61de8-59"/>
Nov 15 04:15:14 user nova-compute[74805]:     </interface>
Nov 15 04:15:14 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:15:14 user nova-compute[74805]:       <mac address="fa:16:3e:60:3d:03"/>
Nov 15 04:15:14 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:15:14 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:15:14 user nova-compute[74805]:       <target dev="tap4f5678db-12"/>
Nov 15 04:15:14 user nova-compute[74805]:     </interface>
Nov 15 04:15:14 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:15:14 user nova-compute[74805]:       <mac address="fa:16:3e:d0:dc:9e"/>
Nov 15 04:15:14 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:15:14 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:15:14 user nova-compute[74805]:       <target dev="tap45598f97-ca"/>
Nov 15 04:15:14 user nova-compute[74805]:     </interface>
Nov 15 04:15:14 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:15:14 user nova-compute[74805]:       <mac address="fa:16:3e:95:db:7d"/>
Nov 15 04:15:14 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:15:14 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:15:14 user nova-compute[74805]:       <target dev="tap39f4ba29-3d"/>
Nov 15 04:15:14 user nova-compute[74805]:     </interface>
Nov 15 04:15:14 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:15:14 user nova-compute[74805]:       <mac address="fa:16:3e:46:51:3c"/>
Nov 15 04:15:14 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:15:14 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:15:14 user nova-compute[74805]:       <target dev="tapc2cf28e2-46"/>
Nov 15 04:15:14 user nova-compute[74805]:     </interface>
Nov 15 04:15:14 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:15:14 user nova-compute[74805]:       <mac address="fa:16:3e:58:83:23"/>
Nov 15 04:15:14 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:15:14 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:15:14 user nova-compute[74805]:       <target dev="tap705a958d-3f"/>
Nov 15 04:15:14 user nova-compute[74805]:     </interface>
Nov 15 04:15:14 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:15:14 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/e1a3273f-42d2-4582-b539-3c7c6111cf3c/console.log" append="off"/>
Nov 15 04:15:14 user nova-compute[74805]:     </serial>
Nov 15 04:15:14 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:15:14 user nova-compute[74805]:     <video>
Nov 15 04:15:14 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:15:14 user nova-compute[74805]:     </video>
Nov 15 04:15:14 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:15:14 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:15:14 user nova-compute[74805]:     </rng>
Nov 15 04:15:14 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:15:14 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:15:14 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:15:14 user nova-compute[74805]:     </memballoon>
Nov 15 04:15:14 user nova-compute[74805]:   </devices>
Nov 15 04:15:14 user nova-compute[74805]: </domain>
Nov 15 04:15:14 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209991627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209991627',id=11,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL2p+ejOi8AQ04hPhdzGD7OzJ/dixq8QFeSc5qrTwC3wpMDZ0/iY+E0x5r4vEKcyTBCdkRv6GOAto/wSL59XHp3RSRI0zh0xWba9e42A7dyuK3bVVrQh2BApcmYL2JgNQ==',key_name='tempest-keypair-902492598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47b57aff3d714da1a9872ecec24524ae',ramdisk_id='',reservation_id='r-len0vorx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105776980',owner_user_name='tempest-TaggedBootDevicesTest-1105776980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52d077ca42b442e9913fc83e1cc73436',uuid=e1a3273f-42d2-4582-b539-3c7c6111cf3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fb4ff06-71a7-4fe2-81b0-e4d980e75a23", "address": "fa:16:3e:4f:d9:b6", "network": {"id": "c9df097d-17ec-4bdd-aa5b-531b2f59c8e1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1457673667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb4ff06-71", "ovs_interfaceid": "8fb4ff06-71a7-4fe2-81b0-e4d980e75a23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converting VIF {"id": "8fb4ff06-71a7-4fe2-81b0-e4d980e75a23", "address": "fa:16:3e:4f:d9:b6", "network": {"id": "c9df097d-17ec-4bdd-aa5b-531b2f59c8e1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1457673667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb4ff06-71", "ovs_interfaceid": "8fb4ff06-71a7-4fe2-81b0-e4d980e75a23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:d9:b6,bridge_name='br-int',has_traffic_filtering=True,id=8fb4ff06-71a7-4fe2-81b0-e4d980e75a23,network=Network(c9df097d-17ec-4bdd-aa5b-531b2f59c8e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fb4ff06-71') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG os_vif [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:d9:b6,bridge_name='br-int',has_traffic_filtering=True,id=8fb4ff06-71a7-4fe2-81b0-e4d980e75a23,network=Network(c9df097d-17ec-4bdd-aa5b-531b2f59c8e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fb4ff06-71') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f69a019-0b35-5dda-8230-b0fcfb881d1f', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fb4ff06-71, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8fb4ff06-71, col_values=(('qos', UUID('179b0de5-b11d-40b7-a7a7-4d3e57b0865c')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8fb4ff06-71, col_values=(('external_ids', {'iface-id': '8fb4ff06-71a7-4fe2-81b0-e4d980e75a23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:d9:b6', 'vm-uuid': 'e1a3273f-42d2-4582-b539-3c7c6111cf3c'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: INFO os_vif [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:d9:b6,bridge_name='br-int',has_traffic_filtering=True,id=8fb4ff06-71a7-4fe2-81b0-e4d980e75a23,network=Network(c9df097d-17ec-4bdd-aa5b-531b2f59c8e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fb4ff06-71')
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209991627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209991627',id=11,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL2p+ejOi8AQ04hPhdzGD7OzJ/dixq8QFeSc5qrTwC3wpMDZ0/iY+E0x5r4vEKcyTBCdkRv6GOAto/wSL59XHp3RSRI0zh0xWba9e42A7dyuK3bVVrQh2BApcmYL2JgNQ==',key_name='tempest-keypair-902492598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47b57aff3d714da1a9872ecec24524ae',ramdisk_id='',reservation_id='r-len0vorx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105776980',owner_user_name='tempest-TaggedBootDevicesTest-1105776980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52d077ca42b442e9913fc83e1cc73436',uuid=e1a3273f-42d2-4582-b539-3c7c6111cf3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2fd61de8-594b-4c85-957d-db3f622ffdc2", "address": "fa:16:3e:b6:83:57", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fd61de8-59", "ovs_interfaceid": "2fd61de8-594b-4c85-957d-db3f622ffdc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converting VIF {"id": "2fd61de8-594b-4c85-957d-db3f622ffdc2", "address": "fa:16:3e:b6:83:57", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fd61de8-59", "ovs_interfaceid": "2fd61de8-594b-4c85-957d-db3f622ffdc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:83:57,bridge_name='br-int',has_traffic_filtering=True,id=2fd61de8-594b-4c85-957d-db3f622ffdc2,network=Network(6d4c82b5-fae6-47b6-a546-2146dc5391c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2fd61de8-59') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG os_vif [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:83:57,bridge_name='br-int',has_traffic_filtering=True,id=2fd61de8-594b-4c85-957d-db3f622ffdc2,network=Network(6d4c82b5-fae6-47b6-a546-2146dc5391c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2fd61de8-59') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2085b45-1815-59f3-8836-35806b251882', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2fd61de8-59, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2fd61de8-59, col_values=(('qos', UUID('f618c4c8-bb5e-4df4-be7d-ad116101c37b')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2fd61de8-59, col_values=(('external_ids', {'iface-id': '2fd61de8-594b-4c85-957d-db3f622ffdc2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:83:57', 'vm-uuid': 'e1a3273f-42d2-4582-b539-3c7c6111cf3c'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: INFO os_vif [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:83:57,bridge_name='br-int',has_traffic_filtering=True,id=2fd61de8-594b-4c85-957d-db3f622ffdc2,network=Network(6d4c82b5-fae6-47b6-a546-2146dc5391c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2fd61de8-59')
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209991627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209991627',id=11,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL2p+ejOi8AQ04hPhdzGD7OzJ/dixq8QFeSc5qrTwC3wpMDZ0/iY+E0x5r4vEKcyTBCdkRv6GOAto/wSL59XHp3RSRI0zh0xWba9e42A7dyuK3bVVrQh2BApcmYL2JgNQ==',key_name='tempest-keypair-902492598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47b57aff3d714da1a9872ecec24524ae',ramdisk_id='',reservation_id='r-len0vorx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105776980',owner_user_name='tempest-TaggedBootDevicesTest-1105776980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52d077ca42b442e9913fc83e1cc73436',uuid=e1a3273f-42d2-4582-b539-3c7c6111cf3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f5678db-1255-42ae-84ca-4d1b3b5dac84", "address": "fa:16:3e:60:3d:03", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f5678db-12", "ovs_interfaceid": "4f5678db-1255-42ae-84ca-4d1b3b5dac84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converting VIF {"id": "4f5678db-1255-42ae-84ca-4d1b3b5dac84", "address": "fa:16:3e:60:3d:03", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f5678db-12", "ovs_interfaceid": "4f5678db-1255-42ae-84ca-4d1b3b5dac84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:3d:03,bridge_name='br-int',has_traffic_filtering=True,id=4f5678db-1255-42ae-84ca-4d1b3b5dac84,network=Network(6d4c82b5-fae6-47b6-a546-2146dc5391c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4f5678db-12') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG os_vif [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:3d:03,bridge_name='br-int',has_traffic_filtering=True,id=4f5678db-1255-42ae-84ca-4d1b3b5dac84,network=Network(6d4c82b5-fae6-47b6-a546-2146dc5391c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4f5678db-12') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '91a07a98-326e-5c63-a4eb-fe1576f9ca45', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f5678db-12, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f5678db-12, col_values=(('qos', UUID('3cb85a58-4f82-4fe9-8b1d-1591f0e17f59')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f5678db-12, col_values=(('external_ids', {'iface-id': '4f5678db-1255-42ae-84ca-4d1b3b5dac84', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:3d:03', 'vm-uuid': 'e1a3273f-42d2-4582-b539-3c7c6111cf3c'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: INFO os_vif [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:3d:03,bridge_name='br-int',has_traffic_filtering=True,id=4f5678db-1255-42ae-84ca-4d1b3b5dac84,network=Network(6d4c82b5-fae6-47b6-a546-2146dc5391c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4f5678db-12')
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209991627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209991627',id=11,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL2p+ejOi8AQ04hPhdzGD7OzJ/dixq8QFeSc5qrTwC3wpMDZ0/iY+E0x5r4vEKcyTBCdkRv6GOAto/wSL59XHp3RSRI0zh0xWba9e42A7dyuK3bVVrQh2BApcmYL2JgNQ==',key_name='tempest-keypair-902492598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47b57aff3d714da1a9872ecec24524ae',ramdisk_id='',reservation_id='r-len0vorx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105776980',owner_user_name='tempest-TaggedBootDevicesTest-1105776980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52d077ca42b442e9913fc83e1cc73436',uuid=e1a3273f-42d2-4582-b539-3c7c6111cf3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45598f97-ca9c-423f-bf8e-e7ce6aba0073", "address": "fa:16:3e:d0:dc:9e", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45598f97-ca", "ovs_interfaceid": "45598f97-ca9c-423f-bf8e-e7ce6aba0073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converting VIF {"id": "45598f97-ca9c-423f-bf8e-e7ce6aba0073", "address": "fa:16:3e:d0:dc:9e", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45598f97-ca", "ovs_interfaceid": "45598f97-ca9c-423f-bf8e-e7ce6aba0073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:dc:9e,bridge_name='br-int',has_traffic_filtering=True,id=45598f97-ca9c-423f-bf8e-e7ce6aba0073,network=Network(6d4c82b5-fae6-47b6-a546-2146dc5391c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45598f97-ca') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG os_vif [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:dc:9e,bridge_name='br-int',has_traffic_filtering=True,id=45598f97-ca9c-423f-bf8e-e7ce6aba0073,network=Network(6d4c82b5-fae6-47b6-a546-2146dc5391c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45598f97-ca') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a6ede22-abdb-583c-bc38-7befe28201d5', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45598f97-ca, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap45598f97-ca, col_values=(('qos', UUID('9b57f12e-c8d8-4d7e-b4d0-d6422000f063')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap45598f97-ca, col_values=(('external_ids', {'iface-id': '45598f97-ca9c-423f-bf8e-e7ce6aba0073', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:dc:9e', 'vm-uuid': 'e1a3273f-42d2-4582-b539-3c7c6111cf3c'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: INFO os_vif [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:dc:9e,bridge_name='br-int',has_traffic_filtering=True,id=45598f97-ca9c-423f-bf8e-e7ce6aba0073,network=Network(6d4c82b5-fae6-47b6-a546-2146dc5391c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45598f97-ca')
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209991627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209991627',id=11,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL2p+ejOi8AQ04hPhdzGD7OzJ/dixq8QFeSc5qrTwC3wpMDZ0/iY+E0x5r4vEKcyTBCdkRv6GOAto/wSL59XHp3RSRI0zh0xWba9e42A7dyuK3bVVrQh2BApcmYL2JgNQ==',key_name='tempest-keypair-902492598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47b57aff3d714da1a9872ecec24524ae',ramdisk_id='',reservation_id='r-len0vorx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105776980',owner_user_name='tempest-TaggedBootDevicesTest-1105776980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52d077ca42b442e9913fc83e1cc73436',uuid=e1a3273f-42d2-4582-b539-3c7c6111cf3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39f4ba29-3df3-4389-ae97-476675222a14", "address": "fa:16:3e:95:db:7d", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f4ba29-3d", "ovs_interfaceid": "39f4ba29-3df3-4389-ae97-476675222a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converting VIF {"id": "39f4ba29-3df3-4389-ae97-476675222a14", "address": "fa:16:3e:95:db:7d", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f4ba29-3d", "ovs_interfaceid": "39f4ba29-3df3-4389-ae97-476675222a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:db:7d,bridge_name='br-int',has_traffic_filtering=True,id=39f4ba29-3df3-4389-ae97-476675222a14,network=Network(6d4c82b5-fae6-47b6-a546-2146dc5391c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f4ba29-3d') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG os_vif [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:db:7d,bridge_name='br-int',has_traffic_filtering=True,id=39f4ba29-3df3-4389-ae97-476675222a14,network=Network(6d4c82b5-fae6-47b6-a546-2146dc5391c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f4ba29-3d') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a5f5a94-f2cd-51be-84a5-2a86de3d2568', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39f4ba29-3d, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap39f4ba29-3d, col_values=(('qos', UUID('259271ce-5179-4864-85c4-1a8355add4a2')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap39f4ba29-3d, col_values=(('external_ids', {'iface-id': '39f4ba29-3df3-4389-ae97-476675222a14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:db:7d', 'vm-uuid': 'e1a3273f-42d2-4582-b539-3c7c6111cf3c'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: INFO os_vif [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:db:7d,bridge_name='br-int',has_traffic_filtering=True,id=39f4ba29-3df3-4389-ae97-476675222a14,network=Network(6d4c82b5-fae6-47b6-a546-2146dc5391c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f4ba29-3d')
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209991627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209991627',id=11,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL2p+ejOi8AQ04hPhdzGD7OzJ/dixq8QFeSc5qrTwC3wpMDZ0/iY+E0x5r4vEKcyTBCdkRv6GOAto/wSL59XHp3RSRI0zh0xWba9e42A7dyuK3bVVrQh2BApcmYL2JgNQ==',key_name='tempest-keypair-902492598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47b57aff3d714da1a9872ecec24524ae',ramdisk_id='',reservation_id='r-len0vorx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105776980',owner_user_name='tempest-TaggedBootDevicesTest-1105776980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52d077ca42b442e9913fc83e1cc73436',uuid=e1a3273f-42d2-4582-b539-3c7c6111cf3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2cf28e2-46e0-450c-a153-23e6ef6da5f2", "address": "fa:16:3e:46:51:3c", "network": {"id": "da7f4cb9-5e5c-4598-a27b-94e6c59c582d", "bridge": "br-int", "label": "tempest-device-tagging-net2-610177095", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2cf28e2-46", "ovs_interfaceid": "c2cf28e2-46e0-450c-a153-23e6ef6da5f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converting VIF {"id": "c2cf28e2-46e0-450c-a153-23e6ef6da5f2", "address": "fa:16:3e:46:51:3c", "network": {"id": "da7f4cb9-5e5c-4598-a27b-94e6c59c582d", "bridge": "br-int", "label": "tempest-device-tagging-net2-610177095", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2cf28e2-46", "ovs_interfaceid": "c2cf28e2-46e0-450c-a153-23e6ef6da5f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:51:3c,bridge_name='br-int',has_traffic_filtering=True,id=c2cf28e2-46e0-450c-a153-23e6ef6da5f2,network=Network(da7f4cb9-5e5c-4598-a27b-94e6c59c582d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2cf28e2-46') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG os_vif [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:51:3c,bridge_name='br-int',has_traffic_filtering=True,id=c2cf28e2-46e0-450c-a153-23e6ef6da5f2,network=Network(da7f4cb9-5e5c-4598-a27b-94e6c59c582d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2cf28e2-46') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56c598fe-1e36-5398-8b3a-593ad9ff079a', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2cf28e2-46, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2cf28e2-46, col_values=(('qos', UUID('caa38663-9ac1-41b3-9e63-06770a9a148e')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2cf28e2-46, col_values=(('external_ids', {'iface-id': 'c2cf28e2-46e0-450c-a153-23e6ef6da5f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:51:3c', 'vm-uuid': 'e1a3273f-42d2-4582-b539-3c7c6111cf3c'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: INFO os_vif [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:51:3c,bridge_name='br-int',has_traffic_filtering=True,id=c2cf28e2-46e0-450c-a153-23e6ef6da5f2,network=Network(da7f4cb9-5e5c-4598-a27b-94e6c59c582d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2cf28e2-46')
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209991627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209991627',id=11,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL2p+ejOi8AQ04hPhdzGD7OzJ/dixq8QFeSc5qrTwC3wpMDZ0/iY+E0x5r4vEKcyTBCdkRv6GOAto/wSL59XHp3RSRI0zh0xWba9e42A7dyuK3bVVrQh2BApcmYL2JgNQ==',key_name='tempest-keypair-902492598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47b57aff3d714da1a9872ecec24524ae',ramdisk_id='',reservation_id='r-len0vorx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105776980',owner_user_name='tempest-TaggedBootDevicesTest-1105776980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52d077ca42b442e9913fc83e1cc73436',uuid=e1a3273f-42d2-4582-b539-3c7c6111cf3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "705a958d-3fb6-4fe9-ba7e-e69d242dde68", "address": "fa:16:3e:58:83:23", "network": {"id": "da7f4cb9-5e5c-4598-a27b-94e6c59c582d", "bridge": "br-int", "label": "tempest-device-tagging-net2-610177095", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705a958d-3f", "ovs_interfaceid": "705a958d-3fb6-4fe9-ba7e-e69d242dde68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converting VIF {"id": "705a958d-3fb6-4fe9-ba7e-e69d242dde68", "address": "fa:16:3e:58:83:23", "network": {"id": "da7f4cb9-5e5c-4598-a27b-94e6c59c582d", "bridge": "br-int", "label": "tempest-device-tagging-net2-610177095", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705a958d-3f", "ovs_interfaceid": "705a958d-3fb6-4fe9-ba7e-e69d242dde68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:83:23,bridge_name='br-int',has_traffic_filtering=True,id=705a958d-3fb6-4fe9-ba7e-e69d242dde68,network=Network(da7f4cb9-5e5c-4598-a27b-94e6c59c582d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap705a958d-3f') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG os_vif [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:83:23,bridge_name='br-int',has_traffic_filtering=True,id=705a958d-3fb6-4fe9-ba7e-e69d242dde68,network=Network(da7f4cb9-5e5c-4598-a27b-94e6c59c582d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap705a958d-3f') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '53cbfc32-7089-5fa6-aa5f-e690bc9ccec4', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap705a958d-3f, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap705a958d-3f, col_values=(('qos', UUID('342cbc3e-7d46-428f-9804-4012e107c574')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap705a958d-3f, col_values=(('external_ids', {'iface-id': '705a958d-3fb6-4fe9-ba7e-e69d242dde68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:83:23', 'vm-uuid': 'e1a3273f-42d2-4582-b539-3c7c6111cf3c'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:14 user nova-compute[74805]: INFO os_vif [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:83:23,bridge_name='br-int',has_traffic_filtering=True,id=705a958d-3fb6-4fe9-ba7e-e69d242dde68,network=Network(da7f4cb9-5e5c-4598-a27b-94e6c59c582d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap705a958d-3f')
Nov 15 04:15:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] No BDM found with device name hda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:15:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:15:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] No VIF found with MAC fa:16:3e:4f:d9:b6, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:15:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] No VIF found with MAC fa:16:3e:95:db:7d, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:15:15 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Using config drive
Nov 15 04:15:15 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Creating config drive at /opt/stack/data/nova/instances/e1a3273f-42d2-4582-b539-3c7c6111cf3c/disk.config
Nov 15 04:15:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e1a3273f-42d2-4582-b539-3c7c6111cf3c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptn75a6nn {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e1a3273f-42d2-4582-b539-3c7c6111cf3c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptn75a6nn" returned: 0 in 0.049s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:17 user nova-compute[74805]: DEBUG nova.compute.manager [req-092464a2-72c9-4062-a6b1-83cb5b8754d9 req-18c38765-fdce-4bfc-9dba-83c87f468046 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-plugged-8fb4ff06-71a7-4fe2-81b0-e4d980e75a23 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-092464a2-72c9-4062-a6b1-83cb5b8754d9 req-18c38765-fdce-4bfc-9dba-83c87f468046 service nova] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-092464a2-72c9-4062-a6b1-83cb5b8754d9 req-18c38765-fdce-4bfc-9dba-83c87f468046 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-092464a2-72c9-4062-a6b1-83cb5b8754d9 req-18c38765-fdce-4bfc-9dba-83c87f468046 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:17 user nova-compute[74805]: DEBUG nova.compute.manager [req-092464a2-72c9-4062-a6b1-83cb5b8754d9 req-18c38765-fdce-4bfc-9dba-83c87f468046 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] No waiting events found dispatching network-vif-plugged-8fb4ff06-71a7-4fe2-81b0-e4d980e75a23 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:15:17 user nova-compute[74805]: WARNING nova.compute.manager [req-092464a2-72c9-4062-a6b1-83cb5b8754d9 req-18c38765-fdce-4bfc-9dba-83c87f468046 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received unexpected event network-vif-plugged-8fb4ff06-71a7-4fe2-81b0-e4d980e75a23 for instance with vm_state building and task_state spawning.
Nov 15 04:15:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:17 user nova-compute[74805]: DEBUG nova.compute.manager [req-b8230974-c062-4a35-a8ff-04e5602b2f2f req-efce5ba6-4648-4b5f-9efb-a8102c95b53e service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-plugged-4f5678db-1255-42ae-84ca-4d1b3b5dac84 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b8230974-c062-4a35-a8ff-04e5602b2f2f req-efce5ba6-4648-4b5f-9efb-a8102c95b53e service nova] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b8230974-c062-4a35-a8ff-04e5602b2f2f req-efce5ba6-4648-4b5f-9efb-a8102c95b53e service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b8230974-c062-4a35-a8ff-04e5602b2f2f req-efce5ba6-4648-4b5f-9efb-a8102c95b53e service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:17 user nova-compute[74805]: DEBUG nova.compute.manager [req-b8230974-c062-4a35-a8ff-04e5602b2f2f req-efce5ba6-4648-4b5f-9efb-a8102c95b53e service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] No waiting events found dispatching network-vif-plugged-4f5678db-1255-42ae-84ca-4d1b3b5dac84 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:15:17 user nova-compute[74805]: WARNING nova.compute.manager [req-b8230974-c062-4a35-a8ff-04e5602b2f2f req-efce5ba6-4648-4b5f-9efb-a8102c95b53e service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received unexpected event network-vif-plugged-4f5678db-1255-42ae-84ca-4d1b3b5dac84 for instance with vm_state building and task_state spawning.
Nov 15 04:15:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG nova.compute.manager [req-f5e89a6a-770e-4227-b5ba-c9ba72d96879 req-9f44d7ea-9483-4f27-b1a8-bcf063f770f6 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-plugged-8fb4ff06-71a7-4fe2-81b0-e4d980e75a23 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f5e89a6a-770e-4227-b5ba-c9ba72d96879 req-9f44d7ea-9483-4f27-b1a8-bcf063f770f6 service nova] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f5e89a6a-770e-4227-b5ba-c9ba72d96879 req-9f44d7ea-9483-4f27-b1a8-bcf063f770f6 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f5e89a6a-770e-4227-b5ba-c9ba72d96879 req-9f44d7ea-9483-4f27-b1a8-bcf063f770f6 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG nova.compute.manager [req-f5e89a6a-770e-4227-b5ba-c9ba72d96879 req-9f44d7ea-9483-4f27-b1a8-bcf063f770f6 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] No waiting events found dispatching network-vif-plugged-8fb4ff06-71a7-4fe2-81b0-e4d980e75a23 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:15:19 user nova-compute[74805]: WARNING nova.compute.manager [req-f5e89a6a-770e-4227-b5ba-c9ba72d96879 req-9f44d7ea-9483-4f27-b1a8-bcf063f770f6 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received unexpected event network-vif-plugged-8fb4ff06-71a7-4fe2-81b0-e4d980e75a23 for instance with vm_state building and task_state spawning.
Nov 15 04:15:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG nova.compute.manager [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-plugged-4f5678db-1255-42ae-84ca-4d1b3b5dac84 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG nova.compute.manager [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] No waiting events found dispatching network-vif-plugged-4f5678db-1255-42ae-84ca-4d1b3b5dac84 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:15:19 user nova-compute[74805]: WARNING nova.compute.manager [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received unexpected event network-vif-plugged-4f5678db-1255-42ae-84ca-4d1b3b5dac84 for instance with vm_state building and task_state spawning.
Nov 15 04:15:19 user nova-compute[74805]: DEBUG nova.compute.manager [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-plugged-c2cf28e2-46e0-450c-a153-23e6ef6da5f2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG nova.compute.manager [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] No waiting events found dispatching network-vif-plugged-c2cf28e2-46e0-450c-a153-23e6ef6da5f2 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:15:19 user nova-compute[74805]: WARNING nova.compute.manager [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received unexpected event network-vif-plugged-c2cf28e2-46e0-450c-a153-23e6ef6da5f2 for instance with vm_state building and task_state spawning.
Nov 15 04:15:19 user nova-compute[74805]: DEBUG nova.compute.manager [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-plugged-c2cf28e2-46e0-450c-a153-23e6ef6da5f2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG nova.compute.manager [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] No waiting events found dispatching network-vif-plugged-c2cf28e2-46e0-450c-a153-23e6ef6da5f2 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:15:19 user nova-compute[74805]: WARNING nova.compute.manager [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received unexpected event network-vif-plugged-c2cf28e2-46e0-450c-a153-23e6ef6da5f2 for instance with vm_state building and task_state spawning.
Nov 15 04:15:19 user nova-compute[74805]: DEBUG nova.compute.manager [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-plugged-705a958d-3fb6-4fe9-ba7e-e69d242dde68 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG nova.compute.manager [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] No waiting events found dispatching network-vif-plugged-705a958d-3fb6-4fe9-ba7e-e69d242dde68 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:15:19 user nova-compute[74805]: WARNING nova.compute.manager [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received unexpected event network-vif-plugged-705a958d-3fb6-4fe9-ba7e-e69d242dde68 for instance with vm_state building and task_state spawning.
Nov 15 04:15:19 user nova-compute[74805]: DEBUG nova.compute.manager [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-plugged-705a958d-3fb6-4fe9-ba7e-e69d242dde68 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG nova.compute.manager [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] No waiting events found dispatching network-vif-plugged-705a958d-3fb6-4fe9-ba7e-e69d242dde68 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:15:19 user nova-compute[74805]: WARNING nova.compute.manager [req-51f41be4-433d-49ba-a61a-df9fb582edde req-53f770c5-c011-4f4e-badb-bcfa56d130e7 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received unexpected event network-vif-plugged-705a958d-3fb6-4fe9-ba7e-e69d242dde68 for instance with vm_state building and task_state spawning.
Nov 15 04:15:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:15:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:20 user nova-compute[74805]: DEBUG nova.compute.manager [req-b442c9a2-2985-4d37-8d84-da4b01f60336 req-5d22eda8-5c1c-41b9-b44c-2c119414dcc3 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-plugged-2fd61de8-594b-4c85-957d-db3f622ffdc2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b442c9a2-2985-4d37-8d84-da4b01f60336 req-5d22eda8-5c1c-41b9-b44c-2c119414dcc3 service nova] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b442c9a2-2985-4d37-8d84-da4b01f60336 req-5d22eda8-5c1c-41b9-b44c-2c119414dcc3 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b442c9a2-2985-4d37-8d84-da4b01f60336 req-5d22eda8-5c1c-41b9-b44c-2c119414dcc3 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:20 user nova-compute[74805]: DEBUG nova.compute.manager [req-b442c9a2-2985-4d37-8d84-da4b01f60336 req-5d22eda8-5c1c-41b9-b44c-2c119414dcc3 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] No waiting events found dispatching network-vif-plugged-2fd61de8-594b-4c85-957d-db3f622ffdc2 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:15:20 user nova-compute[74805]: WARNING nova.compute.manager [req-b442c9a2-2985-4d37-8d84-da4b01f60336 req-5d22eda8-5c1c-41b9-b44c-2c119414dcc3 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received unexpected event network-vif-plugged-2fd61de8-594b-4c85-957d-db3f622ffdc2 for instance with vm_state building and task_state spawning.
Nov 15 04:15:20 user nova-compute[74805]: DEBUG nova.compute.manager [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:15:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:15:20 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Instance spawned successfully.
Nov 15 04:15:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:15:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:15:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:15:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:15:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:15:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:15:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:15:20 user nova-compute[74805]: INFO nova.compute.manager [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Took 10.76 seconds to spawn the instance on the hypervisor.
Nov 15 04:15:20 user nova-compute[74805]: DEBUG nova.compute.manager [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:15:21 user nova-compute[74805]: INFO nova.compute.manager [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Took 30.89 seconds to build instance.
Nov 15 04:15:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-fb6b83a5-b42d-49fb-a77c-7c2b86cc08a5 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.042s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-0acfc9d3-6824-42cb-83ea-b6608ef4fc52 req-ab5fc932-6990-4f36-854d-cf2e2e2c4b75 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-plugged-2fd61de8-594b-4c85-957d-db3f622ffdc2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0acfc9d3-6824-42cb-83ea-b6608ef4fc52 req-ab5fc932-6990-4f36-854d-cf2e2e2c4b75 service nova] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0acfc9d3-6824-42cb-83ea-b6608ef4fc52 req-ab5fc932-6990-4f36-854d-cf2e2e2c4b75 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0acfc9d3-6824-42cb-83ea-b6608ef4fc52 req-ab5fc932-6990-4f36-854d-cf2e2e2c4b75 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-0acfc9d3-6824-42cb-83ea-b6608ef4fc52 req-ab5fc932-6990-4f36-854d-cf2e2e2c4b75 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] No waiting events found dispatching network-vif-plugged-2fd61de8-594b-4c85-957d-db3f622ffdc2 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:15:22 user nova-compute[74805]: WARNING nova.compute.manager [req-0acfc9d3-6824-42cb-83ea-b6608ef4fc52 req-ab5fc932-6990-4f36-854d-cf2e2e2c4b75 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received unexpected event network-vif-plugged-2fd61de8-594b-4c85-957d-db3f622ffdc2 for instance with vm_state active and task_state None.
Nov 15 04:15:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-0acfc9d3-6824-42cb-83ea-b6608ef4fc52 req-ab5fc932-6990-4f36-854d-cf2e2e2c4b75 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-plugged-45598f97-ca9c-423f-bf8e-e7ce6aba0073 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0acfc9d3-6824-42cb-83ea-b6608ef4fc52 req-ab5fc932-6990-4f36-854d-cf2e2e2c4b75 service nova] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0acfc9d3-6824-42cb-83ea-b6608ef4fc52 req-ab5fc932-6990-4f36-854d-cf2e2e2c4b75 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0acfc9d3-6824-42cb-83ea-b6608ef4fc52 req-ab5fc932-6990-4f36-854d-cf2e2e2c4b75 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-0acfc9d3-6824-42cb-83ea-b6608ef4fc52 req-ab5fc932-6990-4f36-854d-cf2e2e2c4b75 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] No waiting events found dispatching network-vif-plugged-45598f97-ca9c-423f-bf8e-e7ce6aba0073 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:15:22 user nova-compute[74805]: WARNING nova.compute.manager [req-0acfc9d3-6824-42cb-83ea-b6608ef4fc52 req-ab5fc932-6990-4f36-854d-cf2e2e2c4b75 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received unexpected event network-vif-plugged-45598f97-ca9c-423f-bf8e-e7ce6aba0073 for instance with vm_state active and task_state None.
Nov 15 04:15:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-0acfc9d3-6824-42cb-83ea-b6608ef4fc52 req-ab5fc932-6990-4f36-854d-cf2e2e2c4b75 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-plugged-45598f97-ca9c-423f-bf8e-e7ce6aba0073 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0acfc9d3-6824-42cb-83ea-b6608ef4fc52 req-ab5fc932-6990-4f36-854d-cf2e2e2c4b75 service nova] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0acfc9d3-6824-42cb-83ea-b6608ef4fc52 req-ab5fc932-6990-4f36-854d-cf2e2e2c4b75 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0acfc9d3-6824-42cb-83ea-b6608ef4fc52 req-ab5fc932-6990-4f36-854d-cf2e2e2c4b75 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-0acfc9d3-6824-42cb-83ea-b6608ef4fc52 req-ab5fc932-6990-4f36-854d-cf2e2e2c4b75 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] No waiting events found dispatching network-vif-plugged-45598f97-ca9c-423f-bf8e-e7ce6aba0073 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:15:22 user nova-compute[74805]: WARNING nova.compute.manager [req-0acfc9d3-6824-42cb-83ea-b6608ef4fc52 req-ab5fc932-6990-4f36-854d-cf2e2e2c4b75 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received unexpected event network-vif-plugged-45598f97-ca9c-423f-bf8e-e7ce6aba0073 for instance with vm_state active and task_state None.
Nov 15 04:15:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-0acfc9d3-6824-42cb-83ea-b6608ef4fc52 req-ab5fc932-6990-4f36-854d-cf2e2e2c4b75 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-plugged-39f4ba29-3df3-4389-ae97-476675222a14 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0acfc9d3-6824-42cb-83ea-b6608ef4fc52 req-ab5fc932-6990-4f36-854d-cf2e2e2c4b75 service nova] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0acfc9d3-6824-42cb-83ea-b6608ef4fc52 req-ab5fc932-6990-4f36-854d-cf2e2e2c4b75 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0acfc9d3-6824-42cb-83ea-b6608ef4fc52 req-ab5fc932-6990-4f36-854d-cf2e2e2c4b75 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-0acfc9d3-6824-42cb-83ea-b6608ef4fc52 req-ab5fc932-6990-4f36-854d-cf2e2e2c4b75 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] No waiting events found dispatching network-vif-plugged-39f4ba29-3df3-4389-ae97-476675222a14 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:15:22 user nova-compute[74805]: WARNING nova.compute.manager [req-0acfc9d3-6824-42cb-83ea-b6608ef4fc52 req-ab5fc932-6990-4f36-854d-cf2e2e2c4b75 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received unexpected event network-vif-plugged-39f4ba29-3df3-4389-ae97-476675222a14 for instance with vm_state active and task_state None.
Nov 15 04:15:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-47d33bc9-9e12-4797-a2c7-0aa08ce404f7 req-1adfd545-ad90-48dc-b0c3-f9ed34ac31a9 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-plugged-39f4ba29-3df3-4389-ae97-476675222a14 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-47d33bc9-9e12-4797-a2c7-0aa08ce404f7 req-1adfd545-ad90-48dc-b0c3-f9ed34ac31a9 service nova] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-47d33bc9-9e12-4797-a2c7-0aa08ce404f7 req-1adfd545-ad90-48dc-b0c3-f9ed34ac31a9 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-47d33bc9-9e12-4797-a2c7-0aa08ce404f7 req-1adfd545-ad90-48dc-b0c3-f9ed34ac31a9 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-47d33bc9-9e12-4797-a2c7-0aa08ce404f7 req-1adfd545-ad90-48dc-b0c3-f9ed34ac31a9 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] No waiting events found dispatching network-vif-plugged-39f4ba29-3df3-4389-ae97-476675222a14 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:15:24 user nova-compute[74805]: WARNING nova.compute.manager [req-47d33bc9-9e12-4797-a2c7-0aa08ce404f7 req-1adfd545-ad90-48dc-b0c3-f9ed34ac31a9 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received unexpected event network-vif-plugged-39f4ba29-3df3-4389-ae97-476675222a14 for instance with vm_state active and task_state None.
Nov 15 04:15:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "cad2eedf-c1ef-436c-b608-5b6dafa47451" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:15:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:27 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:15:27 user nova-compute[74805]: INFO nova.compute.claims [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Claim successful on node user
Nov 15 04:15:27 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Refreshing inventories for resource provider ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 04:15:27 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Updating ProviderTree inventory for provider ada87504-5552-4a33-b754-f9a54c67fe39 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 04:15:27 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Updating inventory in ProviderTree for provider ada87504-5552-4a33-b754-f9a54c67fe39 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 04:15:27 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Refreshing aggregate associations for resource provider ada87504-5552-4a33-b754-f9a54c67fe39, aggregates: None {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 04:15:27 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Refreshing trait associations for resource provider ada87504-5552-4a33-b754-f9a54c67fe39, traits: COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 04:15:28 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:15:28 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:15:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.631s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:28 user nova-compute[74805]: DEBUG nova.compute.manager [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:15:28 user nova-compute[74805]: DEBUG nova.compute.manager [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:15:28 user nova-compute[74805]: DEBUG nova.network.neutron [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:15:28 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:15:28 user nova-compute[74805]: DEBUG nova.compute.manager [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:15:28 user nova-compute[74805]: DEBUG nova.policy [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eac59db39ba64883a64ab3133eaf1972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddde64bc93cc40f189e1d0b6d948cd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:15:28 user nova-compute[74805]: DEBUG nova.compute.manager [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:15:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:15:28 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Creating image(s)
Nov 15 04:15:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "/opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "/opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "/opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "7f8e877eca710056507fc43c4370f51f1ffb7aa0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "7f8e877eca710056507fc43c4370f51f1ffb7aa0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f8e877eca710056507fc43c4370f51f1ffb7aa0.part --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:28 user nova-compute[74805]: DEBUG nova.network.neutron [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Successfully created port: 333d7ad3-7a5b-49e8-a657-a712443ad922 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:15:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f8e877eca710056507fc43c4370f51f1ffb7aa0.part --force-share --output=json" returned: 0 in 0.244s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:29 user nova-compute[74805]: DEBUG nova.virt.images [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] c40fd4f6-246a-4fa8-80fa-f56a69d0386c was qcow2, converting to raw {{(pid=74805) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 04:15:29 user nova-compute[74805]: DEBUG nova.privsep.utils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74805) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 04:15:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7f8e877eca710056507fc43c4370f51f1ffb7aa0.part /opt/stack/data/nova/instances/_base/7f8e877eca710056507fc43c4370f51f1ffb7aa0.converted {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7f8e877eca710056507fc43c4370f51f1ffb7aa0.part /opt/stack/data/nova/instances/_base/7f8e877eca710056507fc43c4370f51f1ffb7aa0.converted" returned: 0 in 0.241s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f8e877eca710056507fc43c4370f51f1ffb7aa0.converted --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f8e877eca710056507fc43c4370f51f1ffb7aa0.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "7f8e877eca710056507fc43c4370f51f1ffb7aa0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.233s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f8e877eca710056507fc43c4370f51f1ffb7aa0 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:29 user nova-compute[74805]: DEBUG nova.network.neutron [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Successfully updated port: 333d7ad3-7a5b-49e8-a657-a712443ad922 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:15:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f8e877eca710056507fc43c4370f51f1ffb7aa0 --force-share --output=json" returned: 0 in 0.188s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "7f8e877eca710056507fc43c4370f51f1ffb7aa0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "7f8e877eca710056507fc43c4370f51f1ffb7aa0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f8e877eca710056507fc43c4370f51f1ffb7aa0 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "refresh_cache-cad2eedf-c1ef-436c-b608-5b6dafa47451" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:15:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquired lock "refresh_cache-cad2eedf-c1ef-436c-b608-5b6dafa47451" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:15:29 user nova-compute[74805]: DEBUG nova.network.neutron [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:15:29 user nova-compute[74805]: DEBUG nova.compute.manager [req-2f82fc5f-5c9f-4fc8-8298-eb56e439eb7a req-d1addb2e-e020-419a-91bb-a900118e4727 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Received event network-changed-333d7ad3-7a5b-49e8-a657-a712443ad922 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:29 user nova-compute[74805]: DEBUG nova.compute.manager [req-2f82fc5f-5c9f-4fc8-8298-eb56e439eb7a req-d1addb2e-e020-419a-91bb-a900118e4727 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Refreshing instance network info cache due to event network-changed-333d7ad3-7a5b-49e8-a657-a712443ad922. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:15:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2f82fc5f-5c9f-4fc8-8298-eb56e439eb7a req-d1addb2e-e020-419a-91bb-a900118e4727 service nova] Acquiring lock "refresh_cache-cad2eedf-c1ef-436c-b608-5b6dafa47451" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:15:29 user nova-compute[74805]: DEBUG nova.network.neutron [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:15:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f8e877eca710056507fc43c4370f51f1ffb7aa0 --force-share --output=json" returned: 0 in 0.179s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7f8e877eca710056507fc43c4370f51f1ffb7aa0,backing_fmt=raw /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7f8e877eca710056507fc43c4370f51f1ffb7aa0,backing_fmt=raw /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk 1073741824" returned: 0 in 0.055s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "7f8e877eca710056507fc43c4370f51f1ffb7aa0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f8e877eca710056507fc43c4370f51f1ffb7aa0 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.network.neutron [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Updating instance_info_cache with network_info: [{"id": "333d7ad3-7a5b-49e8-a657-a712443ad922", "address": "fa:16:3e:ff:8a:9e", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333d7ad3-7a", "ovs_interfaceid": "333d7ad3-7a5b-49e8-a657-a712443ad922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f8e877eca710056507fc43c4370f51f1ffb7aa0 --force-share --output=json" returned: 0 in 0.172s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Releasing lock "refresh_cache-cad2eedf-c1ef-436c-b608-5b6dafa47451" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.compute.manager [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Instance network_info: |[{"id": "333d7ad3-7a5b-49e8-a657-a712443ad922", "address": "fa:16:3e:ff:8a:9e", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333d7ad3-7a", "ovs_interfaceid": "333d7ad3-7a5b-49e8-a657-a712443ad922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2f82fc5f-5c9f-4fc8-8298-eb56e439eb7a req-d1addb2e-e020-419a-91bb-a900118e4727 service nova] Acquired lock "refresh_cache-cad2eedf-c1ef-436c-b608-5b6dafa47451" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.network.neutron [req-2f82fc5f-5c9f-4fc8-8298-eb56e439eb7a req-d1addb2e-e020-419a-91bb-a900118e4727 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Refreshing network info cache for port 333d7ad3-7a5b-49e8-a657-a712443ad922 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Cannot resize image /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Ensure instance console log exists: /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Start _get_guest_xml network_info=[{"id": "333d7ad3-7a5b-49e8-a657-a712443ad922", "address": "fa:16:3e:ff:8a:9e", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333d7ad3-7a", "ovs_interfaceid": "333d7ad3-7a5b-49e8-a657-a712443ad922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:15:24Z,direct_url=<?>,disk_format='qcow2',id=c40fd4f6-246a-4fa8-80fa-f56a69d0386c,min_disk=0,min_ram=0,name='tempest-scenario-img--754554722',owner='ddde64bc93cc40f189e1d0b6d948cd0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:15:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'c40fd4f6-246a-4fa8-80fa-f56a69d0386c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:15:30 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:15:30 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:15:24Z,direct_url=<?>,disk_format='qcow2',id=c40fd4f6-246a-4fa8-80fa-f56a69d0386c,min_disk=0,min_ram=0,name='tempest-scenario-img--754554722',owner='ddde64bc93cc40f189e1d0b6d948cd0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:15:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-882338115',display_name='tempest-TestMinimumBasicScenario-server-882338115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-882338115',id=12,image_ref='c40fd4f6-246a-4fa8-80fa-f56a69d0386c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoM4mPJpNa3lSZNqZNye7yd+TzehokoE4PQcucjBnq3agpjLVjHz6yfP2n5YbekRY7ga7hrRvA9IilP2Z+bVGfBl94B2ikgCr8ddgEyR544o0t1jjaQlKeA+jJsJfPcaA==',key_name='tempest-TestMinimumBasicScenario-883673859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ddde64bc93cc40f189e1d0b6d948cd0a',ramdisk_id='',reservation_id='r-a1rc5i03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c40fd4f6-246a-4fa8-80fa-f56a69d0386c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-342422642',owner_user_name='tempest-TestMinimumBasicScenario-342422642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:15:28Z,user_data=None,user_id='eac59db39ba64883a64ab3133eaf1972',uuid=cad2eedf-c1ef-436c-b608-5b6dafa47451,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "333d7ad3-7a5b-49e8-a657-a712443ad922", "address": "fa:16:3e:ff:8a:9e", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333d7ad3-7a", "ovs_interfaceid": "333d7ad3-7a5b-49e8-a657-a712443ad922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Converting VIF {"id": "333d7ad3-7a5b-49e8-a657-a712443ad922", "address": "fa:16:3e:ff:8a:9e", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333d7ad3-7a", "ovs_interfaceid": "333d7ad3-7a5b-49e8-a657-a712443ad922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:8a:9e,bridge_name='br-int',has_traffic_filtering=True,id=333d7ad3-7a5b-49e8-a657-a712443ad922,network=Network(8408f959-0c0d-4a22-afa0-b51304c254ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333d7ad3-7a') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.objects.instance [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lazy-loading 'pci_devices' on Instance uuid cad2eedf-c1ef-436c-b608-5b6dafa47451 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:15:30 user nova-compute[74805]:   <uuid>cad2eedf-c1ef-436c-b608-5b6dafa47451</uuid>
Nov 15 04:15:30 user nova-compute[74805]:   <name>instance-0000000c</name>
Nov 15 04:15:30 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:15:30 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:15:30 user nova-compute[74805]:   <metadata>
Nov 15 04:15:30 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:15:30 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:15:30 user nova-compute[74805]:       <nova:name>tempest-TestMinimumBasicScenario-server-882338115</nova:name>
Nov 15 04:15:30 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:15:30</nova:creationTime>
Nov 15 04:15:30 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:15:30 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:15:30 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:15:30 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:15:30 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:15:30 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:15:30 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:15:30 user nova-compute[74805]:       <nova:owner>
Nov 15 04:15:30 user nova-compute[74805]:         <nova:user uuid="eac59db39ba64883a64ab3133eaf1972">tempest-TestMinimumBasicScenario-342422642-project-member</nova:user>
Nov 15 04:15:30 user nova-compute[74805]:         <nova:project uuid="ddde64bc93cc40f189e1d0b6d948cd0a">tempest-TestMinimumBasicScenario-342422642</nova:project>
Nov 15 04:15:30 user nova-compute[74805]:       </nova:owner>
Nov 15 04:15:30 user nova-compute[74805]:       <nova:root type="image" uuid="c40fd4f6-246a-4fa8-80fa-f56a69d0386c"/>
Nov 15 04:15:30 user nova-compute[74805]:       <nova:ports>
Nov 15 04:15:30 user nova-compute[74805]:         <nova:port uuid="333d7ad3-7a5b-49e8-a657-a712443ad922">
Nov 15 04:15:30 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 04:15:30 user nova-compute[74805]:         </nova:port>
Nov 15 04:15:30 user nova-compute[74805]:       </nova:ports>
Nov 15 04:15:30 user nova-compute[74805]:     </nova:instance>
Nov 15 04:15:30 user nova-compute[74805]:   </metadata>
Nov 15 04:15:30 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:15:30 user nova-compute[74805]:     <system>
Nov 15 04:15:30 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:15:30 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:15:30 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:15:30 user nova-compute[74805]:       <entry name="serial">cad2eedf-c1ef-436c-b608-5b6dafa47451</entry>
Nov 15 04:15:30 user nova-compute[74805]:       <entry name="uuid">cad2eedf-c1ef-436c-b608-5b6dafa47451</entry>
Nov 15 04:15:30 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:15:30 user nova-compute[74805]:     </system>
Nov 15 04:15:30 user nova-compute[74805]:   </sysinfo>
Nov 15 04:15:30 user nova-compute[74805]:   <os>
Nov 15 04:15:30 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:15:30 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:15:30 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:15:30 user nova-compute[74805]:   </os>
Nov 15 04:15:30 user nova-compute[74805]:   <features>
Nov 15 04:15:30 user nova-compute[74805]:     <acpi/>
Nov 15 04:15:30 user nova-compute[74805]:     <apic/>
Nov 15 04:15:30 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:15:30 user nova-compute[74805]:   </features>
Nov 15 04:15:30 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:15:30 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:15:30 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:15:30 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:15:30 user nova-compute[74805]:   </clock>
Nov 15 04:15:30 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:15:30 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:15:30 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:15:30 user nova-compute[74805]:   </cpu>
Nov 15 04:15:30 user nova-compute[74805]:   <devices>
Nov 15 04:15:30 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:15:30 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:15:30 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk"/>
Nov 15 04:15:30 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:15:30 user nova-compute[74805]:     </disk>
Nov 15 04:15:30 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:15:30 user nova-compute[74805]:       <mac address="fa:16:3e:ff:8a:9e"/>
Nov 15 04:15:30 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:15:30 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:15:30 user nova-compute[74805]:       <target dev="tap333d7ad3-7a"/>
Nov 15 04:15:30 user nova-compute[74805]:     </interface>
Nov 15 04:15:30 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:15:30 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/console.log" append="off"/>
Nov 15 04:15:30 user nova-compute[74805]:     </serial>
Nov 15 04:15:30 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:15:30 user nova-compute[74805]:     <video>
Nov 15 04:15:30 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:15:30 user nova-compute[74805]:     </video>
Nov 15 04:15:30 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:15:30 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:15:30 user nova-compute[74805]:     </rng>
Nov 15 04:15:30 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:15:30 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:15:30 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:15:30 user nova-compute[74805]:     </memballoon>
Nov 15 04:15:30 user nova-compute[74805]:   </devices>
Nov 15 04:15:30 user nova-compute[74805]: </domain>
Nov 15 04:15:30 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-882338115',display_name='tempest-TestMinimumBasicScenario-server-882338115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-882338115',id=12,image_ref='c40fd4f6-246a-4fa8-80fa-f56a69d0386c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoM4mPJpNa3lSZNqZNye7yd+TzehokoE4PQcucjBnq3agpjLVjHz6yfP2n5YbekRY7ga7hrRvA9IilP2Z+bVGfBl94B2ikgCr8ddgEyR544o0t1jjaQlKeA+jJsJfPcaA==',key_name='tempest-TestMinimumBasicScenario-883673859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ddde64bc93cc40f189e1d0b6d948cd0a',ramdisk_id='',reservation_id='r-a1rc5i03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c40fd4f6-246a-4fa8-80fa-f56a69d0386c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-342422642',owner_user_name='tempest-TestMinimumBasicScenario-342422642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:15:28Z,user_data=None,user_id='eac59db39ba64883a64ab3133eaf1972',uuid=cad2eedf-c1ef-436c-b608-5b6dafa47451,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "333d7ad3-7a5b-49e8-a657-a712443ad922", "address": "fa:16:3e:ff:8a:9e", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333d7ad3-7a", "ovs_interfaceid": "333d7ad3-7a5b-49e8-a657-a712443ad922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Converting VIF {"id": "333d7ad3-7a5b-49e8-a657-a712443ad922", "address": "fa:16:3e:ff:8a:9e", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333d7ad3-7a", "ovs_interfaceid": "333d7ad3-7a5b-49e8-a657-a712443ad922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:8a:9e,bridge_name='br-int',has_traffic_filtering=True,id=333d7ad3-7a5b-49e8-a657-a712443ad922,network=Network(8408f959-0c0d-4a22-afa0-b51304c254ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333d7ad3-7a') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG os_vif [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:8a:9e,bridge_name='br-int',has_traffic_filtering=True,id=333d7ad3-7a5b-49e8-a657-a712443ad922,network=Network(8408f959-0c0d-4a22-afa0-b51304c254ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333d7ad3-7a') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ecacd528-58e5-5bb7-8a2e-e0526cd1ae74', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap333d7ad3-7a, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap333d7ad3-7a, col_values=(('qos', UUID('7899a5e9-c257-44cf-9431-65b92e60c1c4')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap333d7ad3-7a, col_values=(('external_ids', {'iface-id': '333d7ad3-7a5b-49e8-a657-a712443ad922', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:8a:9e', 'vm-uuid': 'cad2eedf-c1ef-436c-b608-5b6dafa47451'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:30 user nova-compute[74805]: INFO os_vif [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:8a:9e,bridge_name='br-int',has_traffic_filtering=True,id=333d7ad3-7a5b-49e8-a657-a712443ad922,network=Network(8408f959-0c0d-4a22-afa0-b51304c254ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333d7ad3-7a')
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] No VIF found with MAC fa:16:3e:ff:8a:9e, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.network.neutron [req-2f82fc5f-5c9f-4fc8-8298-eb56e439eb7a req-d1addb2e-e020-419a-91bb-a900118e4727 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Updated VIF entry in instance network info cache for port 333d7ad3-7a5b-49e8-a657-a712443ad922. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG nova.network.neutron [req-2f82fc5f-5c9f-4fc8-8298-eb56e439eb7a req-d1addb2e-e020-419a-91bb-a900118e4727 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Updating instance_info_cache with network_info: [{"id": "333d7ad3-7a5b-49e8-a657-a712443ad922", "address": "fa:16:3e:ff:8a:9e", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333d7ad3-7a", "ovs_interfaceid": "333d7ad3-7a5b-49e8-a657-a712443ad922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:15:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2f82fc5f-5c9f-4fc8-8298-eb56e439eb7a req-d1addb2e-e020-419a-91bb-a900118e4727 service nova] Releasing lock "refresh_cache-cad2eedf-c1ef-436c-b608-5b6dafa47451" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:15:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:32 user nova-compute[74805]: DEBUG nova.compute.manager [req-61ce5269-8dd9-4875-a462-4fcc79dc0842 req-06c5e6c8-649d-4c28-80e6-fa0c947158c3 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Received event network-vif-plugged-333d7ad3-7a5b-49e8-a657-a712443ad922 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-61ce5269-8dd9-4875-a462-4fcc79dc0842 req-06c5e6c8-649d-4c28-80e6-fa0c947158c3 service nova] Acquiring lock "cad2eedf-c1ef-436c-b608-5b6dafa47451-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-61ce5269-8dd9-4875-a462-4fcc79dc0842 req-06c5e6c8-649d-4c28-80e6-fa0c947158c3 service nova] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-61ce5269-8dd9-4875-a462-4fcc79dc0842 req-06c5e6c8-649d-4c28-80e6-fa0c947158c3 service nova] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:32 user nova-compute[74805]: DEBUG nova.compute.manager [req-61ce5269-8dd9-4875-a462-4fcc79dc0842 req-06c5e6c8-649d-4c28-80e6-fa0c947158c3 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] No waiting events found dispatching network-vif-plugged-333d7ad3-7a5b-49e8-a657-a712443ad922 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:15:32 user nova-compute[74805]: WARNING nova.compute.manager [req-61ce5269-8dd9-4875-a462-4fcc79dc0842 req-06c5e6c8-649d-4c28-80e6-fa0c947158c3 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Received unexpected event network-vif-plugged-333d7ad3-7a5b-49e8-a657-a712443ad922 for instance with vm_state building and task_state spawning.
Nov 15 04:15:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:34 user nova-compute[74805]: DEBUG nova.compute.manager [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:15:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:15:34 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Instance spawned successfully.
Nov 15 04:15:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:15:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:15:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:15:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:15:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:15:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:15:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:15:34 user nova-compute[74805]: DEBUG nova.compute.manager [req-bcdcd4f7-e237-4eee-b506-378149c96067 req-e0d47951-c788-4eb3-ab81-86946722c757 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Received event network-vif-plugged-333d7ad3-7a5b-49e8-a657-a712443ad922 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bcdcd4f7-e237-4eee-b506-378149c96067 req-e0d47951-c788-4eb3-ab81-86946722c757 service nova] Acquiring lock "cad2eedf-c1ef-436c-b608-5b6dafa47451-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bcdcd4f7-e237-4eee-b506-378149c96067 req-e0d47951-c788-4eb3-ab81-86946722c757 service nova] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bcdcd4f7-e237-4eee-b506-378149c96067 req-e0d47951-c788-4eb3-ab81-86946722c757 service nova] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:34 user nova-compute[74805]: DEBUG nova.compute.manager [req-bcdcd4f7-e237-4eee-b506-378149c96067 req-e0d47951-c788-4eb3-ab81-86946722c757 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] No waiting events found dispatching network-vif-plugged-333d7ad3-7a5b-49e8-a657-a712443ad922 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:15:34 user nova-compute[74805]: WARNING nova.compute.manager [req-bcdcd4f7-e237-4eee-b506-378149c96067 req-e0d47951-c788-4eb3-ab81-86946722c757 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Received unexpected event network-vif-plugged-333d7ad3-7a5b-49e8-a657-a712443ad922 for instance with vm_state building and task_state spawning.
Nov 15 04:15:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:34 user nova-compute[74805]: INFO nova.compute.manager [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Took 6.15 seconds to spawn the instance on the hypervisor.
Nov 15 04:15:34 user nova-compute[74805]: DEBUG nova.compute.manager [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:15:34 user nova-compute[74805]: INFO nova.compute.manager [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Took 7.31 seconds to build instance.
Nov 15 04:15:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c9905d34-a7b1-483e-bf0d-e0ead50618df tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.411s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Acquiring lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:53 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:15:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:53 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:15:53 user nova-compute[74805]: INFO nova.compute.claims [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Claim successful on node user
Nov 15 04:15:54 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:15:54 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:15:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:54 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:15:54 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:15:54 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:15:54 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:15:54 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:15:54 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:54 user nova-compute[74805]: DEBUG nova.policy [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6db3bb1be1914a19afb67cac89f0a35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18dc7dbc597f4befb565dcff5a92db74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:15:54 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:15:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:15:54 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Creating image(s)
Nov 15 04:15:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Acquiring lock "/opt/stack/data/nova/instances/78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "/opt/stack/data/nova/instances/78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "/opt/stack/data/nova/instances/78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.249s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.164s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff/disk 1073741824" returned: 0 in 0.043s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:55 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Successfully created port: 48712489-c49e-4e52-9c79-fc1a1aa13077 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:15:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.173s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:55 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Checking if we can resize image /opt/stack/data/nova/instances/78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:15:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:55 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Cannot resize image /opt/stack/data/nova/instances/78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:15:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:15:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Ensure instance console log exists: /opt/stack/data/nova/instances/78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:15:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:55 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Successfully updated port: 48712489-c49e-4e52-9c79-fc1a1aa13077 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:15:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Acquiring lock "refresh_cache-78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:15:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Acquired lock "refresh_cache-78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:15:55 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:15:55 user nova-compute[74805]: DEBUG nova.compute.manager [req-e3b1c9bc-666a-4125-a764-19038af6c83e req-f7708399-d26a-4ceb-a482-9e4077dec22a service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Received event network-changed-48712489-c49e-4e52-9c79-fc1a1aa13077 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:55 user nova-compute[74805]: DEBUG nova.compute.manager [req-e3b1c9bc-666a-4125-a764-19038af6c83e req-f7708399-d26a-4ceb-a482-9e4077dec22a service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Refreshing instance network info cache due to event network-changed-48712489-c49e-4e52-9c79-fc1a1aa13077. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:15:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e3b1c9bc-666a-4125-a764-19038af6c83e req-f7708399-d26a-4ceb-a482-9e4077dec22a service nova] Acquiring lock "refresh_cache-78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:15:55 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Updating instance_info_cache with network_info: [{"id": "48712489-c49e-4e52-9c79-fc1a1aa13077", "address": "fa:16:3e:1f:3c:ac", "network": {"id": "d6c12b22-58d0-4d38-aa41-0e08de44bb3a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1369824742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dc7dbc597f4befb565dcff5a92db74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48712489-c4", "ovs_interfaceid": "48712489-c49e-4e52-9c79-fc1a1aa13077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Releasing lock "refresh_cache-78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Instance network_info: |[{"id": "48712489-c49e-4e52-9c79-fc1a1aa13077", "address": "fa:16:3e:1f:3c:ac", "network": {"id": "d6c12b22-58d0-4d38-aa41-0e08de44bb3a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1369824742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dc7dbc597f4befb565dcff5a92db74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48712489-c4", "ovs_interfaceid": "48712489-c49e-4e52-9c79-fc1a1aa13077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e3b1c9bc-666a-4125-a764-19038af6c83e req-f7708399-d26a-4ceb-a482-9e4077dec22a service nova] Acquired lock "refresh_cache-78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.network.neutron [req-e3b1c9bc-666a-4125-a764-19038af6c83e req-f7708399-d26a-4ceb-a482-9e4077dec22a service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Refreshing network info cache for port 48712489-c49e-4e52-9c79-fc1a1aa13077 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Start _get_guest_xml network_info=[{"id": "48712489-c49e-4e52-9c79-fc1a1aa13077", "address": "fa:16:3e:1f:3c:ac", "network": {"id": "d6c12b22-58d0-4d38-aa41-0e08de44bb3a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1369824742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dc7dbc597f4befb565dcff5a92db74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48712489-c4", "ovs_interfaceid": "48712489-c49e-4e52-9c79-fc1a1aa13077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:15:56 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:15:56 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:15:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2059736734',display_name='tempest-ServersNegativeTestJSON-server-2059736734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2059736734',id=13,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18dc7dbc597f4befb565dcff5a92db74',ramdisk_id='',reservation_id='r-rc6ytc54',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2049948325',owner_user_name='tempest-ServersNegativeTestJSON-2049948325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:15:54Z,user_data=None,user_id='6db3bb1be1914a19afb67cac89f0a35e',uuid=78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48712489-c49e-4e52-9c79-fc1a1aa13077", "address": "fa:16:3e:1f:3c:ac", "network": {"id": "d6c12b22-58d0-4d38-aa41-0e08de44bb3a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1369824742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dc7dbc597f4befb565dcff5a92db74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48712489-c4", "ovs_interfaceid": "48712489-c49e-4e52-9c79-fc1a1aa13077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Converting VIF {"id": "48712489-c49e-4e52-9c79-fc1a1aa13077", "address": "fa:16:3e:1f:3c:ac", "network": {"id": "d6c12b22-58d0-4d38-aa41-0e08de44bb3a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1369824742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dc7dbc597f4befb565dcff5a92db74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48712489-c4", "ovs_interfaceid": "48712489-c49e-4e52-9c79-fc1a1aa13077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3c:ac,bridge_name='br-int',has_traffic_filtering=True,id=48712489-c49e-4e52-9c79-fc1a1aa13077,network=Network(d6c12b22-58d0-4d38-aa41-0e08de44bb3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48712489-c4') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.objects.instance [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lazy-loading 'pci_devices' on Instance uuid 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:15:56 user nova-compute[74805]:   <uuid>78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff</uuid>
Nov 15 04:15:56 user nova-compute[74805]:   <name>instance-0000000d</name>
Nov 15 04:15:56 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:15:56 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:15:56 user nova-compute[74805]:   <metadata>
Nov 15 04:15:56 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:15:56 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:15:56 user nova-compute[74805]:       <nova:name>tempest-ServersNegativeTestJSON-server-2059736734</nova:name>
Nov 15 04:15:56 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:15:56</nova:creationTime>
Nov 15 04:15:56 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:15:56 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:15:56 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:15:56 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:15:56 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:15:56 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:15:56 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:15:56 user nova-compute[74805]:       <nova:owner>
Nov 15 04:15:56 user nova-compute[74805]:         <nova:user uuid="6db3bb1be1914a19afb67cac89f0a35e">tempest-ServersNegativeTestJSON-2049948325-project-member</nova:user>
Nov 15 04:15:56 user nova-compute[74805]:         <nova:project uuid="18dc7dbc597f4befb565dcff5a92db74">tempest-ServersNegativeTestJSON-2049948325</nova:project>
Nov 15 04:15:56 user nova-compute[74805]:       </nova:owner>
Nov 15 04:15:56 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:15:56 user nova-compute[74805]:       <nova:ports>
Nov 15 04:15:56 user nova-compute[74805]:         <nova:port uuid="48712489-c49e-4e52-9c79-fc1a1aa13077">
Nov 15 04:15:56 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 04:15:56 user nova-compute[74805]:         </nova:port>
Nov 15 04:15:56 user nova-compute[74805]:       </nova:ports>
Nov 15 04:15:56 user nova-compute[74805]:     </nova:instance>
Nov 15 04:15:56 user nova-compute[74805]:   </metadata>
Nov 15 04:15:56 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:15:56 user nova-compute[74805]:     <system>
Nov 15 04:15:56 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:15:56 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:15:56 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:15:56 user nova-compute[74805]:       <entry name="serial">78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff</entry>
Nov 15 04:15:56 user nova-compute[74805]:       <entry name="uuid">78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff</entry>
Nov 15 04:15:56 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:15:56 user nova-compute[74805]:     </system>
Nov 15 04:15:56 user nova-compute[74805]:   </sysinfo>
Nov 15 04:15:56 user nova-compute[74805]:   <os>
Nov 15 04:15:56 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:15:56 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:15:56 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:15:56 user nova-compute[74805]:   </os>
Nov 15 04:15:56 user nova-compute[74805]:   <features>
Nov 15 04:15:56 user nova-compute[74805]:     <acpi/>
Nov 15 04:15:56 user nova-compute[74805]:     <apic/>
Nov 15 04:15:56 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:15:56 user nova-compute[74805]:   </features>
Nov 15 04:15:56 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:15:56 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:15:56 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:15:56 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:15:56 user nova-compute[74805]:   </clock>
Nov 15 04:15:56 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:15:56 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:15:56 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:15:56 user nova-compute[74805]:   </cpu>
Nov 15 04:15:56 user nova-compute[74805]:   <devices>
Nov 15 04:15:56 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:15:56 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:15:56 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff/disk"/>
Nov 15 04:15:56 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:15:56 user nova-compute[74805]:     </disk>
Nov 15 04:15:56 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:15:56 user nova-compute[74805]:       <mac address="fa:16:3e:1f:3c:ac"/>
Nov 15 04:15:56 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:15:56 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:15:56 user nova-compute[74805]:       <target dev="tap48712489-c4"/>
Nov 15 04:15:56 user nova-compute[74805]:     </interface>
Nov 15 04:15:56 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:15:56 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff/console.log" append="off"/>
Nov 15 04:15:56 user nova-compute[74805]:     </serial>
Nov 15 04:15:56 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:15:56 user nova-compute[74805]:     <video>
Nov 15 04:15:56 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:15:56 user nova-compute[74805]:     </video>
Nov 15 04:15:56 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:15:56 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:15:56 user nova-compute[74805]:     </rng>
Nov 15 04:15:56 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:15:56 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:15:56 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:15:56 user nova-compute[74805]:     </memballoon>
Nov 15 04:15:56 user nova-compute[74805]:   </devices>
Nov 15 04:15:56 user nova-compute[74805]: </domain>
Nov 15 04:15:56 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:15:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2059736734',display_name='tempest-ServersNegativeTestJSON-server-2059736734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2059736734',id=13,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18dc7dbc597f4befb565dcff5a92db74',ramdisk_id='',reservation_id='r-rc6ytc54',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2049948325',owner_user_name='tempest-ServersNegativeTestJSON-2049948325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:15:54Z,user_data=None,user_id='6db3bb1be1914a19afb67cac89f0a35e',uuid=78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48712489-c49e-4e52-9c79-fc1a1aa13077", "address": "fa:16:3e:1f:3c:ac", "network": {"id": "d6c12b22-58d0-4d38-aa41-0e08de44bb3a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1369824742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dc7dbc597f4befb565dcff5a92db74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48712489-c4", "ovs_interfaceid": "48712489-c49e-4e52-9c79-fc1a1aa13077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Converting VIF {"id": "48712489-c49e-4e52-9c79-fc1a1aa13077", "address": "fa:16:3e:1f:3c:ac", "network": {"id": "d6c12b22-58d0-4d38-aa41-0e08de44bb3a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1369824742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dc7dbc597f4befb565dcff5a92db74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48712489-c4", "ovs_interfaceid": "48712489-c49e-4e52-9c79-fc1a1aa13077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3c:ac,bridge_name='br-int',has_traffic_filtering=True,id=48712489-c49e-4e52-9c79-fc1a1aa13077,network=Network(d6c12b22-58d0-4d38-aa41-0e08de44bb3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48712489-c4') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG os_vif [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3c:ac,bridge_name='br-int',has_traffic_filtering=True,id=48712489-c49e-4e52-9c79-fc1a1aa13077,network=Network(d6c12b22-58d0-4d38-aa41-0e08de44bb3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48712489-c4') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '178fef07-bf6f-5488-a952-b41f65edc513', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48712489-c4, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48712489-c4, col_values=(('qos', UUID('035a5c1e-8104-47ec-bc9d-d0f99acf84e6')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48712489-c4, col_values=(('external_ids', {'iface-id': '48712489-c49e-4e52-9c79-fc1a1aa13077', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:3c:ac', 'vm-uuid': '78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:56 user nova-compute[74805]: INFO os_vif [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3c:ac,bridge_name='br-int',has_traffic_filtering=True,id=48712489-c49e-4e52-9c79-fc1a1aa13077,network=Network(d6c12b22-58d0-4d38-aa41-0e08de44bb3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48712489-c4')
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] No VIF found with MAC fa:16:3e:1f:3c:ac, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.network.neutron [req-e3b1c9bc-666a-4125-a764-19038af6c83e req-f7708399-d26a-4ceb-a482-9e4077dec22a service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Updated VIF entry in instance network info cache for port 48712489-c49e-4e52-9c79-fc1a1aa13077. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG nova.network.neutron [req-e3b1c9bc-666a-4125-a764-19038af6c83e req-f7708399-d26a-4ceb-a482-9e4077dec22a service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Updating instance_info_cache with network_info: [{"id": "48712489-c49e-4e52-9c79-fc1a1aa13077", "address": "fa:16:3e:1f:3c:ac", "network": {"id": "d6c12b22-58d0-4d38-aa41-0e08de44bb3a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1369824742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dc7dbc597f4befb565dcff5a92db74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48712489-c4", "ovs_interfaceid": "48712489-c49e-4e52-9c79-fc1a1aa13077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:15:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e3b1c9bc-666a-4125-a764-19038af6c83e req-f7708399-d26a-4ceb-a482-9e4077dec22a service nova] Releasing lock "refresh_cache-78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:15:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Acquiring lock "2921f743-66d5-47c1-b2e4-1b6957a2d550" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lock "2921f743-66d5-47c1-b2e4-1b6957a2d550" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:57 user nova-compute[74805]: DEBUG nova.objects.instance [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lazy-loading 'flavor' on Instance uuid 2921f743-66d5-47c1-b2e4-1b6957a2d550 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:15:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lock "2921f743-66d5-47c1-b2e4-1b6957a2d550" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Acquiring lock "2921f743-66d5-47c1-b2e4-1b6957a2d550" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lock "2921f743-66d5-47c1-b2e4-1b6957a2d550" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:57 user nova-compute[74805]: INFO nova.compute.manager [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Attaching volume 0e749fbb-672f-4711-b988-7a7bd0eed411 to /dev/vdb
Nov 15 04:15:57 user nova-compute[74805]: DEBUG os_brick.utils [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:15:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:57 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[92302720-1cd9-49e6-bc79-709bab0401d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:57 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b1c571-ad57-464a-ad72-c5249e777d9f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:15:57 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e434a0fc-9c33-4f96-be0f-f5b09e773a39]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:57 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec11e6d-2e68-458b-b425-1bf2ac36a55e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:15:57 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:15:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:15:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:15:57 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:15:57 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[af499a0c-5a8a-446d-bcdd-cd432732da07]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:15:57 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:15:57 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:15:57 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:15:57 user nova-compute[74805]: DEBUG os_brick.utils [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:15:57 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Updating existing volume attachment record: c3cba24f-e1c4-412c-af9c-b351522f0ff6 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:15:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:58 user nova-compute[74805]: DEBUG nova.compute.manager [req-3483205f-736a-4048-a660-321d475bd70a req-7a5df6f2-702f-427e-bb34-dc6792b8de0e service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Received event network-vif-plugged-48712489-c49e-4e52-9c79-fc1a1aa13077 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:15:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3483205f-736a-4048-a660-321d475bd70a req-7a5df6f2-702f-427e-bb34-dc6792b8de0e service nova] Acquiring lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:15:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3483205f-736a-4048-a660-321d475bd70a req-7a5df6f2-702f-427e-bb34-dc6792b8de0e service nova] Lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:15:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3483205f-736a-4048-a660-321d475bd70a req-7a5df6f2-702f-427e-bb34-dc6792b8de0e service nova] Lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:15:58 user nova-compute[74805]: DEBUG nova.compute.manager [req-3483205f-736a-4048-a660-321d475bd70a req-7a5df6f2-702f-427e-bb34-dc6792b8de0e service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] No waiting events found dispatching network-vif-plugged-48712489-c49e-4e52-9c79-fc1a1aa13077 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:15:58 user nova-compute[74805]: WARNING nova.compute.manager [req-3483205f-736a-4048-a660-321d475bd70a req-7a5df6f2-702f-427e-bb34-dc6792b8de0e service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Received unexpected event network-vif-plugged-48712489-c49e-4e52-9c79-fc1a1aa13077 for instance with vm_state building and task_state spawning.
Nov 15 04:15:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:15:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:00 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:16:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:00 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:16:00 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:16:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:16:00 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Instance spawned successfully.
Nov 15 04:16:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:16:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:16:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:16:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:16:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:16:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:16:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:16:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:00 user nova-compute[74805]: INFO nova.compute.manager [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Took 5.91 seconds to spawn the instance on the hypervisor.
Nov 15 04:16:00 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:16:00 user nova-compute[74805]: INFO nova.compute.manager [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Took 6.66 seconds to build instance.
Nov 15 04:16:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb86d7f8-bcc9-4219-a61e-a1c0e17661cb tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.780s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-0ee3e858-847a-4215-8d7e-7f998078c419 req-32448fe6-7b06-44fa-bb9c-0194d155e8c1 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Received event network-changed-2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-0ee3e858-847a-4215-8d7e-7f998078c419 req-32448fe6-7b06-44fa-bb9c-0194d155e8c1 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Refreshing instance network info cache due to event network-changed-2bdff360-1f21-4ce8-9c04-a5115a3316b2. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:16:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0ee3e858-847a-4215-8d7e-7f998078c419 req-32448fe6-7b06-44fa-bb9c-0194d155e8c1 service nova] Acquiring lock "refresh_cache-39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:16:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0ee3e858-847a-4215-8d7e-7f998078c419 req-32448fe6-7b06-44fa-bb9c-0194d155e8c1 service nova] Acquired lock "refresh_cache-39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:16:00 user nova-compute[74805]: DEBUG nova.network.neutron [req-0ee3e858-847a-4215-8d7e-7f998078c419 req-32448fe6-7b06-44fa-bb9c-0194d155e8c1 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Refreshing network info cache for port 2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:16:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG nova.network.neutron [req-0ee3e858-847a-4215-8d7e-7f998078c419 req-32448fe6-7b06-44fa-bb9c-0194d155e8c1 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Updated VIF entry in instance network info cache for port 2bdff360-1f21-4ce8-9c04-a5115a3316b2. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG nova.network.neutron [req-0ee3e858-847a-4215-8d7e-7f998078c419 req-32448fe6-7b06-44fa-bb9c-0194d155e8c1 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Updating instance_info_cache with network_info: [{"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0ee3e858-847a-4215-8d7e-7f998078c419 req-32448fe6-7b06-44fa-bb9c-0194d155e8c1 service nova] Releasing lock "refresh_cache-39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG nova.compute.manager [req-0ee3e858-847a-4215-8d7e-7f998078c419 req-32448fe6-7b06-44fa-bb9c-0194d155e8c1 service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Received event network-vif-plugged-48712489-c49e-4e52-9c79-fc1a1aa13077 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0ee3e858-847a-4215-8d7e-7f998078c419 req-32448fe6-7b06-44fa-bb9c-0194d155e8c1 service nova] Acquiring lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0ee3e858-847a-4215-8d7e-7f998078c419 req-32448fe6-7b06-44fa-bb9c-0194d155e8c1 service nova] Lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0ee3e858-847a-4215-8d7e-7f998078c419 req-32448fe6-7b06-44fa-bb9c-0194d155e8c1 service nova] Lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG nova.compute.manager [req-0ee3e858-847a-4215-8d7e-7f998078c419 req-32448fe6-7b06-44fa-bb9c-0194d155e8c1 service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] No waiting events found dispatching network-vif-plugged-48712489-c49e-4e52-9c79-fc1a1aa13077 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:16:01 user nova-compute[74805]: WARNING nova.compute.manager [req-0ee3e858-847a-4215-8d7e-7f998078c419 req-32448fe6-7b06-44fa-bb9c-0194d155e8c1 service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Received unexpected event network-vif-plugged-48712489-c49e-4e52-9c79-fc1a1aa13077 for instance with vm_state active and task_state None.
Nov 15 04:16:01 user nova-compute[74805]: DEBUG nova.compute.manager [req-0ee3e858-847a-4215-8d7e-7f998078c419 req-32448fe6-7b06-44fa-bb9c-0194d155e8c1 service nova] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Received event network-changed-94bbd0d6-bf79-45aa-b274-8a9b44dd26ab {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG nova.compute.manager [req-0ee3e858-847a-4215-8d7e-7f998078c419 req-32448fe6-7b06-44fa-bb9c-0194d155e8c1 service nova] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Refreshing instance network info cache due to event network-changed-94bbd0d6-bf79-45aa-b274-8a9b44dd26ab. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0ee3e858-847a-4215-8d7e-7f998078c419 req-32448fe6-7b06-44fa-bb9c-0194d155e8c1 service nova] Acquiring lock "refresh_cache-1eb9b315-77a9-40f7-8a43-8c40186a0dca" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0ee3e858-847a-4215-8d7e-7f998078c419 req-32448fe6-7b06-44fa-bb9c-0194d155e8c1 service nova] Acquired lock "refresh_cache-1eb9b315-77a9-40f7-8a43-8c40186a0dca" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG nova.network.neutron [req-0ee3e858-847a-4215-8d7e-7f998078c419 req-32448fe6-7b06-44fa-bb9c-0194d155e8c1 service nova] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Refreshing network info cache for port 94bbd0d6-bf79-45aa-b274-8a9b44dd26ab {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG nova.objects.instance [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lazy-loading 'flavor' on Instance uuid 1eb9b315-77a9-40f7-8a43-8c40186a0dca {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2921f743-66d5-47c1-b2e4-1b6957a2d550/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.205s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2921f743-66d5-47c1-b2e4-1b6957a2d550/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2921f743-66d5-47c1-b2e4-1b6957a2d550/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:01 user nova-compute[74805]: INFO nova.compute.manager [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Attaching volume b93c3226-0ddd-46ac-bfbe-bae1d26366c6 to /dev/vdb
Nov 15 04:16:01 user nova-compute[74805]: DEBUG nova.network.neutron [req-0ee3e858-847a-4215-8d7e-7f998078c419 req-32448fe6-7b06-44fa-bb9c-0194d155e8c1 service nova] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Updated VIF entry in instance network info cache for port 94bbd0d6-bf79-45aa-b274-8a9b44dd26ab. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG nova.network.neutron [req-0ee3e858-847a-4215-8d7e-7f998078c419 req-32448fe6-7b06-44fa-bb9c-0194d155e8c1 service nova] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Updating instance_info_cache with network_info: [{"id": "94bbd0d6-bf79-45aa-b274-8a9b44dd26ab", "address": "fa:16:3e:80:32:cf", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94bbd0d6-bf", "ovs_interfaceid": "94bbd0d6-bf79-45aa-b274-8a9b44dd26ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:16:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0ee3e858-847a-4215-8d7e-7f998078c419 req-32448fe6-7b06-44fa-bb9c-0194d155e8c1 service nova] Releasing lock "refresh_cache-1eb9b315-77a9-40f7-8a43-8c40186a0dca" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG os_brick.utils [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[03099e1a-df84-43c3-895e-9f9f85a54a59]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2921f743-66d5-47c1-b2e4-1b6957a2d550/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a66b43-0ab4-4544-b2b8-2b65c54667f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f490294-db65-4910-97f0-23221d0d5926]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[679deb5d-844b-4330-8457-d48082fcd64f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:16:02 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:16:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b249c0-6edf-40c3-9e45-754cc5b6eed4]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG os_brick.utils [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] <== get_connector_properties: return (202ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Updating existing volume attachment record: 43949b3f-ce00-4379-bdae-8119c3cd7305 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG nova.compute.manager [None req-38e7f889-593d-484d-b9fb-b6327f6e7513 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:02 user nova-compute[74805]: INFO nova.compute.manager [None req-38e7f889-593d-484d-b9fb-b6327f6e7513 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] instance snapshotting
Nov 15 04:16:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.410s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:02 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-38e7f889-593d-484d-b9fb-b6327f6e7513 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Beginning live snapshot process
Nov 15 04:16:02 user nova-compute[74805]: DEBUG nova.compute.manager [req-8251cc53-100a-48d1-982c-181acdd84f0f req-c34e4b0b-b1f7-464a-b096-18c509b23877 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Received event network-changed-9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG nova.compute.manager [req-8251cc53-100a-48d1-982c-181acdd84f0f req-c34e4b0b-b1f7-464a-b096-18c509b23877 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Refreshing instance network info cache due to event network-changed-9f426f7d-ce70-41ba-affa-652a4f62a571. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8251cc53-100a-48d1-982c-181acdd84f0f req-c34e4b0b-b1f7-464a-b096-18c509b23877 service nova] Acquiring lock "refresh_cache-0de78a8a-d66a-4703-a044-89c2f2006860" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8251cc53-100a-48d1-982c-181acdd84f0f req-c34e4b0b-b1f7-464a-b096-18c509b23877 service nova] Acquired lock "refresh_cache-0de78a8a-d66a-4703-a044-89c2f2006860" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:16:02 user nova-compute[74805]: DEBUG nova.network.neutron [req-8251cc53-100a-48d1-982c-181acdd84f0f req-c34e4b0b-b1f7-464a-b096-18c509b23877 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Refreshing network info cache for port 9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'raTxytFL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:16:03 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:16:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:16:03 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:16:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:16:03 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9c46ff-7e18-4456-808e-894b6e22893b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:16:03 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3983664-2d33-43f9-93e8-66d8a7f8df8f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411] added
Nov 15 04:16:03 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66d7b00-7aae-4cf2-8e5f-6e6f8adf063e]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eab6495-0666-4e79-8dcb-6fa43ec37a89]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v raTxytFL {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-38e7f889-593d-484d-b9fb-b6327f6e7513 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json -f qcow2 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v raTxytFL" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e215104-d074-4909-8d1b-66ff22bf16a0]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'raTxytFL'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce326d72-51dd-4d92-ac7b-3326aff419e9]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ae495e-80f6-4065-a3af-0f6c1a6e563a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:03 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:03 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:03 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:03 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:03 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:03 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:03 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:03 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-38e7f889-593d-484d-b9fb-b6327f6e7513 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json -f qcow2" returned: 0 in 0.211s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0f4d7a-cd93-4a47-b2ce-904327294612]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-38e7f889-593d-484d-b9fb-b6327f6e7513 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json -f qcow2 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411, portal: 172.16.0.220,3260]
Nov 15 04:16:03 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411, portal: 172.16.0.220,3260] successful.
Nov 15 04:16:03 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG nova.network.neutron [req-8251cc53-100a-48d1-982c-181acdd84f0f req-c34e4b0b-b1f7-464a-b096-18c509b23877 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Updated VIF entry in instance network info cache for port 9f426f7d-ce70-41ba-affa-652a4f62a571. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG nova.network.neutron [req-8251cc53-100a-48d1-982c-181acdd84f0f req-c34e4b0b-b1f7-464a-b096-18c509b23877 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Updating instance_info_cache with network_info: [{"id": "9f426f7d-ce70-41ba-affa-652a4f62a571", "address": "fa:16:3e:74:98:ab", "network": {"id": "e6f9095e-b477-4654-9fb7-7322e7bb3b9d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1108878484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc936c67de2046ff82115c5ebdb8c844", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f426f7d-ce", "ovs_interfaceid": "9f426f7d-ce70-41ba-affa-652a4f62a571", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80d2b4a-0ad4-4145-90f8-5a685be06809]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8251cc53-100a-48d1-982c-181acdd84f0f req-c34e4b0b-b1f7-464a-b096-18c509b23877 service nova] Releasing lock "refresh_cache-0de78a8a-d66a-4703-a044-89c2f2006860" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG nova.compute.manager [req-8251cc53-100a-48d1-982c-181acdd84f0f req-c34e4b0b-b1f7-464a-b096-18c509b23877 service nova] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Received event network-changed-0d0a11b6-25c5-4478-8c6f-40ac41f83b3d {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG nova.compute.manager [req-8251cc53-100a-48d1-982c-181acdd84f0f req-c34e4b0b-b1f7-464a-b096-18c509b23877 service nova] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Refreshing instance network info cache due to event network-changed-0d0a11b6-25c5-4478-8c6f-40ac41f83b3d. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8251cc53-100a-48d1-982c-181acdd84f0f req-c34e4b0b-b1f7-464a-b096-18c509b23877 service nova] Acquiring lock "refresh_cache-d63f3726-27df-455f-bda0-3ddca95b70d9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8251cc53-100a-48d1-982c-181acdd84f0f req-c34e4b0b-b1f7-464a-b096-18c509b23877 service nova] Acquired lock "refresh_cache-d63f3726-27df-455f-bda0-3ddca95b70d9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG nova.network.neutron [req-8251cc53-100a-48d1-982c-181acdd84f0f req-c34e4b0b-b1f7-464a-b096-18c509b23877 service nova] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Refreshing network info cache for port 0d0a11b6-25c5-4478-8c6f-40ac41f83b3d {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[16712414-172d-43f4-8c49-26d35e551499]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:03 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:03 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:03 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:03 user nova-compute[74805]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 (non-flash)
Nov 15 04:16:03 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:03 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:03 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:03 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:03 user nova-compute[74805]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 (non-flash)
Nov 15 04:16:03 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.458s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2b5d6a-5b51-4ed6-9eec-3300abc240c5]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'raTxytFL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-38e7f889-593d-484d-b9fb-b6327f6e7513 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-38e7f889-593d-484d-b9fb-b6327f6e7513 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdf3e90f-4fd8-4da4-a888-48c7a80fb209/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-38e7f889-593d-484d-b9fb-b6327f6e7513 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.221s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-38e7f889-593d-484d-b9fb-b6327f6e7513 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprofpgfsf/f2ce7c05164e419e9b5bf9b4a63463cf.delta 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-38e7f889-593d-484d-b9fb-b6327f6e7513 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprofpgfsf/f2ce7c05164e419e9b5bf9b4a63463cf.delta 1073741824" returned: 0 in 0.053s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:03 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-38e7f889-593d-484d-b9fb-b6327f6e7513 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 04:16:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-38e7f889-593d-484d-b9fb-b6327f6e7513 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74805) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 15 04:16:03 user nova-compute[74805]: INFO nova.virt.libvirt.host [None req-38e7f889-593d-484d-b9fb-b6327f6e7513 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] UEFI support detected
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdf3e90f-4fd8-4da4-a888-48c7a80fb209/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdf3e90f-4fd8-4da4-a888-48c7a80fb209/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdf3e90f-4fd8-4da4-a888-48c7a80fb209/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:04 user nova-compute[74805]: DEBUG nova.network.neutron [req-8251cc53-100a-48d1-982c-181acdd84f0f req-c34e4b0b-b1f7-464a-b096-18c509b23877 service nova] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Updated VIF entry in instance network info cache for port 0d0a11b6-25c5-4478-8c6f-40ac41f83b3d. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:16:04 user nova-compute[74805]: DEBUG nova.network.neutron [req-8251cc53-100a-48d1-982c-181acdd84f0f req-c34e4b0b-b1f7-464a-b096-18c509b23877 service nova] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Updating instance_info_cache with network_info: [{"id": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "address": "fa:16:3e:b1:3d:ff", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d0a11b6-25", "ovs_interfaceid": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:16:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8251cc53-100a-48d1-982c-181acdd84f0f req-c34e4b0b-b1f7-464a-b096-18c509b23877 service nova] Releasing lock "refresh_cache-d63f3726-27df-455f-bda0-3ddca95b70d9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:16:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:04 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.516s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:16:04 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] <== connect_volume: return (1520ms) {'type': 'block', 'scsi_wwn': '23036393137393532', 'path': '/dev/sdf'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:16:04 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036393137393532', 'path': '/dev/sdf'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:16:04 user nova-compute[74805]: DEBUG nova.objects.instance [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lazy-loading 'flavor' on Instance uuid 2921f743-66d5-47c1-b2e4-1b6957a2d550 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:16:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:04 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:16:04 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:16:04 user nova-compute[74805]:   <source dev="/dev/sdf"/>
Nov 15 04:16:04 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:16:04 user nova-compute[74805]:   <serial>0e749fbb-672f-4711-b988-7a7bd0eed411</serial>
Nov 15 04:16:04 user nova-compute[74805]: </disk>
Nov 15 04:16:04 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:16:04 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-38e7f889-593d-484d-b9fb-b6327f6e7513 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] COPY block job progress, current cursor: 524288 final cursor: 75497472 {{(pid=74805) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 04:16:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json" returned: 0 in 0.411s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-38e7f889-593d-484d-b9fb-b6327f6e7513 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] COPY block job progress, current cursor: 17956864 final cursor: 75497472 {{(pid=74805) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 04:16:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:16:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:16:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] No VIF found with MAC fa:16:3e:12:75:7a, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:16:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-870354c1-6591-474b-9aa8-3532e9e99411 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lock "2921f743-66d5-47c1-b2e4-1b6957a2d550" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.983s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89dcacb0-6864-4529-903d-ae46a2dc3bdd/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-38e7f889-593d-484d-b9fb-b6327f6e7513 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74805) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 04:16:05 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-38e7f889-593d-484d-b9fb-b6327f6e7513 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 04:16:05 user nova-compute[74805]: DEBUG nova.privsep.utils [None req-38e7f889-593d-484d-b9fb-b6327f6e7513 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74805) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 04:16:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-38e7f889-593d-484d-b9fb-b6327f6e7513 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprofpgfsf/f2ce7c05164e419e9b5bf9b4a63463cf.delta /opt/stack/data/nova/instances/snapshots/tmprofpgfsf/f2ce7c05164e419e9b5bf9b4a63463cf {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89dcacb0-6864-4529-903d-ae46a2dc3bdd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89dcacb0-6864-4529-903d-ae46a2dc3bdd/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89dcacb0-6864-4529-903d-ae46a2dc3bdd/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-38e7f889-593d-484d-b9fb-b6327f6e7513 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprofpgfsf/f2ce7c05164e419e9b5bf9b4a63463cf.delta /opt/stack/data/nova/instances/snapshots/tmprofpgfsf/f2ce7c05164e419e9b5bf9b4a63463cf" returned: 0 in 0.885s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:06 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-38e7f889-593d-484d-b9fb-b6327f6e7513 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Snapshot extracted, beginning image upload
Nov 15 04:16:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Acquiring lock "2921f743-66d5-47c1-b2e4-1b6957a2d550" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lock "2921f743-66d5-47c1-b2e4-1b6957a2d550" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Acquiring lock "2921f743-66d5-47c1-b2e4-1b6957a2d550-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lock "2921f743-66d5-47c1-b2e4-1b6957a2d550-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lock "2921f743-66d5-47c1-b2e4-1b6957a2d550-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:06 user nova-compute[74805]: INFO nova.compute.manager [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Terminating instance
Nov 15 04:16:06 user nova-compute[74805]: DEBUG nova.compute.manager [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:16:06 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:16:06 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:16:06 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=6574MB free_disk=25.482295989990234GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:16:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 2b1e540c-6226-445a-bd45-5b7b8807e2b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 2921f743-66d5-47c1-b2e4-1b6957a2d550 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 1eb9b315-77a9-40f7-8a43-8c40186a0dca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 0de78a8a-d66a-4703-a044-89c2f2006860 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance d63f3726-27df-455f-bda0-3ddca95b70d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance e91a656c-66d6-4a70-a115-8c03ed964f94 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 05f49324-4b7a-4cd4-ada5-9450b9bf1d70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance fdf3e90f-4fd8-4da4-a888-48c7a80fb209 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 89dcacb0-6864-4529-903d-ae46a2dc3bdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance e1a3273f-42d2-4582-b539-3c7c6111cf3c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance cad2eedf-c1ef-436c-b608-5b6dafa47451 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG nova.compute.manager [req-611f7c63-9687-41a3-939e-37fd88644893 req-f2669b99-99f8-4451-ba6d-a979a690d8b2 service nova] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Received event network-vif-unplugged-ffbc1668-bf57-488c-b543-d7a288eab7a7 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-611f7c63-9687-41a3-939e-37fd88644893 req-f2669b99-99f8-4451-ba6d-a979a690d8b2 service nova] Acquiring lock "2921f743-66d5-47c1-b2e4-1b6957a2d550-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-611f7c63-9687-41a3-939e-37fd88644893 req-f2669b99-99f8-4451-ba6d-a979a690d8b2 service nova] Lock "2921f743-66d5-47c1-b2e4-1b6957a2d550-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-611f7c63-9687-41a3-939e-37fd88644893 req-f2669b99-99f8-4451-ba6d-a979a690d8b2 service nova] Lock "2921f743-66d5-47c1-b2e4-1b6957a2d550-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG nova.compute.manager [req-611f7c63-9687-41a3-939e-37fd88644893 req-f2669b99-99f8-4451-ba6d-a979a690d8b2 service nova] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] No waiting events found dispatching network-vif-unplugged-ffbc1668-bf57-488c-b543-d7a288eab7a7 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG nova.compute.manager [req-611f7c63-9687-41a3-939e-37fd88644893 req-f2669b99-99f8-4451-ba6d-a979a690d8b2 service nova] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Received event network-vif-unplugged-ffbc1668-bf57-488c-b543-d7a288eab7a7 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.760s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PmCURVfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:16:07 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:16:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:16:07 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:16:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:16:07 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e027e807-ca85-42c3-9104-e6eacbaf806b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:16:07 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[655166d2-2338-4830-bc3d-8992dc3575bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6] added
Nov 15 04:16:07 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:07 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Instance destroyed successfully.
Nov 15 04:16:07 user nova-compute[74805]: DEBUG nova.objects.instance [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lazy-loading 'resources' on Instance uuid 2921f743-66d5-47c1-b2e4-1b6957a2d550 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1979337337',display_name='tempest-DeleteServersTestJSON-server-1979337337',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1979337337',id=2,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:14:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28d81fab6ad94b5984ae8f08c57ace0e',ramdisk_id='',reservation_id='r-4t2i0vt4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-242667702',owner_user_name='tempest-DeleteServersTestJSON-242667702-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:14:24Z,user_data=None,user_id='83a575fda76f42a18e836d2d1ade0c3c',uuid=2921f743-66d5-47c1-b2e4-1b6957a2d550,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ffbc1668-bf57-488c-b543-d7a288eab7a7", "address": "fa:16:3e:12:75:7a", "network": {"id": "a93e5b59-b6ae-4772-877c-c76e939a5f94", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1410274890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d81fab6ad94b5984ae8f08c57ace0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbc1668-bf", "ovs_interfaceid": "ffbc1668-bf57-488c-b543-d7a288eab7a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Converting VIF {"id": "ffbc1668-bf57-488c-b543-d7a288eab7a7", "address": "fa:16:3e:12:75:7a", "network": {"id": "a93e5b59-b6ae-4772-877c-c76e939a5f94", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1410274890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d81fab6ad94b5984ae8f08c57ace0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffbc1668-bf", "ovs_interfaceid": "ffbc1668-bf57-488c-b543-d7a288eab7a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:75:7a,bridge_name='br-int',has_traffic_filtering=True,id=ffbc1668-bf57-488c-b543-d7a288eab7a7,network=Network(a93e5b59-b6ae-4772-877c-c76e939a5f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffbc1668-bf') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG os_vif [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:75:7a,bridge_name='br-int',has_traffic_filtering=True,id=ffbc1668-bf57-488c-b543-d7a288eab7a7,network=Network(a93e5b59-b6ae-4772-877c-c76e939a5f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffbc1668-bf') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9266b2-2bc9-4919-93ac-a7094d4f21ea]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffbc1668-bf, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f4a6f073-010b-417a-b39c-6c511986cc3a) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:16:07 user nova-compute[74805]: INFO os_vif [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:75:7a,bridge_name='br-int',has_traffic_filtering=True,id=ffbc1668-bf57-488c-b543-d7a288eab7a7,network=Network(a93e5b59-b6ae-4772-877c-c76e939a5f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffbc1668-bf')
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6290841e-a556-44dd-889b-e3a927ef20fd]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'raTxytFL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:16:07 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:16:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PmCURVfE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PmCURVfE" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5752e44-9195-4823-8cc2-14d51e8162f0]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PmCURVfE'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f352bcd5-5cd6-4310-b0af-ab2f0c4909c0]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac888cc-dfd0-41cc-8552-0e4061744494]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:07 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:07 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:07 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:07 user nova-compute[74805]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 (non-flash)
Nov 15 04:16:07 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:07 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:07 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:07 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:07 user nova-compute[74805]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 (non-flash)
Nov 15 04:16:07 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6b7588-a5b4-4d5f-bafe-4bba7f8940b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6, portal: 172.16.0.220,3260]
Nov 15 04:16:07 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6, portal: 172.16.0.220,3260] successful.
Nov 15 04:16:07 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1bb323-bc83-44c2-87c9-a069a02bea8d]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[87eed870-3559-4a17-83bc-cb7cccd03a4b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:07 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:07 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:07 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:07 user nova-compute[74805]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 (non-flash)
Nov 15 04:16:07 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:07 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:07 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:07 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:07 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:07 user nova-compute[74805]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 (non-flash)
Nov 15 04:16:07 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:07 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[669098db-21f5-4018-a435-dcabd75e09e0]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:07 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: None {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:16:08 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:16:08 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:16:08 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:16:08 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:16:08 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Skipping network cache update for instance because it is being deleted. {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 15 04:16:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:16:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:16:08 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:16:08 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:16:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PmCURVfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:16:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:16:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23337383938636166', 'path': '/dev/sdg'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:16:08 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337383938636166', 'path': '/dev/sdg'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:16:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.237s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:16:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:08 user nova-compute[74805]: DEBUG nova.objects.instance [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lazy-loading 'flavor' on Instance uuid 1eb9b315-77a9-40f7-8a43-8c40186a0dca {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02eb690-131c-4978-9bb2-de3a8c43d7ae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:16:09 user nova-compute[74805]: No targets found.
Nov 15 04:16:09 user nova-compute[74805]: iSNS:
Nov 15 04:16:09 user nova-compute[74805]: No targets found.
Nov 15 04:16:09 user nova-compute[74805]: STATIC:
Nov 15 04:16:09 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730
Nov 15 04:16:09 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:09 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:09 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6
Nov 15 04:16:09 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:09 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:09 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651
Nov 15 04:16:09 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:09 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:09 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d
Nov 15 04:16:09 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:09 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:09 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114
Nov 15 04:16:09 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:09 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:09 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411
Nov 15 04:16:09 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:09 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:09 user nova-compute[74805]: FIRMWARE:
Nov 15 04:16:09 user nova-compute[74805]: No targets found.
Nov 15 04:16:09 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:16:09 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:16:09 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:16:09 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:16:09 user nova-compute[74805]:   <source dev="/dev/sdg"/>
Nov 15 04:16:09 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:16:09 user nova-compute[74805]:   <serial>b93c3226-0ddd-46ac-bfbe-bae1d26366c6</serial>
Nov 15 04:16:09 user nova-compute[74805]: </disk>
Nov 15 04:16:09 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16d5009-78a0-45fd-aea2-b09da9036af9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[03107c8e-a5d4-4033-8cb8-a1a26dec9307]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:09 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:09 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:09 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:09 user nova-compute[74805]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 (non-flash)
Nov 15 04:16:09 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:09 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:09 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:09 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:09 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:09 user nova-compute[74805]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 (non-flash)
Nov 15 04:16:09 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:09 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c766b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411'): ({'sdf'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Removing single pathed devices sdf {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba05eb3-5d0d-4ee9-9927-768866ebc1b7]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6b472b-d606-44c9-a999-c265b68b4ef9]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Flushing IO for device /dev/sdf {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea8c123-546e-4aaf-8dbe-4835678355cf]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Updating instance_info_cache with network_info: [{"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.067s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0750ec18-f7a6-4386-9111-d5e4770f83ec]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] SCSI volumes sdf have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[113a698e-1ef2-4739-9758-122b35921e8d]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edc0169-3340-41e1-877c-e632e19fa4e1]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411, portal: 172.16.0.220,3260]
Nov 15 04:16:09 user nova-compute[74805]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411, portal: 172.16.0.220,3260] successful.
Nov 15 04:16:09 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e749fbb-672f-4711-b988-7a7bd0eed411 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[77788887-93dc-4e2a-8298-a68d8d08ac13]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] <== disconnect_volume: return (1578ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:16:09 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Deleting instance files /opt/stack/data/nova/instances/2921f743-66d5-47c1-b2e4-1b6957a2d550_del
Nov 15 04:16:09 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Deletion of /opt/stack/data/nova/instances/2921f743-66d5-47c1-b2e4-1b6957a2d550_del complete
Nov 15 04:16:09 user nova-compute[74805]: DEBUG nova.compute.manager [req-7ef994cf-ced6-4928-960d-c4e423e7a12e req-dab669ba-3dfb-4aef-99d9-ab2c95c6cffd service nova] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Received event network-vif-plugged-ffbc1668-bf57-488c-b543-d7a288eab7a7 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7ef994cf-ced6-4928-960d-c4e423e7a12e req-dab669ba-3dfb-4aef-99d9-ab2c95c6cffd service nova] Acquiring lock "2921f743-66d5-47c1-b2e4-1b6957a2d550-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7ef994cf-ced6-4928-960d-c4e423e7a12e req-dab669ba-3dfb-4aef-99d9-ab2c95c6cffd service nova] Lock "2921f743-66d5-47c1-b2e4-1b6957a2d550-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7ef994cf-ced6-4928-960d-c4e423e7a12e req-dab669ba-3dfb-4aef-99d9-ab2c95c6cffd service nova] Lock "2921f743-66d5-47c1-b2e4-1b6957a2d550-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG nova.compute.manager [req-7ef994cf-ced6-4928-960d-c4e423e7a12e req-dab669ba-3dfb-4aef-99d9-ab2c95c6cffd service nova] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] No waiting events found dispatching network-vif-plugged-ffbc1668-bf57-488c-b543-d7a288eab7a7 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:16:09 user nova-compute[74805]: WARNING nova.compute.manager [req-7ef994cf-ced6-4928-960d-c4e423e7a12e req-dab669ba-3dfb-4aef-99d9-ab2c95c6cffd service nova] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Received unexpected event network-vif-plugged-ffbc1668-bf57-488c-b543-d7a288eab7a7 for instance with vm_state active and task_state deleting.
Nov 15 04:16:09 user nova-compute[74805]: INFO nova.compute.manager [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Took 2.57 seconds to destroy the instance on the hypervisor.
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] No VIF found with MAC fa:16:3e:80:32:cf, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:16:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5c8127d1-b41c-4ed2-8a60-3a45837adb77 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.887s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:09 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-38e7f889-593d-484d-b9fb-b6327f6e7513 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Snapshot image upload complete
Nov 15 04:16:09 user nova-compute[74805]: INFO nova.compute.manager [None req-38e7f889-593d-484d-b9fb-b6327f6e7513 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Took 7.10 seconds to snapshot the instance on the hypervisor.
Nov 15 04:16:10 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:16:10 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Took 0.77 seconds to deallocate network for instance.
Nov 15 04:16:10 user nova-compute[74805]: DEBUG nova.compute.manager [req-c4207722-a477-4ae2-abd5-798e64d64e92 req-4b255d45-e42b-497b-a967-209ae1fb9fab service nova] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Received event network-vif-deleted-ffbc1668-bf57-488c-b543-d7a288eab7a7 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:10 user nova-compute[74805]: INFO nova.compute.manager [req-c4207722-a477-4ae2-abd5-798e64d64e92 req-4b255d45-e42b-497b-a967-209ae1fb9fab service nova] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Neutron deleted interface ffbc1668-bf57-488c-b543-d7a288eab7a7; detaching it from the instance and deleting it from the info cache
Nov 15 04:16:10 user nova-compute[74805]: DEBUG nova.network.neutron [req-c4207722-a477-4ae2-abd5-798e64d64e92 req-4b255d45-e42b-497b-a967-209ae1fb9fab service nova] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:16:10 user nova-compute[74805]: DEBUG nova.compute.manager [req-c4207722-a477-4ae2-abd5-798e64d64e92 req-4b255d45-e42b-497b-a967-209ae1fb9fab service nova] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Detach interface failed, port_id=ffbc1668-bf57-488c-b543-d7a288eab7a7, reason: Instance 2921f743-66d5-47c1-b2e4-1b6957a2d550 could not be found. {{(pid=74805) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 04:16:10 user nova-compute[74805]: INFO nova.compute.manager [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] [instance: 2921f743-66d5-47c1-b2e4-1b6957a2d550] Took 0.78 seconds to detach 1 volumes for instance.
Nov 15 04:16:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:11 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:16:11 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:16:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:11 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Deleted allocations for instance 2921f743-66d5-47c1-b2e4-1b6957a2d550
Nov 15 04:16:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6fdeedf2-278e-473a-b871-3533c577abc7 tempest-DeleteServersTestJSON-242667702 tempest-DeleteServersTestJSON-242667702-project-member] Lock "2921f743-66d5-47c1-b2e4-1b6957a2d550" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.751s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "b682db81-a837-49e6-818c-394dd4f1e3f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "b682db81-a837-49e6-818c-394dd4f1e3f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:13 user nova-compute[74805]: DEBUG nova.compute.manager [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:16:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:13 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:16:13 user nova-compute[74805]: INFO nova.compute.claims [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Claim successful on node user
Nov 15 04:16:13 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:16:13 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:16:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:13 user nova-compute[74805]: DEBUG nova.compute.manager [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:16:13 user nova-compute[74805]: DEBUG nova.compute.manager [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:16:13 user nova-compute[74805]: DEBUG nova.network.neutron [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:16:13 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:16:13 user nova-compute[74805]: DEBUG nova.compute.manager [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:16:13 user nova-compute[74805]: DEBUG nova.policy [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba1bcf1e429045129d379293cc490bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8280c6302b2e42998c7c436522c47e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:16:14 user nova-compute[74805]: DEBUG nova.compute.manager [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:16:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:16:14 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Creating image(s)
Nov 15 04:16:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "/opt/stack/data/nova/instances/b682db81-a837-49e6-818c-394dd4f1e3f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "/opt/stack/data/nova/instances/b682db81-a837-49e6-818c-394dd4f1e3f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "/opt/stack/data/nova/instances/b682db81-a837-49e6-818c-394dd4f1e3f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.169s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/b682db81-a837-49e6-818c-394dd4f1e3f4/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/b682db81-a837-49e6-818c-394dd4f1e3f4/disk 1073741824" returned: 0 in 0.062s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:14 user nova-compute[74805]: DEBUG nova.network.neutron [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Successfully created port: 092376b3-85d5-46b7-a921-cd57d838df06 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:16:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.165s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:14 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b682db81-a837-49e6-818c-394dd4f1e3f4/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:16:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b682db81-a837-49e6-818c-394dd4f1e3f4/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b682db81-a837-49e6-818c-394dd4f1e3f4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:14 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Cannot resize image /opt/stack/data/nova/instances/b682db81-a837-49e6-818c-394dd4f1e3f4/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:16:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:16:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Ensure instance console log exists: /opt/stack/data/nova/instances/b682db81-a837-49e6-818c-394dd4f1e3f4/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:16:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.network.neutron [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Successfully updated port: 092376b3-85d5-46b7-a921-cd57d838df06 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "refresh_cache-b682db81-a837-49e6-818c-394dd4f1e3f4" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquired lock "refresh_cache-b682db81-a837-49e6-818c-394dd4f1e3f4" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.network.neutron [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.compute.manager [req-101d3e1c-c6e3-4863-a51a-8a7ab01684fb req-99e2a61f-00f4-4f7f-beeb-978dcb92e3a1 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Received event network-changed-092376b3-85d5-46b7-a921-cd57d838df06 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.compute.manager [req-101d3e1c-c6e3-4863-a51a-8a7ab01684fb req-99e2a61f-00f4-4f7f-beeb-978dcb92e3a1 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Refreshing instance network info cache due to event network-changed-092376b3-85d5-46b7-a921-cd57d838df06. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-101d3e1c-c6e3-4863-a51a-8a7ab01684fb req-99e2a61f-00f4-4f7f-beeb-978dcb92e3a1 service nova] Acquiring lock "refresh_cache-b682db81-a837-49e6-818c-394dd4f1e3f4" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.network.neutron [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.network.neutron [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Updating instance_info_cache with network_info: [{"id": "092376b3-85d5-46b7-a921-cd57d838df06", "address": "fa:16:3e:6d:7b:7f", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap092376b3-85", "ovs_interfaceid": "092376b3-85d5-46b7-a921-cd57d838df06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Releasing lock "refresh_cache-b682db81-a837-49e6-818c-394dd4f1e3f4" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.compute.manager [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Instance network_info: |[{"id": "092376b3-85d5-46b7-a921-cd57d838df06", "address": "fa:16:3e:6d:7b:7f", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap092376b3-85", "ovs_interfaceid": "092376b3-85d5-46b7-a921-cd57d838df06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-101d3e1c-c6e3-4863-a51a-8a7ab01684fb req-99e2a61f-00f4-4f7f-beeb-978dcb92e3a1 service nova] Acquired lock "refresh_cache-b682db81-a837-49e6-818c-394dd4f1e3f4" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.network.neutron [req-101d3e1c-c6e3-4863-a51a-8a7ab01684fb req-99e2a61f-00f4-4f7f-beeb-978dcb92e3a1 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Refreshing network info cache for port 092376b3-85d5-46b7-a921-cd57d838df06 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Start _get_guest_xml network_info=[{"id": "092376b3-85d5-46b7-a921-cd57d838df06", "address": "fa:16:3e:6d:7b:7f", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap092376b3-85", "ovs_interfaceid": "092376b3-85d5-46b7-a921-cd57d838df06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:16:15 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:16:15 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:16:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1967639214',display_name='tempest-AttachVolumeNegativeTest-server-1967639214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1967639214',id=14,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAD8inV+r3gVRXN0Cd8G70zLtk1kuB0Ipis027As9LiSuppqbSB+V23mt+roCDHCJKPgF7spqMJTvP5XRBBFhTNRias9ua/cLg5EDWnWh8/IBDxiGX3vsfO2mKHu4urFrA==',key_name='tempest-keypair-271604757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8280c6302b2e42998c7c436522c47e79',ramdisk_id='',reservation_id='r-jt5ewwus',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-6184130',owner_user_name='tempest-AttachVolumeNegativeTest-6184130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:16:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba1bcf1e429045129d379293cc490bde',uuid=b682db81-a837-49e6-818c-394dd4f1e3f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "092376b3-85d5-46b7-a921-cd57d838df06", "address": "fa:16:3e:6d:7b:7f", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap092376b3-85", "ovs_interfaceid": "092376b3-85d5-46b7-a921-cd57d838df06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Converting VIF {"id": "092376b3-85d5-46b7-a921-cd57d838df06", "address": "fa:16:3e:6d:7b:7f", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap092376b3-85", "ovs_interfaceid": "092376b3-85d5-46b7-a921-cd57d838df06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:7b:7f,bridge_name='br-int',has_traffic_filtering=True,id=092376b3-85d5-46b7-a921-cd57d838df06,network=Network(3454b4d8-1ff9-4f3c-9a93-499645affcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap092376b3-85') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.objects.instance [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lazy-loading 'pci_devices' on Instance uuid b682db81-a837-49e6-818c-394dd4f1e3f4 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:16:15 user nova-compute[74805]:   <uuid>b682db81-a837-49e6-818c-394dd4f1e3f4</uuid>
Nov 15 04:16:15 user nova-compute[74805]:   <name>instance-0000000e</name>
Nov 15 04:16:15 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:16:15 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:16:15 user nova-compute[74805]:   <metadata>
Nov 15 04:16:15 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:16:15 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:16:15 user nova-compute[74805]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1967639214</nova:name>
Nov 15 04:16:15 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:16:15</nova:creationTime>
Nov 15 04:16:15 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:16:15 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:16:15 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:16:15 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:16:15 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:16:15 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:16:15 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:16:15 user nova-compute[74805]:       <nova:owner>
Nov 15 04:16:15 user nova-compute[74805]:         <nova:user uuid="ba1bcf1e429045129d379293cc490bde">tempest-AttachVolumeNegativeTest-6184130-project-member</nova:user>
Nov 15 04:16:15 user nova-compute[74805]:         <nova:project uuid="8280c6302b2e42998c7c436522c47e79">tempest-AttachVolumeNegativeTest-6184130</nova:project>
Nov 15 04:16:15 user nova-compute[74805]:       </nova:owner>
Nov 15 04:16:15 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:16:15 user nova-compute[74805]:       <nova:ports>
Nov 15 04:16:15 user nova-compute[74805]:         <nova:port uuid="092376b3-85d5-46b7-a921-cd57d838df06">
Nov 15 04:16:15 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 04:16:15 user nova-compute[74805]:         </nova:port>
Nov 15 04:16:15 user nova-compute[74805]:       </nova:ports>
Nov 15 04:16:15 user nova-compute[74805]:     </nova:instance>
Nov 15 04:16:15 user nova-compute[74805]:   </metadata>
Nov 15 04:16:15 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:16:15 user nova-compute[74805]:     <system>
Nov 15 04:16:15 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:16:15 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:16:15 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:16:15 user nova-compute[74805]:       <entry name="serial">b682db81-a837-49e6-818c-394dd4f1e3f4</entry>
Nov 15 04:16:15 user nova-compute[74805]:       <entry name="uuid">b682db81-a837-49e6-818c-394dd4f1e3f4</entry>
Nov 15 04:16:15 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:16:15 user nova-compute[74805]:     </system>
Nov 15 04:16:15 user nova-compute[74805]:   </sysinfo>
Nov 15 04:16:15 user nova-compute[74805]:   <os>
Nov 15 04:16:15 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:16:15 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:16:15 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:16:15 user nova-compute[74805]:   </os>
Nov 15 04:16:15 user nova-compute[74805]:   <features>
Nov 15 04:16:15 user nova-compute[74805]:     <acpi/>
Nov 15 04:16:15 user nova-compute[74805]:     <apic/>
Nov 15 04:16:15 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:16:15 user nova-compute[74805]:   </features>
Nov 15 04:16:15 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:16:15 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:16:15 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:16:15 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:16:15 user nova-compute[74805]:   </clock>
Nov 15 04:16:15 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:16:15 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:16:15 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:16:15 user nova-compute[74805]:   </cpu>
Nov 15 04:16:15 user nova-compute[74805]:   <devices>
Nov 15 04:16:15 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:16:15 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:16:15 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/b682db81-a837-49e6-818c-394dd4f1e3f4/disk"/>
Nov 15 04:16:15 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:16:15 user nova-compute[74805]:     </disk>
Nov 15 04:16:15 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:16:15 user nova-compute[74805]:       <mac address="fa:16:3e:6d:7b:7f"/>
Nov 15 04:16:15 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:16:15 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:16:15 user nova-compute[74805]:       <target dev="tap092376b3-85"/>
Nov 15 04:16:15 user nova-compute[74805]:     </interface>
Nov 15 04:16:15 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:16:15 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/b682db81-a837-49e6-818c-394dd4f1e3f4/console.log" append="off"/>
Nov 15 04:16:15 user nova-compute[74805]:     </serial>
Nov 15 04:16:15 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:16:15 user nova-compute[74805]:     <video>
Nov 15 04:16:15 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:16:15 user nova-compute[74805]:     </video>
Nov 15 04:16:15 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:16:15 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:16:15 user nova-compute[74805]:     </rng>
Nov 15 04:16:15 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:16:15 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:16:15 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:16:15 user nova-compute[74805]:     </memballoon>
Nov 15 04:16:15 user nova-compute[74805]:   </devices>
Nov 15 04:16:15 user nova-compute[74805]: </domain>
Nov 15 04:16:15 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:16:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1967639214',display_name='tempest-AttachVolumeNegativeTest-server-1967639214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1967639214',id=14,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAD8inV+r3gVRXN0Cd8G70zLtk1kuB0Ipis027As9LiSuppqbSB+V23mt+roCDHCJKPgF7spqMJTvP5XRBBFhTNRias9ua/cLg5EDWnWh8/IBDxiGX3vsfO2mKHu4urFrA==',key_name='tempest-keypair-271604757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8280c6302b2e42998c7c436522c47e79',ramdisk_id='',reservation_id='r-jt5ewwus',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-6184130',owner_user_name='tempest-AttachVolumeNegativeTest-6184130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:16:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba1bcf1e429045129d379293cc490bde',uuid=b682db81-a837-49e6-818c-394dd4f1e3f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "092376b3-85d5-46b7-a921-cd57d838df06", "address": "fa:16:3e:6d:7b:7f", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap092376b3-85", "ovs_interfaceid": "092376b3-85d5-46b7-a921-cd57d838df06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Converting VIF {"id": "092376b3-85d5-46b7-a921-cd57d838df06", "address": "fa:16:3e:6d:7b:7f", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap092376b3-85", "ovs_interfaceid": "092376b3-85d5-46b7-a921-cd57d838df06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:7b:7f,bridge_name='br-int',has_traffic_filtering=True,id=092376b3-85d5-46b7-a921-cd57d838df06,network=Network(3454b4d8-1ff9-4f3c-9a93-499645affcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap092376b3-85') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG os_vif [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:7b:7f,bridge_name='br-int',has_traffic_filtering=True,id=092376b3-85d5-46b7-a921-cd57d838df06,network=Network(3454b4d8-1ff9-4f3c-9a93-499645affcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap092376b3-85') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd08eb07d-d159-5b43-a2aa-ece2fed2012e', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap092376b3-85, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap092376b3-85, col_values=(('qos', UUID('0c03c7f7-178a-420e-9eea-cc016a952e65')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap092376b3-85, col_values=(('external_ids', {'iface-id': '092376b3-85d5-46b7-a921-cd57d838df06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:7b:7f', 'vm-uuid': 'b682db81-a837-49e6-818c-394dd4f1e3f4'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:15 user nova-compute[74805]: INFO os_vif [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:7b:7f,bridge_name='br-int',has_traffic_filtering=True,id=092376b3-85d5-46b7-a921-cd57d838df06,network=Network(3454b4d8-1ff9-4f3c-9a93-499645affcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap092376b3-85')
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] No VIF found with MAC fa:16:3e:6d:7b:7f, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.network.neutron [req-101d3e1c-c6e3-4863-a51a-8a7ab01684fb req-99e2a61f-00f4-4f7f-beeb-978dcb92e3a1 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Updated VIF entry in instance network info cache for port 092376b3-85d5-46b7-a921-cd57d838df06. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG nova.network.neutron [req-101d3e1c-c6e3-4863-a51a-8a7ab01684fb req-99e2a61f-00f4-4f7f-beeb-978dcb92e3a1 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Updating instance_info_cache with network_info: [{"id": "092376b3-85d5-46b7-a921-cd57d838df06", "address": "fa:16:3e:6d:7b:7f", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap092376b3-85", "ovs_interfaceid": "092376b3-85d5-46b7-a921-cd57d838df06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:16:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-101d3e1c-c6e3-4863-a51a-8a7ab01684fb req-99e2a61f-00f4-4f7f-beeb-978dcb92e3a1 service nova] Releasing lock "refresh_cache-b682db81-a837-49e6-818c-394dd4f1e3f4" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:16:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:17 user nova-compute[74805]: DEBUG nova.compute.manager [req-ed3382e4-30b6-4431-bae9-e6eb9ac603d0 req-fd242beb-7f2a-4739-b9e0-a328057f5d83 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Received event network-vif-plugged-092376b3-85d5-46b7-a921-cd57d838df06 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ed3382e4-30b6-4431-bae9-e6eb9ac603d0 req-fd242beb-7f2a-4739-b9e0-a328057f5d83 service nova] Acquiring lock "b682db81-a837-49e6-818c-394dd4f1e3f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ed3382e4-30b6-4431-bae9-e6eb9ac603d0 req-fd242beb-7f2a-4739-b9e0-a328057f5d83 service nova] Lock "b682db81-a837-49e6-818c-394dd4f1e3f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ed3382e4-30b6-4431-bae9-e6eb9ac603d0 req-fd242beb-7f2a-4739-b9e0-a328057f5d83 service nova] Lock "b682db81-a837-49e6-818c-394dd4f1e3f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:17 user nova-compute[74805]: DEBUG nova.compute.manager [req-ed3382e4-30b6-4431-bae9-e6eb9ac603d0 req-fd242beb-7f2a-4739-b9e0-a328057f5d83 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] No waiting events found dispatching network-vif-plugged-092376b3-85d5-46b7-a921-cd57d838df06 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:16:17 user nova-compute[74805]: WARNING nova.compute.manager [req-ed3382e4-30b6-4431-bae9-e6eb9ac603d0 req-fd242beb-7f2a-4739-b9e0-a328057f5d83 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Received unexpected event network-vif-plugged-092376b3-85d5-46b7-a921-cd57d838df06 for instance with vm_state building and task_state spawning.
Nov 15 04:16:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:19 user nova-compute[74805]: DEBUG nova.compute.manager [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:16:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:16:19 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Instance spawned successfully.
Nov 15 04:16:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:16:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:16:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:16:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:16:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:16:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:16:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:16:19 user nova-compute[74805]: INFO nova.compute.manager [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 15 04:16:19 user nova-compute[74805]: DEBUG nova.compute.manager [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:16:19 user nova-compute[74805]: INFO nova.compute.manager [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Took 6.04 seconds to build instance.
Nov 15 04:16:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7698d34d-4fcd-4237-98b7-1c7f0db45545 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "b682db81-a837-49e6-818c-394dd4f1e3f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.137s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:19 user nova-compute[74805]: DEBUG nova.compute.manager [req-aa5b0d33-70d3-4640-a9bc-3a272113efb3 req-017a3d6f-f8ca-4522-bfdb-7c56ca5c1228 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Received event network-vif-plugged-092376b3-85d5-46b7-a921-cd57d838df06 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-aa5b0d33-70d3-4640-a9bc-3a272113efb3 req-017a3d6f-f8ca-4522-bfdb-7c56ca5c1228 service nova] Acquiring lock "b682db81-a837-49e6-818c-394dd4f1e3f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-aa5b0d33-70d3-4640-a9bc-3a272113efb3 req-017a3d6f-f8ca-4522-bfdb-7c56ca5c1228 service nova] Lock "b682db81-a837-49e6-818c-394dd4f1e3f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-aa5b0d33-70d3-4640-a9bc-3a272113efb3 req-017a3d6f-f8ca-4522-bfdb-7c56ca5c1228 service nova] Lock "b682db81-a837-49e6-818c-394dd4f1e3f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:19 user nova-compute[74805]: DEBUG nova.compute.manager [req-aa5b0d33-70d3-4640-a9bc-3a272113efb3 req-017a3d6f-f8ca-4522-bfdb-7c56ca5c1228 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] No waiting events found dispatching network-vif-plugged-092376b3-85d5-46b7-a921-cd57d838df06 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:16:19 user nova-compute[74805]: WARNING nova.compute.manager [req-aa5b0d33-70d3-4640-a9bc-3a272113efb3 req-017a3d6f-f8ca-4522-bfdb-7c56ca5c1228 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Received unexpected event network-vif-plugged-092376b3-85d5-46b7-a921-cd57d838df06 for instance with vm_state active and task_state None.
Nov 15 04:16:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:21 user nova-compute[74805]: DEBUG nova.compute.manager [req-81494492-fed2-420c-be9b-ebe6c47414c7 req-3fc04c68-a758-4654-8dcf-a80d98f6f68b service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Received event network-changed-78ef9969-b62c-4730-8bbf-e5a8d2c75010 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:21 user nova-compute[74805]: DEBUG nova.compute.manager [req-81494492-fed2-420c-be9b-ebe6c47414c7 req-3fc04c68-a758-4654-8dcf-a80d98f6f68b service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Refreshing instance network info cache due to event network-changed-78ef9969-b62c-4730-8bbf-e5a8d2c75010. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:16:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-81494492-fed2-420c-be9b-ebe6c47414c7 req-3fc04c68-a758-4654-8dcf-a80d98f6f68b service nova] Acquiring lock "refresh_cache-e91a656c-66d6-4a70-a115-8c03ed964f94" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:16:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-81494492-fed2-420c-be9b-ebe6c47414c7 req-3fc04c68-a758-4654-8dcf-a80d98f6f68b service nova] Acquired lock "refresh_cache-e91a656c-66d6-4a70-a115-8c03ed964f94" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:16:21 user nova-compute[74805]: DEBUG nova.network.neutron [req-81494492-fed2-420c-be9b-ebe6c47414c7 req-3fc04c68-a758-4654-8dcf-a80d98f6f68b service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Refreshing network info cache for port 78ef9969-b62c-4730-8bbf-e5a8d2c75010 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:16:21 user nova-compute[74805]: INFO nova.compute.manager [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Rebuilding instance
Nov 15 04:16:21 user nova-compute[74805]: DEBUG nova.compute.manager [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:16:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:21 user nova-compute[74805]: DEBUG nova.network.neutron [req-81494492-fed2-420c-be9b-ebe6c47414c7 req-3fc04c68-a758-4654-8dcf-a80d98f6f68b service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Updated VIF entry in instance network info cache for port 78ef9969-b62c-4730-8bbf-e5a8d2c75010. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:16:21 user nova-compute[74805]: DEBUG nova.network.neutron [req-81494492-fed2-420c-be9b-ebe6c47414c7 req-3fc04c68-a758-4654-8dcf-a80d98f6f68b service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Updating instance_info_cache with network_info: [{"id": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "address": "fa:16:3e:d0:6e:1b", "network": {"id": "b3051571-47ed-471a-9d88-051306ee18e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-707580808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b22eb863a050454fb1998acbaae47f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ef9969-b6", "ovs_interfaceid": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:16:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-81494492-fed2-420c-be9b-ebe6c47414c7 req-3fc04c68-a758-4654-8dcf-a80d98f6f68b service nova] Releasing lock "refresh_cache-e91a656c-66d6-4a70-a115-8c03ed964f94" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:16:22 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Instance destroyed successfully.
Nov 15 04:16:22 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Instance destroyed successfully.
Nov 15 04:16:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-641306839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1742924084',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlMPSTIiQVE0Cg8/bE0RixmymMVDkL6CLvmQNksg244N0w4rCZu1JDjdz8UBU0xRiR4zxHQg+y5pVbvwhdP+A3FI8Akdh2Dzal25VcHo1J+LBfq6srezgKC8edvUX0D8Q==',key_name='tempest-keypair-430392767',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:14:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b22eb863a050454fb1998acbaae47f23',ramdisk_id='',reservation_id='r-uvt06p7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1378822471',owner_user_name='tempest-ServerActionsV293TestJSON-1378822471-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7ec9f2afcee4c23883d572235bfa437',uuid=e91a656c-66d6-4a70-a115-8c03ed964f94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "address": "fa:16:3e:d0:6e:1b", "network": {"id": "b3051571-47ed-471a-9d88-051306ee18e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-707580808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b22eb863a050454fb1998acbaae47f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ef9969-b6", "ovs_interfaceid": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Converting VIF {"id": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "address": "fa:16:3e:d0:6e:1b", "network": {"id": "b3051571-47ed-471a-9d88-051306ee18e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-707580808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b22eb863a050454fb1998acbaae47f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ef9969-b6", "ovs_interfaceid": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:6e:1b,bridge_name='br-int',has_traffic_filtering=True,id=78ef9969-b62c-4730-8bbf-e5a8d2c75010,network=Network(b3051571-47ed-471a-9d88-051306ee18e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ef9969-b6') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG os_vif [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:6e:1b,bridge_name='br-int',has_traffic_filtering=True,id=78ef9969-b62c-4730-8bbf-e5a8d2c75010,network=Network(b3051571-47ed-471a-9d88-051306ee18e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ef9969-b6') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78ef9969-b6, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38880ec7-d4f9-46a6-b372-dd41bdc61691) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:22 user nova-compute[74805]: INFO os_vif [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:6e:1b,bridge_name='br-int',has_traffic_filtering=True,id=78ef9969-b62c-4730-8bbf-e5a8d2c75010,network=Network(b3051571-47ed-471a-9d88-051306ee18e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ef9969-b6')
Nov 15 04:16:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQvEqwlU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:16:22 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 04:16:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[76686e9b-2c29-4bca-8a66-4d30dec9d9c3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:16:22 user nova-compute[74805]: No targets found.
Nov 15 04:16:22 user nova-compute[74805]: iSNS:
Nov 15 04:16:22 user nova-compute[74805]: No targets found.
Nov 15 04:16:22 user nova-compute[74805]: STATIC:
Nov 15 04:16:22 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730
Nov 15 04:16:22 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:22 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:22 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6
Nov 15 04:16:22 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:22 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:22 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651
Nov 15 04:16:22 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:22 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:22 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d
Nov 15 04:16:22 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:22 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:22 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114
Nov 15 04:16:22 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:22 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:22 user nova-compute[74805]: FIRMWARE:
Nov 15 04:16:22 user nova-compute[74805]: No targets found.
Nov 15 04:16:22 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:16:22 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:16:22 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3d7ffe-33e4-44f4-9136-fe9077d237d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.093s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[51be7eea-572e-4f34-94f9-be811cf4c4e2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:22 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:22 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:22 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:22 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:22 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:22 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:22 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:22 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:22 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:22 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2fb4367010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d'): ({'sdb'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Removing single pathed devices sdb {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[457502a8-5f0d-46f6-a9e4-121bb2c21f45]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd28fc21-057c-465c-89c4-1a3589ca8df8]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Flushing IO for device /dev/sdb {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2178c60d-f628-4666-a6cb-3cfe59ca62b5]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[75eb858e-31a6-40a0-baf1-ae747cb03076]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_5bfe3be9', '/dev/disk/by-id/scsi-1SCST_BIO5bfe3be9-2296d383288b549d', '/dev/disk/by-id/scsi-23232393664333833') {{(pid=85029) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81ff0ca-0b69-4cf6-bc05-b6f28cd64283]: (4, None) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ba67ea-46d7-4bba-b198-fefcfc090b0b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7275f4-7206-4e8f-abaf-a0952543a9fd]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d, portal: 172.16.0.220,3260]
Nov 15 04:16:22 user nova-compute[74805]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d, portal: 172.16.0.220,3260] successful.
Nov 15 04:16:22 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39c164f-7b63-49eb-b24b-e81524ca53f3]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] <== disconnect_volume: return (407ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:16:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:16:22 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Deleting instance files /opt/stack/data/nova/instances/e91a656c-66d6-4a70-a115-8c03ed964f94_del
Nov 15 04:16:22 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Deletion of /opt/stack/data/nova/instances/e91a656c-66d6-4a70-a115-8c03ed964f94_del complete
Nov 15 04:16:23 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance e91a656c-66d6-4a70-a115-8c03ed964f94 could not be found.
Nov 15 04:16:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQvEqwlU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:16:23 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 04:16:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4091895-2cf1-483b-8b63-3e75bcda2719]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:16:23 user nova-compute[74805]: No targets found.
Nov 15 04:16:23 user nova-compute[74805]: iSNS:
Nov 15 04:16:23 user nova-compute[74805]: No targets found.
Nov 15 04:16:23 user nova-compute[74805]: STATIC:
Nov 15 04:16:23 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730
Nov 15 04:16:23 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:23 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:23 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6
Nov 15 04:16:23 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:23 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:23 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651
Nov 15 04:16:23 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:23 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:23 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114
Nov 15 04:16:23 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:23 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:23 user nova-compute[74805]: FIRMWARE:
Nov 15 04:16:23 user nova-compute[74805]: No targets found.
Nov 15 04:16:23 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:16:23 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:16:23 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc2a28b-9509-42e6-9113-04325dd83b7d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9504b993-9df9-47d0-b7c1-db34c94885d9]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:23 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:23 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:23 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:23 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:23 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:23 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:23 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:23 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2fb43671c0>, {}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Disconnecting from: [] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.068s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] <== disconnect_volume: return (69ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG nova.compute.manager [req-e3749dad-b902-42f0-a8b5-93b2222ab24c req-58756285-b86b-4bd2-aacf-60b45a05390e service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Received event network-vif-unplugged-78ef9969-b62c-4730-8bbf-e5a8d2c75010 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e3749dad-b902-42f0-a8b5-93b2222ab24c req-58756285-b86b-4bd2-aacf-60b45a05390e service nova] Acquiring lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e3749dad-b902-42f0-a8b5-93b2222ab24c req-58756285-b86b-4bd2-aacf-60b45a05390e service nova] Lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e3749dad-b902-42f0-a8b5-93b2222ab24c req-58756285-b86b-4bd2-aacf-60b45a05390e service nova] Lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG nova.compute.manager [req-e3749dad-b902-42f0-a8b5-93b2222ab24c req-58756285-b86b-4bd2-aacf-60b45a05390e service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] No waiting events found dispatching network-vif-unplugged-78ef9969-b62c-4730-8bbf-e5a8d2c75010 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:16:23 user nova-compute[74805]: WARNING nova.compute.manager [req-e3749dad-b902-42f0-a8b5-93b2222ab24c req-58756285-b86b-4bd2-aacf-60b45a05390e service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Received unexpected event network-vif-unplugged-78ef9969-b62c-4730-8bbf-e5a8d2c75010 for instance with vm_state active and task_state rebuilding.
Nov 15 04:16:23 user nova-compute[74805]: DEBUG nova.compute.manager [req-e3749dad-b902-42f0-a8b5-93b2222ab24c req-58756285-b86b-4bd2-aacf-60b45a05390e service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Received event network-vif-plugged-78ef9969-b62c-4730-8bbf-e5a8d2c75010 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e3749dad-b902-42f0-a8b5-93b2222ab24c req-58756285-b86b-4bd2-aacf-60b45a05390e service nova] Acquiring lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e3749dad-b902-42f0-a8b5-93b2222ab24c req-58756285-b86b-4bd2-aacf-60b45a05390e service nova] Lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e3749dad-b902-42f0-a8b5-93b2222ab24c req-58756285-b86b-4bd2-aacf-60b45a05390e service nova] Lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:23 user nova-compute[74805]: DEBUG nova.compute.manager [req-e3749dad-b902-42f0-a8b5-93b2222ab24c req-58756285-b86b-4bd2-aacf-60b45a05390e service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] No waiting events found dispatching network-vif-plugged-78ef9969-b62c-4730-8bbf-e5a8d2c75010 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:16:23 user nova-compute[74805]: WARNING nova.compute.manager [req-e3749dad-b902-42f0-a8b5-93b2222ab24c req-58756285-b86b-4bd2-aacf-60b45a05390e service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Received unexpected event network-vif-plugged-78ef9969-b62c-4730-8bbf-e5a8d2c75010 for instance with vm_state active and task_state rebuilding.
Nov 15 04:16:24 user nova-compute[74805]: DEBUG nova.compute.manager [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Preparing to wait for external event volume-reimaged-b384dac9-f81c-4c7a-bfc7-93966c62f43d {{(pid=74805) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 15 04:16:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Acquiring lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-34764b69-049b-4d4d-b738-1632781f3728 req-7f3bdfd6-0c81-4057-ad77-2544f9f0f381 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Received event network-changed-51834a6c-a2bb-4135-b3b3-beb4e689e876 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-34764b69-049b-4d4d-b738-1632781f3728 req-7f3bdfd6-0c81-4057-ad77-2544f9f0f381 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Refreshing instance network info cache due to event network-changed-51834a6c-a2bb-4135-b3b3-beb4e689e876. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:16:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-34764b69-049b-4d4d-b738-1632781f3728 req-7f3bdfd6-0c81-4057-ad77-2544f9f0f381 service nova] Acquiring lock "refresh_cache-05f49324-4b7a-4cd4-ada5-9450b9bf1d70" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:16:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-34764b69-049b-4d4d-b738-1632781f3728 req-7f3bdfd6-0c81-4057-ad77-2544f9f0f381 service nova] Acquired lock "refresh_cache-05f49324-4b7a-4cd4-ada5-9450b9bf1d70" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:16:24 user nova-compute[74805]: DEBUG nova.network.neutron [req-34764b69-049b-4d4d-b738-1632781f3728 req-7f3bdfd6-0c81-4057-ad77-2544f9f0f381 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Refreshing network info cache for port 51834a6c-a2bb-4135-b3b3-beb4e689e876 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:16:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c6c2fa4-0900-4edb-b766-b789879d69e4 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Acquiring lock "interface-05f49324-4b7a-4cd4-ada5-9450b9bf1d70-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c6c2fa4-0900-4edb-b766-b789879d69e4 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "interface-05f49324-4b7a-4cd4-ada5-9450b9bf1d70-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:24 user nova-compute[74805]: DEBUG nova.objects.instance [None req-4c6c2fa4-0900-4edb-b766-b789879d69e4 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lazy-loading 'flavor' on Instance uuid 05f49324-4b7a-4cd4-ada5-9450b9bf1d70 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:16:24 user nova-compute[74805]: DEBUG nova.network.neutron [req-34764b69-049b-4d4d-b738-1632781f3728 req-7f3bdfd6-0c81-4057-ad77-2544f9f0f381 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Updated VIF entry in instance network info cache for port 51834a6c-a2bb-4135-b3b3-beb4e689e876. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:16:24 user nova-compute[74805]: DEBUG nova.network.neutron [req-34764b69-049b-4d4d-b738-1632781f3728 req-7f3bdfd6-0c81-4057-ad77-2544f9f0f381 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Updating instance_info_cache with network_info: [{"id": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "address": "fa:16:3e:c4:ea:ce", "network": {"id": "faafe4eb-0b41-4c3a-bce5-3d65543bc634", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-431209234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5fa2f59063040d9a58de745e87380a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51834a6c-a2", "ovs_interfaceid": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:16:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-34764b69-049b-4d4d-b738-1632781f3728 req-7f3bdfd6-0c81-4057-ad77-2544f9f0f381 service nova] Releasing lock "refresh_cache-05f49324-4b7a-4cd4-ada5-9450b9bf1d70" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG nova.objects.instance [None req-4c6c2fa4-0900-4edb-b766-b789879d69e4 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lazy-loading 'pci_requests' on Instance uuid 05f49324-4b7a-4cd4-ada5-9450b9bf1d70 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG nova.objects.base [None req-4c6c2fa4-0900-4edb-b766-b789879d69e4 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Object Instance<05f49324-4b7a-4cd4-ada5-9450b9bf1d70> lazy-loaded attributes: flavor,pci_requests {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG nova.network.neutron [None req-4c6c2fa4-0900-4edb-b766-b789879d69e4 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG nova.policy [None req-4c6c2fa4-0900-4edb-b766-b789879d69e4 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6fca23f109447409a8f31b925071ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5fa2f59063040d9a58de745e87380a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Acquiring lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG nova.objects.instance [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lazy-loading 'flavor' on Instance uuid fdf3e90f-4fd8-4da4-a888-48c7a80fb209 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Acquiring lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:25 user nova-compute[74805]: INFO nova.compute.manager [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Attaching volume c27c663f-7b69-4434-9bc7-16a40032c7b0 to /dev/vdb
Nov 15 04:16:25 user nova-compute[74805]: DEBUG os_brick.utils [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4952ca0-fdb4-463a-9e78-74605bf6ff5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[84109c38-551f-4ba2-bff8-31e57bae233c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f25be5-2f82-4dae-97d0-aa7c243d848b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[667dd4fc-8c8e-4f7c-9c9b-9aa7953aef30]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:16:25 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:16:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3947df57-b70c-401c-9fd3-e1881f9c5091]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG os_brick.utils [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Updating existing volume attachment record: 6fe7d2bd-d096-4da7-ab7b-23f716a834ae {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:16:25 user nova-compute[74805]: DEBUG nova.network.neutron [None req-4c6c2fa4-0900-4edb-b766-b789879d69e4 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Successfully created port: 594121f1-1d63-4ca4-8818-51d77f20a391 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:16:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-cc3fd054-19c9-4ed5-867d-094780f675ec req-cb47cf11-2aea-4f7d-a99c-aaa98abc5cb2 service nova] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Received event network-changed-88133a1b-c635-48f8-b84d-891f943b38f2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-cc3fd054-19c9-4ed5-867d-094780f675ec req-cb47cf11-2aea-4f7d-a99c-aaa98abc5cb2 service nova] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Refreshing instance network info cache due to event network-changed-88133a1b-c635-48f8-b84d-891f943b38f2. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:16:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-cc3fd054-19c9-4ed5-867d-094780f675ec req-cb47cf11-2aea-4f7d-a99c-aaa98abc5cb2 service nova] Acquiring lock "refresh_cache-fdf3e90f-4fd8-4da4-a888-48c7a80fb209" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:16:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-cc3fd054-19c9-4ed5-867d-094780f675ec req-cb47cf11-2aea-4f7d-a99c-aaa98abc5cb2 service nova] Acquired lock "refresh_cache-fdf3e90f-4fd8-4da4-a888-48c7a80fb209" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:16:26 user nova-compute[74805]: DEBUG nova.network.neutron [req-cc3fd054-19c9-4ed5-867d-094780f675ec req-cb47cf11-2aea-4f7d-a99c-aaa98abc5cb2 service nova] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Refreshing network info cache for port 88133a1b-c635-48f8-b84d-891f943b38f2 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:16:26 user nova-compute[74805]: DEBUG nova.network.neutron [None req-4c6c2fa4-0900-4edb-b766-b789879d69e4 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Successfully updated port: 594121f1-1d63-4ca4-8818-51d77f20a391 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c6c2fa4-0900-4edb-b766-b789879d69e4 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Acquiring lock "refresh_cache-05f49324-4b7a-4cd4-ada5-9450b9bf1d70" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c6c2fa4-0900-4edb-b766-b789879d69e4 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Acquired lock "refresh_cache-05f49324-4b7a-4cd4-ada5-9450b9bf1d70" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG nova.network.neutron [None req-4c6c2fa4-0900-4edb-b766-b789879d69e4 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG nova.compute.manager [req-ca883d8b-bbbb-437a-a28a-f432818c36df req-087de856-e8db-48d2-8ed2-4d62aa225637 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Received event network-changed-594121f1-1d63-4ca4-8818-51d77f20a391 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG nova.compute.manager [req-ca883d8b-bbbb-437a-a28a-f432818c36df req-087de856-e8db-48d2-8ed2-4d62aa225637 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Refreshing instance network info cache due to event network-changed-594121f1-1d63-4ca4-8818-51d77f20a391. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ca883d8b-bbbb-437a-a28a-f432818c36df req-087de856-e8db-48d2-8ed2-4d62aa225637 service nova] Acquiring lock "refresh_cache-05f49324-4b7a-4cd4-ada5-9450b9bf1d70" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG nova.network.neutron [req-cc3fd054-19c9-4ed5-867d-094780f675ec req-cb47cf11-2aea-4f7d-a99c-aaa98abc5cb2 service nova] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Updated VIF entry in instance network info cache for port 88133a1b-c635-48f8-b84d-891f943b38f2. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG nova.network.neutron [req-cc3fd054-19c9-4ed5-867d-094780f675ec req-cb47cf11-2aea-4f7d-a99c-aaa98abc5cb2 service nova] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Updating instance_info_cache with network_info: [{"id": "88133a1b-c635-48f8-b84d-891f943b38f2", "address": "fa:16:3e:bb:68:f4", "network": {"id": "e5fa9b51-eaad-4687-9ae5-01132e7768e0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-778141578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "354b7353cecf4f7e8bd6fbc058dd15fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88133a1b-c6", "ovs_interfaceid": "88133a1b-c635-48f8-b84d-891f943b38f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-cc3fd054-19c9-4ed5-867d-094780f675ec req-cb47cf11-2aea-4f7d-a99c-aaa98abc5cb2 service nova] Releasing lock "refresh_cache-fdf3e90f-4fd8-4da4-a888-48c7a80fb209" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG nova.network.neutron [None req-4c6c2fa4-0900-4edb-b766-b789879d69e4 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Updating instance_info_cache with network_info: [{"id": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "address": "fa:16:3e:c4:ea:ce", "network": {"id": "faafe4eb-0b41-4c3a-bce5-3d65543bc634", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-431209234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5fa2f59063040d9a58de745e87380a6", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51834a6c-a2", "ovs_interfaceid": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "594121f1-1d63-4ca4-8818-51d77f20a391", "address": "fa:16:3e:04:e1:3a", "network": {"id": "c5744827-782d-4634-95a0-c795fcab0619", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-167365921", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a5fa2f59063040d9a58de745e87380a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594121f1-1d", "ovs_interfaceid": "594121f1-1d63-4ca4-8818-51d77f20a391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c6c2fa4-0900-4edb-b766-b789879d69e4 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Releasing lock "refresh_cache-05f49324-4b7a-4cd4-ada5-9450b9bf1d70" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ca883d8b-bbbb-437a-a28a-f432818c36df req-087de856-e8db-48d2-8ed2-4d62aa225637 service nova] Acquired lock "refresh_cache-05f49324-4b7a-4cd4-ada5-9450b9bf1d70" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG nova.network.neutron [req-ca883d8b-bbbb-437a-a28a-f432818c36df req-087de856-e8db-48d2-8ed2-4d62aa225637 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Refreshing network info cache for port 594121f1-1d63-4ca4-8818-51d77f20a391 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-4c6c2fa4-0900-4edb-b766-b789879d69e4 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-175864182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-175864182',id=8,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqVjB/VXeAAXbcPR9EXCBQSbi0fxJNcG8/LYTw94OkTxRdq8BS1Qip4iGD0FJLZzAa8glLWaInjyzM+FwK314PVqp4xOkTB5SsVxL+0dMsk7No3KOKU2UWDKovL9DtDJQ==',key_name='tempest-keypair-792239620',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:14:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a5fa2f59063040d9a58de745e87380a6',ramdisk_id='',reservation_id='r-it125hzz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-986558879',owner_user_name='tempest-TaggedAttachmentsTest-986558879-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:14:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6fca23f109447409a8f31b925071ca7',uuid=05f49324-4b7a-4cd4-ada5-9450b9bf1d70,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "594121f1-1d63-4ca4-8818-51d77f20a391", "address": "fa:16:3e:04:e1:3a", "network": {"id": "c5744827-782d-4634-95a0-c795fcab0619", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-167365921", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a5fa2f59063040d9a58de745e87380a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594121f1-1d", "ovs_interfaceid": "594121f1-1d63-4ca4-8818-51d77f20a391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-4c6c2fa4-0900-4edb-b766-b789879d69e4 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Converting VIF {"id": "594121f1-1d63-4ca4-8818-51d77f20a391", "address": "fa:16:3e:04:e1:3a", "network": {"id": "c5744827-782d-4634-95a0-c795fcab0619", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-167365921", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a5fa2f59063040d9a58de745e87380a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594121f1-1d", "ovs_interfaceid": "594121f1-1d63-4ca4-8818-51d77f20a391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-4c6c2fa4-0900-4edb-b766-b789879d69e4 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:e1:3a,bridge_name='br-int',has_traffic_filtering=True,id=594121f1-1d63-4ca4-8818-51d77f20a391,network=Network(c5744827-782d-4634-95a0-c795fcab0619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap594121f1-1d') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG os_vif [None req-4c6c2fa4-0900-4edb-b766-b789879d69e4 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:e1:3a,bridge_name='br-int',has_traffic_filtering=True,id=594121f1-1d63-4ca4-8818-51d77f20a391,network=Network(c5744827-782d-4634-95a0-c795fcab0619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap594121f1-1d') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4f133a7-94ab-5a2f-b55c-1f4c561b7ed2', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap594121f1-1d, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap594121f1-1d, col_values=(('qos', UUID('e3036a06-cba7-4544-a627-ecaaaee98062')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap594121f1-1d, col_values=(('external_ids', {'iface-id': '594121f1-1d63-4ca4-8818-51d77f20a391', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:e1:3a', 'vm-uuid': '05f49324-4b7a-4cd4-ada5-9450b9bf1d70'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:27 user nova-compute[74805]: INFO os_vif [None req-4c6c2fa4-0900-4edb-b766-b789879d69e4 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:e1:3a,bridge_name='br-int',has_traffic_filtering=True,id=594121f1-1d63-4ca4-8818-51d77f20a391,network=Network(c5744827-782d-4634-95a0-c795fcab0619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap594121f1-1d')
Nov 15 04:16:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-4c6c2fa4-0900-4edb-b766-b789879d69e4 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-175864182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-175864182',id=8,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqVjB/VXeAAXbcPR9EXCBQSbi0fxJNcG8/LYTw94OkTxRdq8BS1Qip4iGD0FJLZzAa8glLWaInjyzM+FwK314PVqp4xOkTB5SsVxL+0dMsk7No3KOKU2UWDKovL9DtDJQ==',key_name='tempest-keypair-792239620',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:14:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a5fa2f59063040d9a58de745e87380a6',ramdisk_id='',reservation_id='r-it125hzz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-986558879',owner_user_name='tempest-TaggedAttachmentsTest-986558879-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:14:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6fca23f109447409a8f31b925071ca7',uuid=05f49324-4b7a-4cd4-ada5-9450b9bf1d70,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "594121f1-1d63-4ca4-8818-51d77f20a391", "address": "fa:16:3e:04:e1:3a", "network": {"id": "c5744827-782d-4634-95a0-c795fcab0619", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-167365921", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a5fa2f59063040d9a58de745e87380a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594121f1-1d", "ovs_interfaceid": "594121f1-1d63-4ca4-8818-51d77f20a391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-4c6c2fa4-0900-4edb-b766-b789879d69e4 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Converting VIF {"id": "594121f1-1d63-4ca4-8818-51d77f20a391", "address": "fa:16:3e:04:e1:3a", "network": {"id": "c5744827-782d-4634-95a0-c795fcab0619", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-167365921", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a5fa2f59063040d9a58de745e87380a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594121f1-1d", "ovs_interfaceid": "594121f1-1d63-4ca4-8818-51d77f20a391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-4c6c2fa4-0900-4edb-b766-b789879d69e4 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:e1:3a,bridge_name='br-int',has_traffic_filtering=True,id=594121f1-1d63-4ca4-8818-51d77f20a391,network=Network(c5744827-782d-4634-95a0-c795fcab0619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap594121f1-1d') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-4c6c2fa4-0900-4edb-b766-b789879d69e4 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] attach device xml: <interface type="ethernet">
Nov 15 04:16:27 user nova-compute[74805]:   <mac address="fa:16:3e:04:e1:3a"/>
Nov 15 04:16:27 user nova-compute[74805]:   <model type="virtio"/>
Nov 15 04:16:27 user nova-compute[74805]:   <mtu size="1442"/>
Nov 15 04:16:27 user nova-compute[74805]:   <target dev="tap594121f1-1d"/>
Nov 15 04:16:27 user nova-compute[74805]: </interface>
Nov 15 04:16:27 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:16:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:28 user nova-compute[74805]: DEBUG nova.compute.manager [req-7595a94c-3812-4cc6-a23a-2db2ff70e4c1 req-421757f2-c942-412a-a0b1-426d81aa9ddd service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Received event network-vif-plugged-594121f1-1d63-4ca4-8818-51d77f20a391 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7595a94c-3812-4cc6-a23a-2db2ff70e4c1 req-421757f2-c942-412a-a0b1-426d81aa9ddd service nova] Acquiring lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7595a94c-3812-4cc6-a23a-2db2ff70e4c1 req-421757f2-c942-412a-a0b1-426d81aa9ddd service nova] Lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7595a94c-3812-4cc6-a23a-2db2ff70e4c1 req-421757f2-c942-412a-a0b1-426d81aa9ddd service nova] Lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:28 user nova-compute[74805]: DEBUG nova.compute.manager [req-7595a94c-3812-4cc6-a23a-2db2ff70e4c1 req-421757f2-c942-412a-a0b1-426d81aa9ddd service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] No waiting events found dispatching network-vif-plugged-594121f1-1d63-4ca4-8818-51d77f20a391 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:16:28 user nova-compute[74805]: WARNING nova.compute.manager [req-7595a94c-3812-4cc6-a23a-2db2ff70e4c1 req-421757f2-c942-412a-a0b1-426d81aa9ddd service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Received unexpected event network-vif-plugged-594121f1-1d63-4ca4-8818-51d77f20a391 for instance with vm_state active and task_state None.
Nov 15 04:16:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-4c6c2fa4-0900-4edb-b766-b789879d69e4 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:16:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-4c6c2fa4-0900-4edb-b766-b789879d69e4 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] No BDM found with device name hda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:16:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-4c6c2fa4-0900-4edb-b766-b789879d69e4 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] No VIF found with MAC fa:16:3e:c4:ea:ce, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:16:28 user nova-compute[74805]: DEBUG nova.network.neutron [req-ca883d8b-bbbb-437a-a28a-f432818c36df req-087de856-e8db-48d2-8ed2-4d62aa225637 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Updated VIF entry in instance network info cache for port 594121f1-1d63-4ca4-8818-51d77f20a391. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:16:28 user nova-compute[74805]: DEBUG nova.network.neutron [req-ca883d8b-bbbb-437a-a28a-f432818c36df req-087de856-e8db-48d2-8ed2-4d62aa225637 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Updating instance_info_cache with network_info: [{"id": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "address": "fa:16:3e:c4:ea:ce", "network": {"id": "faafe4eb-0b41-4c3a-bce5-3d65543bc634", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-431209234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5fa2f59063040d9a58de745e87380a6", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51834a6c-a2", "ovs_interfaceid": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "594121f1-1d63-4ca4-8818-51d77f20a391", "address": "fa:16:3e:04:e1:3a", "network": {"id": "c5744827-782d-4634-95a0-c795fcab0619", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-167365921", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a5fa2f59063040d9a58de745e87380a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594121f1-1d", "ovs_interfaceid": "594121f1-1d63-4ca4-8818-51d77f20a391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:16:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-4c6c2fa4-0900-4edb-b766-b789879d69e4 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:16:28 user nova-compute[74805]:   <nova:package version="0.0.0"/>
Nov 15 04:16:28 user nova-compute[74805]:   <nova:name>tempest-device-tagging-server-175864182</nova:name>
Nov 15 04:16:28 user nova-compute[74805]:   <nova:creationTime>2023-11-15 04:16:28</nova:creationTime>
Nov 15 04:16:28 user nova-compute[74805]:   <nova:flavor name="m1.tiny">
Nov 15 04:16:28 user nova-compute[74805]:     <nova:memory>512</nova:memory>
Nov 15 04:16:28 user nova-compute[74805]:     <nova:disk>1</nova:disk>
Nov 15 04:16:28 user nova-compute[74805]:     <nova:swap>0</nova:swap>
Nov 15 04:16:28 user nova-compute[74805]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:16:28 user nova-compute[74805]:     <nova:vcpus>1</nova:vcpus>
Nov 15 04:16:28 user nova-compute[74805]:   </nova:flavor>
Nov 15 04:16:28 user nova-compute[74805]:   <nova:owner>
Nov 15 04:16:28 user nova-compute[74805]:     <nova:user uuid="e6fca23f109447409a8f31b925071ca7">tempest-TaggedAttachmentsTest-986558879-project-member</nova:user>
Nov 15 04:16:28 user nova-compute[74805]:     <nova:project uuid="a5fa2f59063040d9a58de745e87380a6">tempest-TaggedAttachmentsTest-986558879</nova:project>
Nov 15 04:16:28 user nova-compute[74805]:   </nova:owner>
Nov 15 04:16:28 user nova-compute[74805]:   <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:16:28 user nova-compute[74805]:   <nova:ports>
Nov 15 04:16:28 user nova-compute[74805]:     <nova:port uuid="51834a6c-a2bb-4135-b3b3-beb4e689e876">
Nov 15 04:16:28 user nova-compute[74805]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 04:16:28 user nova-compute[74805]:     </nova:port>
Nov 15 04:16:28 user nova-compute[74805]:     <nova:port uuid="594121f1-1d63-4ca4-8818-51d77f20a391">
Nov 15 04:16:28 user nova-compute[74805]:       <nova:ip type="fixed" address="10.10.10.160" ipVersion="4"/>
Nov 15 04:16:28 user nova-compute[74805]:     </nova:port>
Nov 15 04:16:28 user nova-compute[74805]:   </nova:ports>
Nov 15 04:16:28 user nova-compute[74805]: </nova:instance>
Nov 15 04:16:28 user nova-compute[74805]:  {{(pid=74805) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 04:16:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ca883d8b-bbbb-437a-a28a-f432818c36df req-087de856-e8db-48d2-8ed2-4d62aa225637 service nova] Releasing lock "refresh_cache-05f49324-4b7a-4cd4-ada5-9450b9bf1d70" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:16:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c6c2fa4-0900-4edb-b766-b789879d69e4 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "interface-05f49324-4b7a-4cd4-ada5-9450b9bf1d70-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.512s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Acquiring lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:28 user nova-compute[74805]: DEBUG nova.objects.instance [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lazy-loading 'flavor' on Instance uuid 05f49324-4b7a-4cd4-ada5-9450b9bf1d70 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:16:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Acquiring lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:29 user nova-compute[74805]: INFO nova.compute.manager [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Attaching volume 448652d9-1141-4d9d-8f13-dc491f1d50ab to /dev/vdb
Nov 15 04:16:29 user nova-compute[74805]: DEBUG os_brick.utils [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:16:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:29 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01e1b8c-851c-493a-a774-32f4e94222aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:29 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8adde7-2add-4aa0-9539-7ef4cee46e14]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:29 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f265a08-cbfa-491c-9783-faa3732a6d94]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:29 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[387b7855-8d19-4545-b309-c4b2a872ef71]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:16:29 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:16:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:16:29 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:16:29 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c788d3-f68a-42d2-bfd9-95b7cf8b720f]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:29 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:16:29 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:16:29 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:16:29 user nova-compute[74805]: DEBUG os_brick.utils [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:16:29 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Updating existing volume attachment record: 7b9dec91-b126-4f74-8223-999889649cde {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:16:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:30 user nova-compute[74805]: DEBUG nova.compute.manager [req-69525f2e-7def-48e2-9fb1-321f57cb717c req-1f88da77-2d15-48b5-845c-bbd58d6db8e0 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Received event network-vif-plugged-594121f1-1d63-4ca4-8818-51d77f20a391 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-69525f2e-7def-48e2-9fb1-321f57cb717c req-1f88da77-2d15-48b5-845c-bbd58d6db8e0 service nova] Acquiring lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-69525f2e-7def-48e2-9fb1-321f57cb717c req-1f88da77-2d15-48b5-845c-bbd58d6db8e0 service nova] Lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-69525f2e-7def-48e2-9fb1-321f57cb717c req-1f88da77-2d15-48b5-845c-bbd58d6db8e0 service nova] Lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:30 user nova-compute[74805]: DEBUG nova.compute.manager [req-69525f2e-7def-48e2-9fb1-321f57cb717c req-1f88da77-2d15-48b5-845c-bbd58d6db8e0 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] No waiting events found dispatching network-vif-plugged-594121f1-1d63-4ca4-8818-51d77f20a391 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:16:30 user nova-compute[74805]: WARNING nova.compute.manager [req-69525f2e-7def-48e2-9fb1-321f57cb717c req-1f88da77-2d15-48b5-845c-bbd58d6db8e0 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Received unexpected event network-vif-plugged-594121f1-1d63-4ca4-8818-51d77f20a391 for instance with vm_state active and task_state None.
Nov 15 04:16:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUnLfqKY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:16:31 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:16:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:16:31 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:16:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:16:31 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3c5cf9-df8a-48dc-8bbc-52f1339729fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:16:31 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[201726d5-3292-4436-8aca-f7e4454ed0e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0] added
Nov 15 04:16:31 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8f7e3d-cfe7-43dd-a9a2-c350b51c61ef]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Acquiring lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG nova.objects.instance [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Lazy-loading 'flavor' on Instance uuid 89dcacb0-6864-4529-903d-ae46a2dc3bdd {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[472e7a8d-a16d-42ae-b239-38a97ac53fc0]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BUnLfqKY {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BUnLfqKY" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfe4ea3-98c5-40d9-a206-505a5c474e00]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BUnLfqKY'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bcc806-8c2e-493f-a2ca-856f28f219eb]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bd47d1-9ba7-4dd1-8c19-a2f4830ec4e1]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:31 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:31 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:31 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:31 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:31 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:31 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:31 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:31 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fec53b-f7de-4cf7-8b1e-2148dc2e1065]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0, portal: 172.16.0.220,3260]
Nov 15 04:16:31 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0, portal: 172.16.0.220,3260] successful.
Nov 15 04:16:31 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f64feb-fe36-4867-a246-18fa5d27fd68]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e861b3b-9ca2-4b55-bf98-1321e28220f8]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:31 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:31 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:31 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:31 user nova-compute[74805]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)
Nov 15 04:16:31 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:31 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:31 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:31 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:31 user nova-compute[74805]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)
Nov 15 04:16:31 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] HCTL ('33', '-', '-', 0) found on session 8 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2191a14b-123d-452b-b3b7-96fa18854c30]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Searching for a device in session 8 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUnLfqKY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Acquiring lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:31 user nova-compute[74805]: INFO nova.compute.manager [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Attaching volume 7eeda1e3-3470-493c-abc5-0000c70f8287 to /dev/vdb
Nov 15 04:16:31 user nova-compute[74805]: DEBUG os_brick.utils [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1dd89f-786b-4f6e-9d37-ba6fffb1a408]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97014a4-b1dd-4775-999b-bed1027f273a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3827f8b-c02a-447b-8c97-e81647272239]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[790324e1-dd74-4c00-a4ab-a170a09fca77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:16:31 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:16:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f517fce2-34d5-4104-bb4f-d2ff68074941]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG os_brick.utils [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:16:31 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Updating existing volume attachment record: 63b7e2ae-0ddb-4691-b028-6bb09de8409c {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:16:32 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:16:32 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23164336463633563', 'path': '/dev/sdb'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:16:32 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164336463633563', 'path': '/dev/sdb'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:16:32 user nova-compute[74805]: DEBUG nova.objects.instance [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lazy-loading 'flavor' on Instance uuid fdf3e90f-4fd8-4da4-a888-48c7a80fb209 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:16:32 user nova-compute[74805]: DEBUG nova.compute.manager [req-8b4a140b-4901-48b6-b751-a72fcbba47c1 req-0fdab473-f614-4db7-96f0-f3dc5e498d20 service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Received event network-changed-8008b41a-f1bc-4a16-b839-17f69eea93e5 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:32 user nova-compute[74805]: DEBUG nova.compute.manager [req-8b4a140b-4901-48b6-b751-a72fcbba47c1 req-0fdab473-f614-4db7-96f0-f3dc5e498d20 service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Refreshing instance network info cache due to event network-changed-8008b41a-f1bc-4a16-b839-17f69eea93e5. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:16:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8b4a140b-4901-48b6-b751-a72fcbba47c1 req-0fdab473-f614-4db7-96f0-f3dc5e498d20 service nova] Acquiring lock "refresh_cache-89dcacb0-6864-4529-903d-ae46a2dc3bdd" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:16:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8b4a140b-4901-48b6-b751-a72fcbba47c1 req-0fdab473-f614-4db7-96f0-f3dc5e498d20 service nova] Acquired lock "refresh_cache-89dcacb0-6864-4529-903d-ae46a2dc3bdd" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:16:32 user nova-compute[74805]: DEBUG nova.network.neutron [req-8b4a140b-4901-48b6-b751-a72fcbba47c1 req-0fdab473-f614-4db7-96f0-f3dc5e498d20 service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Refreshing network info cache for port 8008b41a-f1bc-4a16-b839-17f69eea93e5 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:16:32 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:16:32 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:16:32 user nova-compute[74805]:   <source dev="/dev/sdb"/>
Nov 15 04:16:32 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:16:32 user nova-compute[74805]:   <serial>c27c663f-7b69-4434-9bc7-16a40032c7b0</serial>
Nov 15 04:16:32 user nova-compute[74805]: </disk>
Nov 15 04:16:32 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:16:32 user nova-compute[74805]: DEBUG nova.network.neutron [req-8b4a140b-4901-48b6-b751-a72fcbba47c1 req-0fdab473-f614-4db7-96f0-f3dc5e498d20 service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Updated VIF entry in instance network info cache for port 8008b41a-f1bc-4a16-b839-17f69eea93e5. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:16:32 user nova-compute[74805]: DEBUG nova.network.neutron [req-8b4a140b-4901-48b6-b751-a72fcbba47c1 req-0fdab473-f614-4db7-96f0-f3dc5e498d20 service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Updating instance_info_cache with network_info: [{"id": "8008b41a-f1bc-4a16-b839-17f69eea93e5", "address": "fa:16:3e:ea:64:39", "network": {"id": "6765ab2e-ca61-4ee7-873b-c41ae0c8f751", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-335552907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc0430dda414f238788cc4d75813097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8008b41a-f1", "ovs_interfaceid": "8008b41a-f1bc-4a16-b839-17f69eea93e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:16:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8b4a140b-4901-48b6-b751-a72fcbba47c1 req-0fdab473-f614-4db7-96f0-f3dc5e498d20 service nova] Releasing lock "refresh_cache-89dcacb0-6864-4529-903d-ae46a2dc3bdd" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:16:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:32 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:16:32 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:16:32 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] No VIF found with MAC fa:16:3e:bb:68:f4, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:16:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d077238f-56db-4e4c-812c-21d6643c29fd tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.527s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Acquiring lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:33 user nova-compute[74805]: DEBUG os_brick.utils [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:16:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:33 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f091894f-2e84-491f-a55c-3a2cf1b990f5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:33 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c91cba-8eca-4289-8423-65bb616c689f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:33 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a8638c-75c0-4a7c-98e2-d959331a8925]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:33 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9006ac44-3a49-45cf-8644-225630fcbada]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:16:33 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:16:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:16:33 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:16:33 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c845b4-6132-4237-ac67-87faacf81682]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:33 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:16:33 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:16:33 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:16:33 user nova-compute[74805]: DEBUG os_brick.utils [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:16:34 user nova-compute[74805]: INFO nova.compute.manager [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Swapping volume c27c663f-7b69-4434-9bc7-16a40032c7b0 for 02d1edf9-9210-4f74-8216-f7e9350759aa
Nov 15 04:16:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QEPMJSkN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:16:34 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:16:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:16:34 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:16:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:16:34 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b62d20-4ada-48eb-879b-8d3875ddca4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:16:34 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[176bdc8f-1194-4fa3-a227-52266eb5d0a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab] added
Nov 15 04:16:34 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c1cdb5-dccb-4054-833a-50d9274a0ead]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba79301-94f6-4956-8d68-9e76f390c185]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QEPMJSkN {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QEPMJSkN" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c208642-2985-4f32-85c7-5871b80dfe94]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QEPMJSkN'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73daeb2-02f2-4c9c-8e31-f291858804fa]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c83702-7ff6-46c3-8d41-7632e4b6db9a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:34 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:34 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:34 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:34 user nova-compute[74805]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)
Nov 15 04:16:34 user nova-compute[74805]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:34 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:34 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:34 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:34 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:34 user nova-compute[74805]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)
Nov 15 04:16:34 user nova-compute[74805]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:34 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ceb1c1-8d93-4ac1-9833-a75b17e111c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab, portal: 172.16.0.220,3260]
Nov 15 04:16:34 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab, portal: 172.16.0.220,3260] successful.
Nov 15 04:16:34 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce89c53-ffd1-4981-b73a-fbc9b73369e6]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[02594a51-f336-4d77-b0b2-1e6e2d7e1ccf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)
Nov 15 04:16:34 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:34 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:34 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:34 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:34 user nova-compute[74805]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)
Nov 15 04:16:34 user nova-compute[74805]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:34 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)
Nov 15 04:16:34 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:34 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:34 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:34 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:34 user nova-compute[74805]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)
Nov 15 04:16:34 user nova-compute[74805]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:34 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a077b62-cc99-49fe-bce1-2a0b50c91b56]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QEPMJSkN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:16:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:35 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:16:35 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23834393832613866', 'path': '/dev/sdh'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:16:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834393832613866', 'path': '/dev/sdh'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:16:35 user nova-compute[74805]: DEBUG nova.objects.instance [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lazy-loading 'flavor' on Instance uuid 05f49324-4b7a-4cd4-ada5-9450b9bf1d70 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:16:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:16:35 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:16:35 user nova-compute[74805]:   <source dev="/dev/sdh"/>
Nov 15 04:16:35 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:16:35 user nova-compute[74805]:   <serial>448652d9-1141-4d9d-8f13-dc491f1d50ab</serial>
Nov 15 04:16:35 user nova-compute[74805]: </disk>
Nov 15 04:16:35 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:16:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:16:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] No BDM found with device name hda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:16:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] No VIF found with MAC fa:16:3e:c4:ea:ce, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8c95e93e-9c79-4b31-a9cf-3c5850c3f66a tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.041s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ALOSNtnu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:16:36 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:16:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:16:36 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:16:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:16:36 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd5b5aa-5eb7-418a-9726-66327bf57d9d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:16:36 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb6ee42-a5b5-46f1-b00e-e31d14f38ef8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287] added
Nov 15 04:16:36 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bac6ced-3d92-4d03-8ecb-6fcb2f031674]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1d4af5-068d-493e-b560-0bb9d40a6354]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ALOSNtnu {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ALOSNtnu" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1781ec6-e088-48e6-9365-14e3316486e6]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ALOSNtnu'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f533228a-78db-4e0d-8e7d-4305a5ccc30f]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9040100-742c-4d17-9f71-f1a246798041]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)
Nov 15 04:16:36 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:36 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:36 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:36 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:36 user nova-compute[74805]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)
Nov 15 04:16:36 user nova-compute[74805]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:36 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)
Nov 15 04:16:36 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:36 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:36 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:36 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:36 user nova-compute[74805]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)
Nov 15 04:16:36 user nova-compute[74805]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:36 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5111c1-5305-438e-803f-e493c3a7f3f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287, portal: 172.16.0.220,3260]
Nov 15 04:16:36 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287, portal: 172.16.0.220,3260] successful.
Nov 15 04:16:36 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[344c38b3-a69e-492b-8cc3-eeea37e41f21]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd229e1-6e13-4edf-8f41-6528188759f3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)
Nov 15 04:16:36 user nova-compute[74805]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)
Nov 15 04:16:36 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:36 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:36 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:36 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:36 user nova-compute[74805]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)
Nov 15 04:16:36 user nova-compute[74805]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:36 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)
Nov 15 04:16:36 user nova-compute[74805]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)
Nov 15 04:16:36 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:36 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:36 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:36 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:36 user nova-compute[74805]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)
Nov 15 04:16:36 user nova-compute[74805]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:36 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5606e1-ca20-461a-b40b-f5dc96018353]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:16:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ALOSNtnu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:16:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Acquiring lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:37 user nova-compute[74805]: INFO nova.compute.manager [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Detaching volume 448652d9-1141-4d9d-8f13-dc491f1d50ab
Nov 15 04:16:37 user nova-compute[74805]: INFO nova.virt.block_device [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Attempting to driver detach volume 448652d9-1141-4d9d-8f13-dc491f1d50ab from mountpoint /dev/vdb
Nov 15 04:16:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Attempting to detach device vdb from instance 05f49324-4b7a-4cd4-ada5-9450b9bf1d70 from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:16:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:16:37 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:16:37 user nova-compute[74805]:   <source dev="/dev/sdh"/>
Nov 15 04:16:37 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:16:37 user nova-compute[74805]:   <serial>448652d9-1141-4d9d-8f13-dc491f1d50ab</serial>
Nov 15 04:16:37 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 04:16:37 user nova-compute[74805]: </disk>
Nov 15 04:16:37 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:16:37 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Successfully detached device vdb from instance 05f49324-4b7a-4cd4-ada5-9450b9bf1d70 from the persistent domain config.
Nov 15 04:16:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 05f49324-4b7a-4cd4-ada5-9450b9bf1d70 from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:16:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:16:37 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:16:37 user nova-compute[74805]:   <source dev="/dev/sdh"/>
Nov 15 04:16:37 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:16:37 user nova-compute[74805]:   <serial>448652d9-1141-4d9d-8f13-dc491f1d50ab</serial>
Nov 15 04:16:37 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 04:16:37 user nova-compute[74805]: </disk>
Nov 15 04:16:37 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:16:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:16:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23937613036383438', 'path': '/dev/sdi'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:16:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937613036383438', 'path': '/dev/sdi'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:16:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:37 user nova-compute[74805]: DEBUG nova.objects.instance [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Lazy-loading 'flavor' on Instance uuid 89dcacb0-6864-4529-903d-ae46a2dc3bdd {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:16:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] attach device xml: <disk type="block" device="disk">
Nov 15 04:16:37 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:16:37 user nova-compute[74805]:   <source dev="/dev/sdi"/>
Nov 15 04:16:37 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:16:37 user nova-compute[74805]:   <serial>7eeda1e3-3470-493c-abc5-0000c70f8287</serial>
Nov 15 04:16:37 user nova-compute[74805]: </disk>
Nov 15 04:16:37 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:16:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 05f49324-4b7a-4cd4-ada5-9450b9bf1d70 {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:16:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:16:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:16:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] No VIF found with MAC fa:16:3e:ea:64:39, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:16:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b57631c3-0136-4539-beaf-04c40a88e555 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.197s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FpCDKNtq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fdf3e90f-4fd8-4da4-a888-48c7a80fb209', 'attached_at': '', 'detached_at': '', 'volume_id': '02d1edf9-9210-4f74-8216-f7e9350759aa', 'serial': '02d1edf9-9210-4f74-8216-f7e9350759aa'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUnLfqKY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'fdf3e90f-4fd8-4da4-a888-48c7a80fb209', 'attached_at': '', 'detached_at': '', 'volume_id': 'c27c663f-7b69-4434-9bc7-16a40032c7b0', 'serial'} {{(pid=74805) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FpCDKNtq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:16:39 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:16:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:16:39 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:16:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:16:39 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad4d021-e88c-4d9c-9d8a-bb70701ac528]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:16:39 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0579807-ffef-4c2f-acd5-8d4e638c480c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa] added
Nov 15 04:16:39 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b23c81-3e92-4b83-934c-80fe07fd739f]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[38684c55-3f87-4dbc-b7d9-14798208a05b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FpCDKNtq {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FpCDKNtq" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d680f9d4-fb83-4dcc-8120-5bbf3c5a2c25]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FpCDKNtq'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[672b1347-99f5-4237-8443-2de2e7c30cbf]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e00d2f-3c8a-4e8a-ae4a-ebb0e36167e9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:39 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:39 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-51976dac-5b7f-4224-b676-7a0c44e51605 tempest-VolumesAssistedSnapshotsTest-1103104356 tempest-VolumesAssistedSnapshotsTest-1103104356-project] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] volume_snapshot_create: create_info: {'snapshot_id': '2b4cff91-f0bc-433f-9bc9-efc2128cfc4b', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74805) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-51976dac-5b7f-4224-b676-7a0c44e51605 tempest-VolumesAssistedSnapshotsTest-1103104356 tempest-VolumesAssistedSnapshotsTest-1103104356-project] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] snap xml: <domainsnapshot>
Nov 15 04:16:39 user nova-compute[74805]:   <disks>
Nov 15 04:16:39 user nova-compute[74805]:     <disk name="/dev/sdi" snapshot="external" type="file">
Nov 15 04:16:39 user nova-compute[74805]:       <source file="/dev/new_file"/>
Nov 15 04:16:39 user nova-compute[74805]:     </disk>
Nov 15 04:16:39 user nova-compute[74805]:     <disk name="vda" snapshot="no"/>
Nov 15 04:16:39 user nova-compute[74805]:   </disks>
Nov 15 04:16:39 user nova-compute[74805]: </domainsnapshot>
Nov 15 04:16:39 user nova-compute[74805]:  {{(pid=74805) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG nova.objects.instance [None req-51976dac-5b7f-4224-b676-7a0c44e51605 tempest-VolumesAssistedSnapshotsTest-1103104356 tempest-VolumesAssistedSnapshotsTest-1103104356-project] Lazy-loading 'system_metadata' on Instance uuid 89dcacb0-6864-4529-903d-ae46a2dc3bdd {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:16:39 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-51976dac-5b7f-4224-b676-7a0c44e51605 tempest-VolumesAssistedSnapshotsTest-1103104356 tempest-VolumesAssistedSnapshotsTest-1103104356-project] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a48d12-3ea7-4eb1-9e40-ffebd4d9c6c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa, portal: 172.16.0.220,3260]
Nov 15 04:16:39 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa, portal: 172.16.0.220,3260] successful.
Nov 15 04:16:39 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [None req-51976dac-5b7f-4224-b676-7a0c44e51605 tempest-VolumesAssistedSnapshotsTest-1103104356 tempest-VolumesAssistedSnapshotsTest-1103104356-project] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Traceback (most recent call last):
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]     rv = execute(f, *args, **kwargs)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]     six.reraise(c, e, tb)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]     raise value
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]     rv = meth(*args, **kwargs)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] 
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [None req-51976dac-5b7f-4224-b676-7a0c44e51605 tempest-VolumesAssistedSnapshotsTest-1103104356 tempest-VolumesAssistedSnapshotsTest-1103104356-project] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Traceback (most recent call last):
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]     self._volume_snapshot_create(context, instance, guest,
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]     rv = execute(f, *args, **kwargs)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]     six.reraise(c, e, tb)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]     raise value
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]     rv = meth(*args, **kwargs)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] 
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-c2c301ad-2fcf-4f6a-8966-7c86b278735f tempest-VolumesAssistedSnapshotsTest-1103104356 tempest-VolumesAssistedSnapshotsTest-1103104356-project] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] volume_snapshot_delete: delete_info: {'volume_id': '7eeda1e3-3470-493c-abc5-0000c70f8287'} {{(pid=74805) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [None req-c2c301ad-2fcf-4f6a-8966-7c86b278735f tempest-VolumesAssistedSnapshotsTest-1103104356 tempest-VolumesAssistedSnapshotsTest-1103104356-project] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Traceback (most recent call last):
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd]     if delete_info['type'] != 'qcow2':
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] KeyError: 'type'
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] 
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[88647470-c8a9-4634-a1ae-061035c87a78]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [None req-51976dac-5b7f-4224-b676-7a0c44e51605 tempest-VolumesAssistedSnapshotsTest-1103104356 tempest-VolumesAssistedSnapshotsTest-1103104356-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 2b4cff91-f0bc-433f-9bc9-efc2128cfc4b could not be found.
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     raise value
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver 
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver 
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 2b4cff91-f0bc-433f-9bc9-efc2128cfc4b could not be found. (HTTP 404) (Request-ID: req-bd2718d5-8fe2-4b0b-830a-9e74b1a3274f)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver 
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver 
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 2b4cff91-f0bc-433f-9bc9-efc2128cfc4b could not be found.
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver 
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9659b8cc-230b-4cb6-9515-b90e32e93bd3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:39 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)
Nov 15 04:16:39 user nova-compute[74805]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:39 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] HCTL ('41', '-', '-', 0) found on session 12 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver [None req-c2c301ad-2fcf-4f6a-8966-7c86b278735f tempest-VolumesAssistedSnapshotsTest-1103104356 tempest-VolumesAssistedSnapshotsTest-1103104356-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver 
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver 
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-63f0abc7-05fe-43ee-90cd-e46ca8f40c3d)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver 
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver 
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 15 04:16:39 user nova-compute[74805]: ERROR nova.virt.libvirt.driver 
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server [None req-51976dac-5b7f-4224-b676-7a0c44e51605 tempest-VolumesAssistedSnapshotsTest-1103104356 tempest-VolumesAssistedSnapshotsTest-1103104356-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     raise value
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server 
Nov 15 04:16:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server [None req-c2c301ad-2fcf-4f6a-8966-7c86b278735f tempest-VolumesAssistedSnapshotsTest-1103104356 tempest-VolumesAssistedSnapshotsTest-1103104356-project] Exception during message handling: KeyError: 'type'
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 15 04:16:39 user nova-compute[74805]: ERROR oslo_messaging.rpc.server 
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Acquiring lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:39 user nova-compute[74805]: INFO nova.compute.manager [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Detaching volume 7eeda1e3-3470-493c-abc5-0000c70f8287
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.266s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02f427c-aaef-4d28-b9b7-f57831972f0a]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FpCDKNtq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:16:39 user nova-compute[74805]: INFO nova.virt.block_device [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Attempting to driver detach volume 7eeda1e3-3470-493c-abc5-0000c70f8287 from mountpoint /dev/vdb
Nov 15 04:16:39 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Attempting to detach device vdb from instance 89dcacb0-6864-4529-903d-ae46a2dc3bdd from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] detach device xml: <disk type="block" device="disk">
Nov 15 04:16:39 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:16:39 user nova-compute[74805]:   <source dev="/dev/sdi"/>
Nov 15 04:16:39 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:16:39 user nova-compute[74805]:   <serial>7eeda1e3-3470-493c-abc5-0000c70f8287</serial>
Nov 15 04:16:39 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:16:39 user nova-compute[74805]: </disk>
Nov 15 04:16:39 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:16:39 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Successfully detached device vdb from instance 89dcacb0-6864-4529-903d-ae46a2dc3bdd from the persistent domain config.
Nov 15 04:16:39 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 89dcacb0-6864-4529-903d-ae46a2dc3bdd from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:16:39 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] detach device xml: <disk type="block" device="disk">
Nov 15 04:16:39 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:16:39 user nova-compute[74805]:   <source dev="/dev/sdi"/>
Nov 15 04:16:39 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:16:39 user nova-compute[74805]:   <serial>7eeda1e3-3470-493c-abc5-0000c70f8287</serial>
Nov 15 04:16:39 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:16:39 user nova-compute[74805]: </disk>
Nov 15 04:16:39 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:16:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 89dcacb0-6864-4529-903d-ae46a2dc3bdd {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:16:40 user nova-compute[74805]: DEBUG nova.compute.manager [req-a19b1df5-68a5-48a5-85dc-bd8ec55d3455 req-e80bc312-6dc4-4c11-baeb-b4422f0af807 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-changed-8fb4ff06-71a7-4fe2-81b0-e4d980e75a23 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:40 user nova-compute[74805]: DEBUG nova.compute.manager [req-a19b1df5-68a5-48a5-85dc-bd8ec55d3455 req-e80bc312-6dc4-4c11-baeb-b4422f0af807 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Refreshing instance network info cache due to event network-changed-8fb4ff06-71a7-4fe2-81b0-e4d980e75a23. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:16:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-a19b1df5-68a5-48a5-85dc-bd8ec55d3455 req-e80bc312-6dc4-4c11-baeb-b4422f0af807 service nova] Acquiring lock "refresh_cache-e1a3273f-42d2-4582-b539-3c7c6111cf3c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:16:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-a19b1df5-68a5-48a5-85dc-bd8ec55d3455 req-e80bc312-6dc4-4c11-baeb-b4422f0af807 service nova] Acquired lock "refresh_cache-e1a3273f-42d2-4582-b539-3c7c6111cf3c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:16:40 user nova-compute[74805]: DEBUG nova.network.neutron [req-a19b1df5-68a5-48a5-85dc-bd8ec55d3455 req-e80bc312-6dc4-4c11-baeb-b4422f0af807 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Refreshing network info cache for port 8fb4ff06-71a7-4fe2-81b0-e4d980e75a23 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:16:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.638s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:16:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] <== connect_volume: return (1640ms) {'type': 'block', 'scsi_wwn': '23638373637356430', 'path': '/dev/sdj'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:16:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638373637356430', 'path': '/dev/sdj'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:16:40 user nova-compute[74805]: DEBUG nova.objects.instance [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Lazy-loading 'flavor' on Instance uuid fdf3e90f-4fd8-4da4-a888-48c7a80fb209 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:16:41 user nova-compute[74805]: DEBUG nova.network.neutron [req-a19b1df5-68a5-48a5-85dc-bd8ec55d3455 req-e80bc312-6dc4-4c11-baeb-b4422f0af807 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Updated VIF entry in instance network info cache for port 8fb4ff06-71a7-4fe2-81b0-e4d980e75a23. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:16:41 user nova-compute[74805]: DEBUG nova.network.neutron [req-a19b1df5-68a5-48a5-85dc-bd8ec55d3455 req-e80bc312-6dc4-4c11-baeb-b4422f0af807 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Updating instance_info_cache with network_info: [{"id": "8fb4ff06-71a7-4fe2-81b0-e4d980e75a23", "address": "fa:16:3e:4f:d9:b6", "network": {"id": "c9df097d-17ec-4bdd-aa5b-531b2f59c8e1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1457673667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb4ff06-71", "ovs_interfaceid": "8fb4ff06-71a7-4fe2-81b0-e4d980e75a23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2fd61de8-594b-4c85-957d-db3f622ffdc2", "address": "fa:16:3e:b6:83:57", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fd61de8-59", "ovs_interfaceid": "2fd61de8-594b-4c85-957d-db3f622ffdc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f5678db-1255-42ae-84ca-4d1b3b5dac84", "address": "fa:16:3e:60:3d:03", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f5678db-12", "ovs_interfaceid": "4f5678db-1255-42ae-84ca-4d1b3b5dac84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45598f97-ca9c-423f-bf8e-e7ce6aba0073", "address": "fa:16:3e:d0:dc:9e", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45598f97-ca", "ovs_interfaceid": "45598f97-ca9c-423f-bf8e-e7ce6aba0073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39f4ba29-3df3-4389-ae97-476675222a14", "address": "fa:16:3e:95:db:7d", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f4ba29-3d", "ovs_interfaceid": "39f4ba29-3df3-4389-ae97-476675222a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2cf28e2-46e0-450c-a153-23e6ef6da5f2", "address": "fa:16:3e:46:51:3c", "network": {"id": "da7f4cb9-5e5c-4598-a27b-94e6c59c582d", "bridge": "br-int", "label": "tempest-device-tagging-net2-610177095", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2cf28e2-46", "ovs_interfaceid": "c2cf28e2-46e0-450c-a153-23e6ef6da5f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "705a958d-3fb6-4fe9-ba7e-e69d242dde68", "address": "fa:16:3e:58:83:23", "network": {"id": "da7f4cb9-5e5c-4598-a27b-94e6c59c582d", "bridge": "br-int", "label": "tempest-device-tagging-net2-610177095", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705a958d-3f", "ovs_interfaceid": "705a958d-3fb6-4fe9-ba7e-e69d242dde68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:16:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-a19b1df5-68a5-48a5-85dc-bd8ec55d3455 req-e80bc312-6dc4-4c11-baeb-b4422f0af807 service nova] Releasing lock "refresh_cache-e1a3273f-42d2-4582-b539-3c7c6111cf3c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:16:41 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74805) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 04:16:41 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] COPY block job progress, current cursor: 106954752 final cursor: 1073741824 {{(pid=74805) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] COPY block job progress, current cursor: 248512512 final cursor: 1073741824 {{(pid=74805) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG nova.compute.manager [req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 req-756ed8f5-81b0-413f-971f-9cd48ac4d75c service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Received event volume-reimaged-b384dac9-f81c-4c7a-bfc7-93966c62f43d {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 req-756ed8f5-81b0-413f-971f-9cd48ac4d75c service nova] Acquiring lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 req-756ed8f5-81b0-413f-971f-9cd48ac4d75c service nova] Lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 req-756ed8f5-81b0-413f-971f-9cd48ac4d75c service nova] Lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG nova.compute.manager [req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 req-756ed8f5-81b0-413f-971f-9cd48ac4d75c service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Processing event volume-reimaged-b384dac9-f81c-4c7a-bfc7-93966c62f43d {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG nova.compute.manager [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Instance event wait completed in 18 seconds for volume-reimaged {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:16:42 user nova-compute[74805]: INFO nova.virt.block_device [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Booting with volume b384dac9-f81c-4c7a-bfc7-93966c62f43d at /dev/vda
Nov 15 04:16:42 user nova-compute[74805]: DEBUG os_brick.utils [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7307534-f1f4-4479-8b77-14cd44834ba2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] COPY block job progress, current cursor: 426770432 final cursor: 1073741824 {{(pid=74805) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fba4b32-ad80-46ff-9524-67d2affeb55b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[191f631e-7839-4f83-9d92-7ec2e302f1ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca40f68-c145-46e7-9a73-db43c99a3353]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:16:42 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:16:42 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[75493d65-8464-4150-bb8c-9fd35e4ae588]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG os_brick.utils [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Updating existing volume attachment record: 606f7b1d-4976-4ee6-b72f-bfd2f35e601d {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:42 user nova-compute[74805]: INFO nova.compute.manager [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Terminating instance
Nov 15 04:16:42 user nova-compute[74805]: DEBUG nova.compute.manager [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] COPY block job progress, current cursor: 613416960 final cursor: 1073741824 {{(pid=74805) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG nova.compute.manager [req-5c823dd7-18be-4484-81bd-82c0e95f8c24 req-47cca157-fe86-4e58-b2ef-becd6056a3f3 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-unplugged-8fb4ff06-71a7-4fe2-81b0-e4d980e75a23 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5c823dd7-18be-4484-81bd-82c0e95f8c24 req-47cca157-fe86-4e58-b2ef-becd6056a3f3 service nova] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5c823dd7-18be-4484-81bd-82c0e95f8c24 req-47cca157-fe86-4e58-b2ef-becd6056a3f3 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5c823dd7-18be-4484-81bd-82c0e95f8c24 req-47cca157-fe86-4e58-b2ef-becd6056a3f3 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG nova.compute.manager [req-5c823dd7-18be-4484-81bd-82c0e95f8c24 req-47cca157-fe86-4e58-b2ef-becd6056a3f3 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] No waiting events found dispatching network-vif-unplugged-8fb4ff06-71a7-4fe2-81b0-e4d980e75a23 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG nova.compute.manager [req-5c823dd7-18be-4484-81bd-82c0e95f8c24 req-47cca157-fe86-4e58-b2ef-becd6056a3f3 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-unplugged-8fb4ff06-71a7-4fe2-81b0-e4d980e75a23 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG nova.compute.manager [req-caa8b906-e2ea-4920-8396-cb1fb52e3016 req-bd9145c7-585c-4b88-ab2f-91170c7bcc12 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-unplugged-2fd61de8-594b-4c85-957d-db3f622ffdc2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-caa8b906-e2ea-4920-8396-cb1fb52e3016 req-bd9145c7-585c-4b88-ab2f-91170c7bcc12 service nova] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-caa8b906-e2ea-4920-8396-cb1fb52e3016 req-bd9145c7-585c-4b88-ab2f-91170c7bcc12 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-caa8b906-e2ea-4920-8396-cb1fb52e3016 req-bd9145c7-585c-4b88-ab2f-91170c7bcc12 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG nova.compute.manager [req-caa8b906-e2ea-4920-8396-cb1fb52e3016 req-bd9145c7-585c-4b88-ab2f-91170c7bcc12 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] No waiting events found dispatching network-vif-unplugged-2fd61de8-594b-4c85-957d-db3f622ffdc2 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG nova.compute.manager [req-caa8b906-e2ea-4920-8396-cb1fb52e3016 req-bd9145c7-585c-4b88-ab2f-91170c7bcc12 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-unplugged-2fd61de8-594b-4c85-957d-db3f622ffdc2 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG nova.compute.manager [req-1e8b0725-0ff2-4311-ae77-ad5759340f0b req-2020d6f0-3d5d-4b13-b251-c8f22d929a41 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-unplugged-4f5678db-1255-42ae-84ca-4d1b3b5dac84 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1e8b0725-0ff2-4311-ae77-ad5759340f0b req-2020d6f0-3d5d-4b13-b251-c8f22d929a41 service nova] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1e8b0725-0ff2-4311-ae77-ad5759340f0b req-2020d6f0-3d5d-4b13-b251-c8f22d929a41 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1e8b0725-0ff2-4311-ae77-ad5759340f0b req-2020d6f0-3d5d-4b13-b251-c8f22d929a41 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG nova.compute.manager [req-1e8b0725-0ff2-4311-ae77-ad5759340f0b req-2020d6f0-3d5d-4b13-b251-c8f22d929a41 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] No waiting events found dispatching network-vif-unplugged-4f5678db-1255-42ae-84ca-4d1b3b5dac84 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG nova.compute.manager [req-1e8b0725-0ff2-4311-ae77-ad5759340f0b req-2020d6f0-3d5d-4b13-b251-c8f22d929a41 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-unplugged-4f5678db-1255-42ae-84ca-4d1b3b5dac84 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] COPY block job progress, current cursor: 672137216 final cursor: 1073741824 {{(pid=74805) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] COPY block job progress, current cursor: 830472192 final cursor: 1073741824 {{(pid=74805) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 04:16:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] COPY block job progress, current cursor: 991952896 final cursor: 1073741824 {{(pid=74805) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 04:16:44 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Instance destroyed successfully.
Nov 15 04:16:44 user nova-compute[74805]: DEBUG nova.objects.instance [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lazy-loading 'resources' on Instance uuid e1a3273f-42d2-4582-b539-3c7c6111cf3c {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:16:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209991627',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209991627',id=11,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL2p+ejOi8AQ04hPhdzGD7OzJ/dixq8QFeSc5qrTwC3wpMDZ0/iY+E0x5r4vEKcyTBCdkRv6GOAto/wSL59XHp3RSRI0zh0xWba9e42A7dyuK3bVVrQh2BApcmYL2JgNQ==',key_name='tempest-keypair-902492598',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:15:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47b57aff3d714da1a9872ecec24524ae',ramdisk_id='',reservation_id='r-len0vorx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1105776980',owner_user_name='tempest-TaggedBootDevicesTest-1105776980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:15:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52d077ca42b442e9913fc83e1cc73436',uuid=e1a3273f-42d2-4582-b539-3c7c6111cf3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fb4ff06-71a7-4fe2-81b0-e4d980e75a23", "address": "fa:16:3e:4f:d9:b6", "network": {"id": "c9df097d-17ec-4bdd-aa5b-531b2f59c8e1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1457673667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb4ff06-71", "ovs_interfaceid": "8fb4ff06-71a7-4fe2-81b0-e4d980e75a23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:16:44 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converting VIF {"id": "8fb4ff06-71a7-4fe2-81b0-e4d980e75a23", "address": "fa:16:3e:4f:d9:b6", "network": {"id": "c9df097d-17ec-4bdd-aa5b-531b2f59c8e1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1457673667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb4ff06-71", "ovs_interfaceid": "8fb4ff06-71a7-4fe2-81b0-e4d980e75a23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:16:44 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:d9:b6,bridge_name='br-int',has_traffic_filtering=True,id=8fb4ff06-71a7-4fe2-81b0-e4d980e75a23,network=Network(c9df097d-17ec-4bdd-aa5b-531b2f59c8e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fb4ff06-71') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:16:44 user nova-compute[74805]: DEBUG os_vif [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:d9:b6,bridge_name='br-int',has_traffic_filtering=True,id=8fb4ff06-71a7-4fe2-81b0-e4d980e75a23,network=Network(c9df097d-17ec-4bdd-aa5b-531b2f59c8e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fb4ff06-71') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:16:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fb4ff06-71, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=179b0de5-b11d-40b7-a7a7-4d3e57b0865c) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: INFO os_vif [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:d9:b6,bridge_name='br-int',has_traffic_filtering=True,id=8fb4ff06-71a7-4fe2-81b0-e4d980e75a23,network=Network(c9df097d-17ec-4bdd-aa5b-531b2f59c8e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fb4ff06-71')
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209991627',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209991627',id=11,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL2p+ejOi8AQ04hPhdzGD7OzJ/dixq8QFeSc5qrTwC3wpMDZ0/iY+E0x5r4vEKcyTBCdkRv6GOAto/wSL59XHp3RSRI0zh0xWba9e42A7dyuK3bVVrQh2BApcmYL2JgNQ==',key_name='tempest-keypair-902492598',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:15:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47b57aff3d714da1a9872ecec24524ae',ramdisk_id='',reservation_id='r-len0vorx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1105776980',owner_user_name='tempest-TaggedBootDevicesTest-1105776980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:15:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52d077ca42b442e9913fc83e1cc73436',uuid=e1a3273f-42d2-4582-b539-3c7c6111cf3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2fd61de8-594b-4c85-957d-db3f622ffdc2", "address": "fa:16:3e:b6:83:57", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fd61de8-59", "ovs_interfaceid": "2fd61de8-594b-4c85-957d-db3f622ffdc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converting VIF {"id": "2fd61de8-594b-4c85-957d-db3f622ffdc2", "address": "fa:16:3e:b6:83:57", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fd61de8-59", "ovs_interfaceid": "2fd61de8-594b-4c85-957d-db3f622ffdc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:83:57,bridge_name='br-int',has_traffic_filtering=True,id=2fd61de8-594b-4c85-957d-db3f622ffdc2,network=Network(6d4c82b5-fae6-47b6-a546-2146dc5391c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2fd61de8-59') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_vif [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:83:57,bridge_name='br-int',has_traffic_filtering=True,id=2fd61de8-594b-4c85-957d-db3f622ffdc2,network=Network(6d4c82b5-fae6-47b6-a546-2146dc5391c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2fd61de8-59') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2fd61de8-59, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f618c4c8-bb5e-4df4-be7d-ad116101c37b) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: INFO os_vif [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:83:57,bridge_name='br-int',has_traffic_filtering=True,id=2fd61de8-594b-4c85-957d-db3f622ffdc2,network=Network(6d4c82b5-fae6-47b6-a546-2146dc5391c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2fd61de8-59')
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209991627',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209991627',id=11,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL2p+ejOi8AQ04hPhdzGD7OzJ/dixq8QFeSc5qrTwC3wpMDZ0/iY+E0x5r4vEKcyTBCdkRv6GOAto/wSL59XHp3RSRI0zh0xWba9e42A7dyuK3bVVrQh2BApcmYL2JgNQ==',key_name='tempest-keypair-902492598',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:15:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47b57aff3d714da1a9872ecec24524ae',ramdisk_id='',reservation_id='r-len0vorx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1105776980',owner_user_name='tempest-TaggedBootDevicesTest-1105776980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:15:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52d077ca42b442e9913fc83e1cc73436',uuid=e1a3273f-42d2-4582-b539-3c7c6111cf3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f5678db-1255-42ae-84ca-4d1b3b5dac84", "address": "fa:16:3e:60:3d:03", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f5678db-12", "ovs_interfaceid": "4f5678db-1255-42ae-84ca-4d1b3b5dac84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converting VIF {"id": "4f5678db-1255-42ae-84ca-4d1b3b5dac84", "address": "fa:16:3e:60:3d:03", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f5678db-12", "ovs_interfaceid": "4f5678db-1255-42ae-84ca-4d1b3b5dac84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:3d:03,bridge_name='br-int',has_traffic_filtering=True,id=4f5678db-1255-42ae-84ca-4d1b3b5dac84,network=Network(6d4c82b5-fae6-47b6-a546-2146dc5391c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4f5678db-12') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_vif [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:3d:03,bridge_name='br-int',has_traffic_filtering=True,id=4f5678db-1255-42ae-84ca-4d1b3b5dac84,network=Network(6d4c82b5-fae6-47b6-a546-2146dc5391c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4f5678db-12') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f5678db-12, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3cb85a58-4f82-4fe9-8b1d-1591f0e17f59) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74805) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: INFO os_vif [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:3d:03,bridge_name='br-int',has_traffic_filtering=True,id=4f5678db-1255-42ae-84ca-4d1b3b5dac84,network=Network(6d4c82b5-fae6-47b6-a546-2146dc5391c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4f5678db-12')
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209991627',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209991627',id=11,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL2p+ejOi8AQ04hPhdzGD7OzJ/dixq8QFeSc5qrTwC3wpMDZ0/iY+E0x5r4vEKcyTBCdkRv6GOAto/wSL59XHp3RSRI0zh0xWba9e42A7dyuK3bVVrQh2BApcmYL2JgNQ==',key_name='tempest-keypair-902492598',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:15:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47b57aff3d714da1a9872ecec24524ae',ramdisk_id='',reservation_id='r-len0vorx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1105776980',owner_user_name='tempest-TaggedBootDevicesTest-1105776980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:15:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52d077ca42b442e9913fc83e1cc73436',uuid=e1a3273f-42d2-4582-b539-3c7c6111cf3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45598f97-ca9c-423f-bf8e-e7ce6aba0073", "address": "fa:16:3e:d0:dc:9e", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45598f97-ca", "ovs_interfaceid": "45598f97-ca9c-423f-bf8e-e7ce6aba0073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converting VIF {"id": "45598f97-ca9c-423f-bf8e-e7ce6aba0073", "address": "fa:16:3e:d0:dc:9e", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45598f97-ca", "ovs_interfaceid": "45598f97-ca9c-423f-bf8e-e7ce6aba0073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:dc:9e,bridge_name='br-int',has_traffic_filtering=True,id=45598f97-ca9c-423f-bf8e-e7ce6aba0073,network=Network(6d4c82b5-fae6-47b6-a546-2146dc5391c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45598f97-ca') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_vif [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:dc:9e,bridge_name='br-int',has_traffic_filtering=True,id=45598f97-ca9c-423f-bf8e-e7ce6aba0073,network=Network(6d4c82b5-fae6-47b6-a546-2146dc5391c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45598f97-ca') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45598f97-ca, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b57f12e-c8d8-4d7e-b4d0-d6422000f063) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: INFO os_vif [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:dc:9e,bridge_name='br-int',has_traffic_filtering=True,id=45598f97-ca9c-423f-bf8e-e7ce6aba0073,network=Network(6d4c82b5-fae6-47b6-a546-2146dc5391c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45598f97-ca')
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209991627',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209991627',id=11,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL2p+ejOi8AQ04hPhdzGD7OzJ/dixq8QFeSc5qrTwC3wpMDZ0/iY+E0x5r4vEKcyTBCdkRv6GOAto/wSL59XHp3RSRI0zh0xWba9e42A7dyuK3bVVrQh2BApcmYL2JgNQ==',key_name='tempest-keypair-902492598',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:15:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47b57aff3d714da1a9872ecec24524ae',ramdisk_id='',reservation_id='r-len0vorx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1105776980',owner_user_name='tempest-TaggedBootDevicesTest-1105776980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:15:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52d077ca42b442e9913fc83e1cc73436',uuid=e1a3273f-42d2-4582-b539-3c7c6111cf3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39f4ba29-3df3-4389-ae97-476675222a14", "address": "fa:16:3e:95:db:7d", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f4ba29-3d", "ovs_interfaceid": "39f4ba29-3df3-4389-ae97-476675222a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converting VIF {"id": "39f4ba29-3df3-4389-ae97-476675222a14", "address": "fa:16:3e:95:db:7d", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f4ba29-3d", "ovs_interfaceid": "39f4ba29-3df3-4389-ae97-476675222a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:db:7d,bridge_name='br-int',has_traffic_filtering=True,id=39f4ba29-3df3-4389-ae97-476675222a14,network=Network(6d4c82b5-fae6-47b6-a546-2146dc5391c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f4ba29-3d') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_vif [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:db:7d,bridge_name='br-int',has_traffic_filtering=True,id=39f4ba29-3df3-4389-ae97-476675222a14,network=Network(6d4c82b5-fae6-47b6-a546-2146dc5391c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f4ba29-3d') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39f4ba29-3d, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=259271ce-5179-4864-85c4-1a8355add4a2) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUnLfqKY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:16:45 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:45 user nova-compute[74805]: INFO os_vif [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:db:7d,bridge_name='br-int',has_traffic_filtering=True,id=39f4ba29-3df3-4389-ae97-476675222a14,network=Network(6d4c82b5-fae6-47b6-a546-2146dc5391c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f4ba29-3d')
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209991627',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209991627',id=11,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL2p+ejOi8AQ04hPhdzGD7OzJ/dixq8QFeSc5qrTwC3wpMDZ0/iY+E0x5r4vEKcyTBCdkRv6GOAto/wSL59XHp3RSRI0zh0xWba9e42A7dyuK3bVVrQh2BApcmYL2JgNQ==',key_name='tempest-keypair-902492598',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:15:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47b57aff3d714da1a9872ecec24524ae',ramdisk_id='',reservation_id='r-len0vorx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1105776980',owner_user_name='tempest-TaggedBootDevicesTest-1105776980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:15:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52d077ca42b442e9913fc83e1cc73436',uuid=e1a3273f-42d2-4582-b539-3c7c6111cf3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2cf28e2-46e0-450c-a153-23e6ef6da5f2", "address": "fa:16:3e:46:51:3c", "network": {"id": "da7f4cb9-5e5c-4598-a27b-94e6c59c582d", "bridge": "br-int", "label": "tempest-device-tagging-net2-610177095", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2cf28e2-46", "ovs_interfaceid": "c2cf28e2-46e0-450c-a153-23e6ef6da5f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converting VIF {"id": "c2cf28e2-46e0-450c-a153-23e6ef6da5f2", "address": "fa:16:3e:46:51:3c", "network": {"id": "da7f4cb9-5e5c-4598-a27b-94e6c59c582d", "bridge": "br-int", "label": "tempest-device-tagging-net2-610177095", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2cf28e2-46", "ovs_interfaceid": "c2cf28e2-46e0-450c-a153-23e6ef6da5f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:51:3c,bridge_name='br-int',has_traffic_filtering=True,id=c2cf28e2-46e0-450c-a153-23e6ef6da5f2,network=Network(da7f4cb9-5e5c-4598-a27b-94e6c59c582d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2cf28e2-46') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_vif [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:51:3c,bridge_name='br-int',has_traffic_filtering=True,id=c2cf28e2-46e0-450c-a153-23e6ef6da5f2,network=Network(da7f4cb9-5e5c-4598-a27b-94e6c59c582d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2cf28e2-46') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2cf28e2-46, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=caa38663-9ac1-41b3-9e63-06770a9a148e) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa0f358-39e1-4c28-939b-ca31c36767dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:16:45 user nova-compute[74805]: No targets found.
Nov 15 04:16:45 user nova-compute[74805]: iSNS:
Nov 15 04:16:45 user nova-compute[74805]: No targets found.
Nov 15 04:16:45 user nova-compute[74805]: STATIC:
Nov 15 04:16:45 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0
Nov 15 04:16:45 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:45 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:45 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730
Nov 15 04:16:45 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:45 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:45 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6
Nov 15 04:16:45 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:45 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:45 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287
Nov 15 04:16:45 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:45 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:45 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651
Nov 15 04:16:45 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:45 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:45 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114
Nov 15 04:16:45 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:45 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:45 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab
Nov 15 04:16:45 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:45 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:45 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa
Nov 15 04:16:45 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:45 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:45 user nova-compute[74805]: FIRMWARE:
Nov 15 04:16:45 user nova-compute[74805]: No targets found.
Nov 15 04:16:45 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:16:45 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:16:45 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: INFO os_vif [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:51:3c,bridge_name='br-int',has_traffic_filtering=True,id=c2cf28e2-46e0-450c-a153-23e6ef6da5f2,network=Network(da7f4cb9-5e5c-4598-a27b-94e6c59c582d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2cf28e2-46')
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209991627',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209991627',id=11,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL2p+ejOi8AQ04hPhdzGD7OzJ/dixq8QFeSc5qrTwC3wpMDZ0/iY+E0x5r4vEKcyTBCdkRv6GOAto/wSL59XHp3RSRI0zh0xWba9e42A7dyuK3bVVrQh2BApcmYL2JgNQ==',key_name='tempest-keypair-902492598',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:15:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47b57aff3d714da1a9872ecec24524ae',ramdisk_id='',reservation_id='r-len0vorx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1105776980',owner_user_name='tempest-TaggedBootDevicesTest-1105776980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:15:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52d077ca42b442e9913fc83e1cc73436',uuid=e1a3273f-42d2-4582-b539-3c7c6111cf3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "705a958d-3fb6-4fe9-ba7e-e69d242dde68", "address": "fa:16:3e:58:83:23", "network": {"id": "da7f4cb9-5e5c-4598-a27b-94e6c59c582d", "bridge": "br-int", "label": "tempest-device-tagging-net2-610177095", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705a958d-3f", "ovs_interfaceid": "705a958d-3fb6-4fe9-ba7e-e69d242dde68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converting VIF {"id": "705a958d-3fb6-4fe9-ba7e-e69d242dde68", "address": "fa:16:3e:58:83:23", "network": {"id": "da7f4cb9-5e5c-4598-a27b-94e6c59c582d", "bridge": "br-int", "label": "tempest-device-tagging-net2-610177095", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705a958d-3f", "ovs_interfaceid": "705a958d-3fb6-4fe9-ba7e-e69d242dde68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:83:23,bridge_name='br-int',has_traffic_filtering=True,id=705a958d-3fb6-4fe9-ba7e-e69d242dde68,network=Network(da7f4cb9-5e5c-4598-a27b-94e6c59c582d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap705a958d-3f') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_vif [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:83:23,bridge_name='br-int',has_traffic_filtering=True,id=705a958d-3fb6-4fe9-ba7e-e69d242dde68,network=Network(da7f4cb9-5e5c-4598-a27b-94e6c59c582d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap705a958d-3f') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap705a958d-3f, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbeea17d-7804-4735-aefa-cb2b74930ade]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=342cbc3e-7d46-428f-9804-4012e107c574) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:45 user nova-compute[74805]: INFO os_vif [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:83:23,bridge_name='br-int',has_traffic_filtering=True,id=705a958d-3fb6-4fe9-ba7e-e69d242dde68,network=Network(da7f4cb9-5e5c-4598-a27b-94e6c59c582d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap705a958d-3f')
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfiQBoCg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:16:45 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7ad2fa-44d4-41cb-9701-49f9ebf23332]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)
Nov 15 04:16:45 user nova-compute[74805]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)
Nov 15 04:16:45 user nova-compute[74805]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)
Nov 15 04:16:45 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:45 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:45 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:45 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:45 user nova-compute[74805]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)
Nov 15 04:16:45 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)
Nov 15 04:16:45 user nova-compute[74805]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)
Nov 15 04:16:45 user nova-compute[74805]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)
Nov 15 04:16:45 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:45 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:45 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:45 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:45 user nova-compute[74805]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)
Nov 15 04:16:45 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2fb4313e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0'): ({'sdb'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Removing single pathed devices sdb {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e9df72-5bf5-4878-8db7-6044606b63cc]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-a5f9b710-99b0-4698-ad63-c907a7849a93 req-bf24f6ce-ec0d-44a6-9a22-22db281f9e70 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-plugged-8fb4ff06-71a7-4fe2-81b0-e4d980e75a23 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-a5f9b710-99b0-4698-ad63-c907a7849a93 req-bf24f6ce-ec0d-44a6-9a22-22db281f9e70 service nova] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-a5f9b710-99b0-4698-ad63-c907a7849a93 req-bf24f6ce-ec0d-44a6-9a22-22db281f9e70 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-a5f9b710-99b0-4698-ad63-c907a7849a93 req-bf24f6ce-ec0d-44a6-9a22-22db281f9e70 service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-a5f9b710-99b0-4698-ad63-c907a7849a93 req-bf24f6ce-ec0d-44a6-9a22-22db281f9e70 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] No waiting events found dispatching network-vif-plugged-8fb4ff06-71a7-4fe2-81b0-e4d980e75a23 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:16:45 user nova-compute[74805]: WARNING nova.compute.manager [req-a5f9b710-99b0-4698-ad63-c907a7849a93 req-bf24f6ce-ec0d-44a6-9a22-22db281f9e70 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received unexpected event network-vif-plugged-8fb4ff06-71a7-4fe2-81b0-e4d980e75a23 for instance with vm_state active and task_state deleting.
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1e42ae-f699-483e-82c0-58f0a7db9f3c]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Flushing IO for device /dev/sdb {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaadf447-47b4-4919-a0d8-d4518258e587]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-plugged-2fd61de8-594b-4c85-957d-db3f622ffdc2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] No waiting events found dispatching network-vif-plugged-2fd61de8-594b-4c85-957d-db3f622ffdc2 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:16:45 user nova-compute[74805]: WARNING nova.compute.manager [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received unexpected event network-vif-plugged-2fd61de8-594b-4c85-957d-db3f622ffdc2 for instance with vm_state active and task_state deleting.
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-unplugged-45598f97-ca9c-423f-bf8e-e7ce6aba0073 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] No waiting events found dispatching network-vif-unplugged-45598f97-ca9c-423f-bf8e-e7ce6aba0073 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-unplugged-45598f97-ca9c-423f-bf8e-e7ce6aba0073 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-plugged-45598f97-ca9c-423f-bf8e-e7ce6aba0073 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] No waiting events found dispatching network-vif-plugged-45598f97-ca9c-423f-bf8e-e7ce6aba0073 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:16:45 user nova-compute[74805]: WARNING nova.compute.manager [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received unexpected event network-vif-plugged-45598f97-ca9c-423f-bf8e-e7ce6aba0073 for instance with vm_state active and task_state deleting.
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-unplugged-39f4ba29-3df3-4389-ae97-476675222a14 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] No waiting events found dispatching network-vif-unplugged-39f4ba29-3df3-4389-ae97-476675222a14 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-unplugged-39f4ba29-3df3-4389-ae97-476675222a14 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-plugged-39f4ba29-3df3-4389-ae97-476675222a14 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] No waiting events found dispatching network-vif-plugged-39f4ba29-3df3-4389-ae97-476675222a14 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:16:45 user nova-compute[74805]: WARNING nova.compute.manager [req-5301765b-e546-4e60-a5f7-8e92816cd8f2 req-13056181-1e22-43a7-bc34-1d41213df6ce service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received unexpected event network-vif-plugged-39f4ba29-3df3-4389-ae97-476675222a14 for instance with vm_state active and task_state deleting.
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[627f7836-e54b-4be4-b7f1-b37e7ef61f3e]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[560a0673-df4a-4de6-a241-1f0442c1d169]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-plugged-4f5678db-1255-42ae-84ca-4d1b3b5dac84 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] No waiting events found dispatching network-vif-plugged-4f5678db-1255-42ae-84ca-4d1b3b5dac84 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:16:45 user nova-compute[74805]: WARNING nova.compute.manager [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received unexpected event network-vif-plugged-4f5678db-1255-42ae-84ca-4d1b3b5dac84 for instance with vm_state active and task_state deleting.
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-unplugged-705a958d-3fb6-4fe9-ba7e-e69d242dde68 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] No waiting events found dispatching network-vif-unplugged-705a958d-3fb6-4fe9-ba7e-e69d242dde68 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-unplugged-705a958d-3fb6-4fe9-ba7e-e69d242dde68 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-plugged-705a958d-3fb6-4fe9-ba7e-e69d242dde68 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] No waiting events found dispatching network-vif-plugged-705a958d-3fb6-4fe9-ba7e-e69d242dde68 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:16:45 user nova-compute[74805]: WARNING nova.compute.manager [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received unexpected event network-vif-plugged-705a958d-3fb6-4fe9-ba7e-e69d242dde68 for instance with vm_state active and task_state deleting.
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-unplugged-c2cf28e2-46e0-450c-a153-23e6ef6da5f2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] No waiting events found dispatching network-vif-unplugged-c2cf28e2-46e0-450c-a153-23e6ef6da5f2 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-unplugged-c2cf28e2-46e0-450c-a153-23e6ef6da5f2 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-plugged-c2cf28e2-46e0-450c-a153-23e6ef6da5f2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] Acquiring lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] No waiting events found dispatching network-vif-plugged-c2cf28e2-46e0-450c-a153-23e6ef6da5f2 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:16:45 user nova-compute[74805]: WARNING nova.compute.manager [req-ec584461-8061-4f13-ab47-5bb3ab9564c6 req-e8a3a2ea-acb7-4b4d-b204-d6d777e67bfb service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received unexpected event network-vif-plugged-c2cf28e2-46e0-450c-a153-23e6ef6da5f2 for instance with vm_state active and task_state deleting.
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[42654d1e-91a4-4a93-9923-0af313420be6]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0, portal: 172.16.0.220,3260]
Nov 15 04:16:45 user nova-compute[74805]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0, portal: 172.16.0.220,3260] successful.
Nov 15 04:16:45 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd26478-747b-479a-b044-437b0f44b653]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] <== disconnect_volume: return (369ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.308s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d71142-1e47-45a6-9e11-79e49cfc9162]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:16:45 user nova-compute[74805]: No targets found.
Nov 15 04:16:45 user nova-compute[74805]: iSNS:
Nov 15 04:16:45 user nova-compute[74805]: No targets found.
Nov 15 04:16:45 user nova-compute[74805]: STATIC:
Nov 15 04:16:45 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730
Nov 15 04:16:45 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:45 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:45 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6
Nov 15 04:16:45 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:45 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:45 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287
Nov 15 04:16:45 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:45 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:45 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651
Nov 15 04:16:45 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:45 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:45 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114
Nov 15 04:16:45 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:45 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:45 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab
Nov 15 04:16:45 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:45 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:45 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa
Nov 15 04:16:45 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:45 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:45 user nova-compute[74805]: FIRMWARE:
Nov 15 04:16:45 user nova-compute[74805]: No targets found.
Nov 15 04:16:45 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:16:45 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:16:45 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FpCDKNtq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'fdf3e90f-4fd8-4da4-a888-48c7a80fb209', 'attached_at': '', 'detached_at': '', 'volume_id': '02d1edf9-9210-4f74-8216-f7e9350759aa', 'serial'} {{(pid=74805) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] swap_volume: removing Cinder connection for volume c27c663f-7b69-4434-9bc7-16a40032c7b0 {{(pid=74805) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de94a30-f6b1-44a3-9b80-678c595853e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdec17c-55eb-447d-874b-44f6e837f7ec]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)
Nov 15 04:16:45 user nova-compute[74805]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)
Nov 15 04:16:45 user nova-compute[74805]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)
Nov 15 04:16:45 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:45 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:45 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:45 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:45 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)
Nov 15 04:16:45 user nova-compute[74805]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)
Nov 15 04:16:45 user nova-compute[74805]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)
Nov 15 04:16:45 user nova-compute[74805]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 (non-flash)
Nov 15 04:16:45 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:45 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:45 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:45 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2fac21ecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651'): ({'sdc'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Removing single pathed devices sdc {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e523b6-ce5e-48ee-8897-1329413af2ec]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8bbb16-00de-483f-beab-98a7690a00a6]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Flushing IO for device /dev/sdc {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[71386a52-a624-4f59-9025-318b46725ecc]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e371b9e-672b-478e-ae7e-1aa766eac8c3]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:16:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[786d43da-da66-4b72-9597-d047a293397d]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c131e8-b34d-4862-a121-764eb0bb80fa]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651, portal: 172.16.0.220,3260]
Nov 15 04:16:46 user nova-compute[74805]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651, portal: 172.16.0.220,3260] successful.
Nov 15 04:16:46 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c533429-7f55-4f56-a45f-e02c2f0dd651 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a5089e-cdc4-4e3f-940f-7480426ca0c5]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] <== disconnect_volume: return (643ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'REamgAJt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:16:46 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[50159229-8eee-43fe-bcbe-a10db056c438]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:16:46 user nova-compute[74805]: No targets found.
Nov 15 04:16:46 user nova-compute[74805]: iSNS:
Nov 15 04:16:46 user nova-compute[74805]: No targets found.
Nov 15 04:16:46 user nova-compute[74805]: STATIC:
Nov 15 04:16:46 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730
Nov 15 04:16:46 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:46 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:46 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6
Nov 15 04:16:46 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:46 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:46 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287
Nov 15 04:16:46 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:46 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:46 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114
Nov 15 04:16:46 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:46 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:46 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab
Nov 15 04:16:46 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:46 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:46 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa
Nov 15 04:16:46 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:46 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:46 user nova-compute[74805]: FIRMWARE:
Nov 15 04:16:46 user nova-compute[74805]: No targets found.
Nov 15 04:16:46 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:16:46 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:16:46 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a42eec-a09e-4bbf-93b8-5d5fcf50b516]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd57c4b-d762-4137-8070-5d81d2be75eb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)
Nov 15 04:16:46 user nova-compute[74805]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)
Nov 15 04:16:46 user nova-compute[74805]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)
Nov 15 04:16:46 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:46 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:46 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:46 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)
Nov 15 04:16:46 user nova-compute[74805]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)
Nov 15 04:16:46 user nova-compute[74805]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)
Nov 15 04:16:46 user nova-compute[74805]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 (non-flash)
Nov 15 04:16:46 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:46 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:46 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2fac21ecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730'): ({'sdd'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Removing single pathed devices sdd {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a3843b-db9c-4191-9fc6-a3c1a7ae16e9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fe3f66-eb21-4732-b89e-0ad354d2d232]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Flushing IO for device /dev/sdd {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa09ff9-c60d-4223-af21-bff1094ea3bc]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ecb03d-a201-460d-838a-3895e5fbbf82]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] SCSI volumes sdd have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd281529-8bdb-4ee6-be5c-3f133cefb777]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1e925a-83e7-4988-bc04-b8b128c40e9d]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730, portal: 172.16.0.220,3260]
Nov 15 04:16:46 user nova-compute[74805]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730, portal: 172.16.0.220,3260] successful.
Nov 15 04:16:46 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38401583-d453-48d5-b5c6-9b7bddfc9730 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5024404-3df6-4fb3-a6b2-d65d14291fb5]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] <== disconnect_volume: return (343ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cMIbZFjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:16:46 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1eff770-4843-48cc-985d-088565814aad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:16:46 user nova-compute[74805]: No targets found.
Nov 15 04:16:46 user nova-compute[74805]: iSNS:
Nov 15 04:16:46 user nova-compute[74805]: No targets found.
Nov 15 04:16:46 user nova-compute[74805]: STATIC:
Nov 15 04:16:46 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6
Nov 15 04:16:46 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:46 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:46 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287
Nov 15 04:16:46 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:46 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:46 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114
Nov 15 04:16:46 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:46 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:46 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab
Nov 15 04:16:46 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:46 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:46 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa
Nov 15 04:16:46 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:46 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:46 user nova-compute[74805]: FIRMWARE:
Nov 15 04:16:46 user nova-compute[74805]: No targets found.
Nov 15 04:16:46 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:16:46 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:16:46 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c4977f-6ccb-443f-b886-9b646402dc74]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee347923-f2d7-4675-af63-c6fd1bb02da9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)
Nov 15 04:16:46 user nova-compute[74805]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)
Nov 15 04:16:46 user nova-compute[74805]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)
Nov 15 04:16:46 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:46 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:46 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)
Nov 15 04:16:46 user nova-compute[74805]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)
Nov 15 04:16:46 user nova-compute[74805]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)
Nov 15 04:16:46 user nova-compute[74805]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 (non-flash)
Nov 15 04:16:46 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:46 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2fac21ecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114'): ({'sde'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Removing single pathed devices sde {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] swap_volume: Updating volume c27c663f-7b69-4434-9bc7-16a40032c7b0 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "FpCDKNtq", "auth_password": "ke3npBr1uyM2jm", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "02d1edf9-9210-4f74-8216-f7e9350759aa"}, "status": "reserved", "instance": "fdf3e90f-4fd8-4da4-a888-48c7a80fb209", "attached_at": "", "detached_at": "", "volume_id": "02d1edf9-9210-4f74-8216-f7e9350759aa", "serial": "02d1edf9-9210-4f74-8216-f7e9350759aa"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '02d1edf9-9210-4f74-8216-f7e9350759aa', 'no_device': None, 'attachment_id': '59c3718e-9e19-48d0-aad8-c512c60017c5'} {{(pid=74805) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[304c1d41-0ee6-483a-a6b3-d3f2ec220199]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0907b164-48aa-4513-bbb4-ccc2ed3c0508 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.867s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9196b5-1091-49c4-bb6d-ce46ef3eb348]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Flushing IO for device /dev/sde {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[db219c3d-1855-448f-9dab-6f0cb9e458e0]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b52b60-8327-4f0f-a55a-5892f2962cae]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] SCSI volumes sde have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[33558d4c-4d22-44c1-9392-0eede6f95219]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d72f4f3-61af-48b2-8613-ff427c5698f3]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114, portal: 172.16.0.220,3260]
Nov 15 04:16:46 user nova-compute[74805]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114, portal: 172.16.0.220,3260] successful.
Nov 15 04:16:46 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd5bfde-5430-4032-b783-a72254443114 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2425f1-c70b-4ff8-b22b-887d6973ec3a]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] <== disconnect_volume: return (312ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:16:46 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Deleting instance files /opt/stack/data/nova/instances/e1a3273f-42d2-4582-b539-3c7c6111cf3c_del
Nov 15 04:16:46 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Deletion of /opt/stack/data/nova/instances/e1a3273f-42d2-4582-b539-3c7c6111cf3c_del complete
Nov 15 04:16:46 user nova-compute[74805]: INFO nova.compute.manager [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Took 4.00 seconds to destroy the instance on the hypervisor.
Nov 15 04:16:46 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:16:46 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:16:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Acquiring lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:47 user nova-compute[74805]: DEBUG os_brick.utils [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:16:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[195dffbc-b79e-451e-9244-ed4c1c350c95]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[190a2dc0-e5ae-4493-8824-07adb67e31c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fa954d-748d-4013-a1d7-e36fa83d5f2e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e34787-bd56-443e-8da5-a449f6dccd72]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:16:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:16:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:16:47 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:16:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff4bbed-e5bf-4f05-af70-bcad9650ea59]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:16:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:16:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:16:47 user nova-compute[74805]: DEBUG os_brick.utils [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:16:47 user nova-compute[74805]: INFO nova.compute.manager [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Swapping volume 02d1edf9-9210-4f74-8216-f7e9350759aa for c27c663f-7b69-4434-9bc7-16a40032c7b0
Nov 15 04:16:48 user nova-compute[74805]: DEBUG nova.compute.manager [req-72058f99-cc8e-4622-82ef-33056897d014 req-483ef922-0301-4dd6-a0f6-6995377f755a service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-deleted-705a958d-3fb6-4fe9-ba7e-e69d242dde68 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:48 user nova-compute[74805]: INFO nova.compute.manager [req-72058f99-cc8e-4622-82ef-33056897d014 req-483ef922-0301-4dd6-a0f6-6995377f755a service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Neutron deleted interface 705a958d-3fb6-4fe9-ba7e-e69d242dde68; detaching it from the instance and deleting it from the info cache
Nov 15 04:16:48 user nova-compute[74805]: DEBUG nova.network.neutron [req-72058f99-cc8e-4622-82ef-33056897d014 req-483ef922-0301-4dd6-a0f6-6995377f755a service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Updating instance_info_cache with network_info: [{"id": "8fb4ff06-71a7-4fe2-81b0-e4d980e75a23", "address": "fa:16:3e:4f:d9:b6", "network": {"id": "c9df097d-17ec-4bdd-aa5b-531b2f59c8e1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1457673667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb4ff06-71", "ovs_interfaceid": "8fb4ff06-71a7-4fe2-81b0-e4d980e75a23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2fd61de8-594b-4c85-957d-db3f622ffdc2", "address": "fa:16:3e:b6:83:57", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fd61de8-59", "ovs_interfaceid": "2fd61de8-594b-4c85-957d-db3f622ffdc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f5678db-1255-42ae-84ca-4d1b3b5dac84", "address": "fa:16:3e:60:3d:03", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f5678db-12", "ovs_interfaceid": "4f5678db-1255-42ae-84ca-4d1b3b5dac84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45598f97-ca9c-423f-bf8e-e7ce6aba0073", "address": "fa:16:3e:d0:dc:9e", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45598f97-ca", "ovs_interfaceid": "45598f97-ca9c-423f-bf8e-e7ce6aba0073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39f4ba29-3df3-4389-ae97-476675222a14", "address": "fa:16:3e:95:db:7d", "network": {"id": "6d4c82b5-fae6-47b6-a546-2146dc5391c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-110784744", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f4ba29-3d", "ovs_interfaceid": "39f4ba29-3df3-4389-ae97-476675222a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2cf28e2-46e0-450c-a153-23e6ef6da5f2", "address": "fa:16:3e:46:51:3c", "network": {"id": "da7f4cb9-5e5c-4598-a27b-94e6c59c582d", "bridge": "br-int", "label": "tempest-device-tagging-net2-610177095", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47b57aff3d714da1a9872ecec24524ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2cf28e2-46", "ovs_interfaceid": "c2cf28e2-46e0-450c-a153-23e6ef6da5f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG nova.compute.manager [req-72058f99-cc8e-4622-82ef-33056897d014 req-483ef922-0301-4dd6-a0f6-6995377f755a service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Detach interface failed, port_id=705a958d-3fb6-4fe9-ba7e-e69d242dde68, reason: Instance e1a3273f-42d2-4582-b539-3c7c6111cf3c could not be found. {{(pid=74805) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:16:48 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Creating image(s)
Nov 15 04:16:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Did not create local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Ensure instance console log exists: /opt/stack/data/nova/instances/e91a656c-66d6-4a70-a115-8c03ed964f94/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Start _get_guest_xml network_info=[{"id": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "address": "fa:16:3e:d0:6e:1b", "network": {"id": "b3051571-47ed-471a-9d88-051306ee18e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-707580808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b22eb863a050454fb1998acbaae47f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ef9969-b6", "ovs_interfaceid": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQvEqwlU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e91a656c-66d6-4a70-a115-8c03ed964f94', 'attached_at': '', 'detached_at': '', 'volume_id': 'b384dac9-f81c-4c7a-bfc7-93966c62f43d', 'serial': 'b384dac9-f81c-4c7a-bfc7-93966c62f43d'}, 'delete_on_termination': True, 'attachment_id': '606f7b1d-4976-4ee6-b72f-bfd2f35e601d', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:16:48 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 04:16:48 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 04:16:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG nova.objects.instance [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lazy-loading 'vcpu_model' on Instance uuid e91a656c-66d6-4a70-a115-8c03ed964f94 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQvEqwlU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:16:48 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 04:16:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:16:48 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 04:16:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:16:48 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:16:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[351d61f0-0daa-4214-a627-cc4f03dd9aa5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:16:48 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9f6125-fbed-485b-8359-b0fe99fb3143]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d] added
Nov 15 04:16:48 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9fbeb9-8507-47ca-907f-b3649da5ea5e]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00c3d81-dd2e-40bd-86c8-8b3685fc5b22]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xQvEqwlU {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xQvEqwlU" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bead67-bdd5-4d37-a205-52a959c816ac]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xQvEqwlU'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e1b6d3-0e38-4135-8e24-c8655205b1e1]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd46f53-7bd5-4488-af4c-b83355a69446]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)
Nov 15 04:16:49 user nova-compute[74805]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)
Nov 15 04:16:49 user nova-compute[74805]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)
Nov 15 04:16:49 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:49 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)
Nov 15 04:16:49 user nova-compute[74805]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)
Nov 15 04:16:49 user nova-compute[74805]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)
Nov 15 04:16:49 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:49 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6729ee4c-5ea5-4e3d-8624-3b37f22549a2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d, portal: 172.16.0.220,3260]
Nov 15 04:16:49 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d, portal: 172.16.0.220,3260] successful.
Nov 15 04:16:49 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db25112-c866-4ff7-ae35-a046ec464989]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e97f2fb-011f-4b1e-8954-69eb2368a84c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)
Nov 15 04:16:49 user nova-compute[74805]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)
Nov 15 04:16:49 user nova-compute[74805]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)
Nov 15 04:16:49 user nova-compute[74805]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:49 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:49 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)
Nov 15 04:16:49 user nova-compute[74805]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)
Nov 15 04:16:49 user nova-compute[74805]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)
Nov 15 04:16:49 user nova-compute[74805]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:49 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:49 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e89dae9-a453-4695-97fc-b2e863b98f06]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: None {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:16:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQvEqwlU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23232393664333833', 'path': '/dev/sdb'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232393664333833', 'path': '/dev/sdb'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T04:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-641306839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1742924084',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlMPSTIiQVE0Cg8/bE0RixmymMVDkL6CLvmQNksg244N0w4rCZu1JDjdz8UBU0xRiR4zxHQg+y5pVbvwhdP+A3FI8Akdh2Dzal25VcHo1J+LBfq6srezgKC8edvUX0D8Q==',key_name='tempest-keypair-430392767',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:14:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b22eb863a050454fb1998acbaae47f23',ramdisk_id='',reservation_id='r-uvt06p7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1378822471',owner_user_name='tempest-ServerActionsV293TestJSON-1378822471-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:16:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7ec9f2afcee4c23883d572235bfa437',uuid=e91a656c-66d6-4a70-a115-8c03ed964f94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "address": "fa:16:3e:d0:6e:1b", "network": {"id": "b3051571-47ed-471a-9d88-051306ee18e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-707580808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b22eb863a050454fb1998acbaae47f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ef9969-b6", "ovs_interfaceid": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Converting VIF {"id": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "address": "fa:16:3e:d0:6e:1b", "network": {"id": "b3051571-47ed-471a-9d88-051306ee18e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-707580808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b22eb863a050454fb1998acbaae47f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ef9969-b6", "ovs_interfaceid": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:6e:1b,bridge_name='br-int',has_traffic_filtering=True,id=78ef9969-b62c-4730-8bbf-e5a8d2c75010,network=Network(b3051571-47ed-471a-9d88-051306ee18e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ef9969-b6') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:16:50 user nova-compute[74805]:   <uuid>e91a656c-66d6-4a70-a115-8c03ed964f94</uuid>
Nov 15 04:16:50 user nova-compute[74805]:   <name>instance-00000007</name>
Nov 15 04:16:50 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:16:50 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:16:50 user nova-compute[74805]:   <metadata>
Nov 15 04:16:50 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:16:50 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:16:50 user nova-compute[74805]:       <nova:name>tempest-ServerActionsV293TestJSON-server-641306839</nova:name>
Nov 15 04:16:50 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:16:48</nova:creationTime>
Nov 15 04:16:50 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:16:50 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:16:50 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:16:50 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:16:50 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:16:50 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:16:50 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:16:50 user nova-compute[74805]:       <nova:owner>
Nov 15 04:16:50 user nova-compute[74805]:         <nova:user uuid="d7ec9f2afcee4c23883d572235bfa437">tempest-ServerActionsV293TestJSON-1378822471-project-member</nova:user>
Nov 15 04:16:50 user nova-compute[74805]:         <nova:project uuid="b22eb863a050454fb1998acbaae47f23">tempest-ServerActionsV293TestJSON-1378822471</nova:project>
Nov 15 04:16:50 user nova-compute[74805]:       </nova:owner>
Nov 15 04:16:50 user nova-compute[74805]:       <nova:ports>
Nov 15 04:16:50 user nova-compute[74805]:         <nova:port uuid="78ef9969-b62c-4730-8bbf-e5a8d2c75010">
Nov 15 04:16:50 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 04:16:50 user nova-compute[74805]:         </nova:port>
Nov 15 04:16:50 user nova-compute[74805]:       </nova:ports>
Nov 15 04:16:50 user nova-compute[74805]:     </nova:instance>
Nov 15 04:16:50 user nova-compute[74805]:   </metadata>
Nov 15 04:16:50 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:16:50 user nova-compute[74805]:     <system>
Nov 15 04:16:50 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:16:50 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:16:50 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:16:50 user nova-compute[74805]:       <entry name="serial">e91a656c-66d6-4a70-a115-8c03ed964f94</entry>
Nov 15 04:16:50 user nova-compute[74805]:       <entry name="uuid">e91a656c-66d6-4a70-a115-8c03ed964f94</entry>
Nov 15 04:16:50 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:16:50 user nova-compute[74805]:     </system>
Nov 15 04:16:50 user nova-compute[74805]:   </sysinfo>
Nov 15 04:16:50 user nova-compute[74805]:   <os>
Nov 15 04:16:50 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:16:50 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:16:50 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:16:50 user nova-compute[74805]:   </os>
Nov 15 04:16:50 user nova-compute[74805]:   <features>
Nov 15 04:16:50 user nova-compute[74805]:     <acpi/>
Nov 15 04:16:50 user nova-compute[74805]:     <apic/>
Nov 15 04:16:50 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:16:50 user nova-compute[74805]:   </features>
Nov 15 04:16:50 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:16:50 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:16:50 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:16:50 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:16:50 user nova-compute[74805]:   </clock>
Nov 15 04:16:50 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:16:50 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:16:50 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:16:50 user nova-compute[74805]:   </cpu>
Nov 15 04:16:50 user nova-compute[74805]:   <devices>
Nov 15 04:16:50 user nova-compute[74805]:     <disk type="block" device="disk">
Nov 15 04:16:50 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:16:50 user nova-compute[74805]:       <source dev="/dev/sdb"/>
Nov 15 04:16:50 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:16:50 user nova-compute[74805]:       <serial>b384dac9-f81c-4c7a-bfc7-93966c62f43d</serial>
Nov 15 04:16:50 user nova-compute[74805]:     </disk>
Nov 15 04:16:50 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:16:50 user nova-compute[74805]:       <mac address="fa:16:3e:d0:6e:1b"/>
Nov 15 04:16:50 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:16:50 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:16:50 user nova-compute[74805]:       <target dev="tap78ef9969-b6"/>
Nov 15 04:16:50 user nova-compute[74805]:     </interface>
Nov 15 04:16:50 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:16:50 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/e91a656c-66d6-4a70-a115-8c03ed964f94/console.log" append="off"/>
Nov 15 04:16:50 user nova-compute[74805]:     </serial>
Nov 15 04:16:50 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:16:50 user nova-compute[74805]:     <video>
Nov 15 04:16:50 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:16:50 user nova-compute[74805]:     </video>
Nov 15 04:16:50 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:16:50 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:16:50 user nova-compute[74805]:     </rng>
Nov 15 04:16:50 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:16:50 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:16:50 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:16:50 user nova-compute[74805]:     </memballoon>
Nov 15 04:16:50 user nova-compute[74805]:   </devices>
Nov 15 04:16:50 user nova-compute[74805]: </domain>
Nov 15 04:16:50 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T04:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-641306839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1742924084',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlMPSTIiQVE0Cg8/bE0RixmymMVDkL6CLvmQNksg244N0w4rCZu1JDjdz8UBU0xRiR4zxHQg+y5pVbvwhdP+A3FI8Akdh2Dzal25VcHo1J+LBfq6srezgKC8edvUX0D8Q==',key_name='tempest-keypair-430392767',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:14:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b22eb863a050454fb1998acbaae47f23',ramdisk_id='',reservation_id='r-uvt06p7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1378822471',owner_user_name='tempest-ServerActionsV293TestJSON-1378822471-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:16:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7ec9f2afcee4c23883d572235bfa437',uuid=e91a656c-66d6-4a70-a115-8c03ed964f94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "address": "fa:16:3e:d0:6e:1b", "network": {"id": "b3051571-47ed-471a-9d88-051306ee18e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-707580808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b22eb863a050454fb1998acbaae47f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ef9969-b6", "ovs_interfaceid": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Converting VIF {"id": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "address": "fa:16:3e:d0:6e:1b", "network": {"id": "b3051571-47ed-471a-9d88-051306ee18e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-707580808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b22eb863a050454fb1998acbaae47f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ef9969-b6", "ovs_interfaceid": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:6e:1b,bridge_name='br-int',has_traffic_filtering=True,id=78ef9969-b62c-4730-8bbf-e5a8d2c75010,network=Network(b3051571-47ed-471a-9d88-051306ee18e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ef9969-b6') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG os_vif [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:6e:1b,bridge_name='br-int',has_traffic_filtering=True,id=78ef9969-b62c-4730-8bbf-e5a8d2c75010,network=Network(b3051571-47ed-471a-9d88-051306ee18e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ef9969-b6') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ad6daee-3535-5aa0-958c-d6e8859f88c9', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78ef9969-b6, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78ef9969-b6, col_values=(('qos', UUID('e781c81e-285d-4ff5-98ec-f100623f8358')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78ef9969-b6, col_values=(('external_ids', {'iface-id': '78ef9969-b62c-4730-8bbf-e5a8d2c75010', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:6e:1b', 'vm-uuid': 'e91a656c-66d6-4a70-a115-8c03ed964f94'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:50 user nova-compute[74805]: INFO os_vif [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:6e:1b,bridge_name='br-int',has_traffic_filtering=True,id=78ef9969-b62c-4730-8bbf-e5a8d2c75010,network=Network(b3051571-47ed-471a-9d88-051306ee18e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ef9969-b6')
Nov 15 04:16:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] No VIF found with MAC fa:16:3e:d0:6e:1b, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:16:50 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Took 3.48 seconds to deallocate network for instance.
Nov 15 04:16:50 user nova-compute[74805]: DEBUG nova.compute.manager [req-b8748cc0-bfec-4596-b919-ebb636659344 req-51e9b33c-6427-4af8-8d2a-608bd23cb176 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-deleted-8fb4ff06-71a7-4fe2-81b0-e4d980e75a23 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG nova.compute.manager [req-b8748cc0-bfec-4596-b919-ebb636659344 req-51e9b33c-6427-4af8-8d2a-608bd23cb176 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-deleted-39f4ba29-3df3-4389-ae97-476675222a14 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG nova.compute.manager [req-b8748cc0-bfec-4596-b919-ebb636659344 req-51e9b33c-6427-4af8-8d2a-608bd23cb176 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-deleted-c2cf28e2-46e0-450c-a153-23e6ef6da5f2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:50 user nova-compute[74805]: DEBUG nova.compute.manager [req-b8748cc0-bfec-4596-b919-ebb636659344 req-51e9b33c-6427-4af8-8d2a-608bd23cb176 service nova] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Received event network-vif-deleted-45598f97-ca9c-423f-bf8e-e7ce6aba0073 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:51 user nova-compute[74805]: DEBUG nova.compute.manager [req-e3248677-cc92-4e44-a157-cd9dfe1bd5a1 req-895b9b1b-0098-4c6d-8ce4-14542ebd8e7c service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Received event network-vif-plugged-78ef9969-b62c-4730-8bbf-e5a8d2c75010 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e3248677-cc92-4e44-a157-cd9dfe1bd5a1 req-895b9b1b-0098-4c6d-8ce4-14542ebd8e7c service nova] Acquiring lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e3248677-cc92-4e44-a157-cd9dfe1bd5a1 req-895b9b1b-0098-4c6d-8ce4-14542ebd8e7c service nova] Lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e3248677-cc92-4e44-a157-cd9dfe1bd5a1 req-895b9b1b-0098-4c6d-8ce4-14542ebd8e7c service nova] Lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:51 user nova-compute[74805]: DEBUG nova.compute.manager [req-e3248677-cc92-4e44-a157-cd9dfe1bd5a1 req-895b9b1b-0098-4c6d-8ce4-14542ebd8e7c service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] No waiting events found dispatching network-vif-plugged-78ef9969-b62c-4730-8bbf-e5a8d2c75010 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:16:51 user nova-compute[74805]: WARNING nova.compute.manager [req-e3248677-cc92-4e44-a157-cd9dfe1bd5a1 req-895b9b1b-0098-4c6d-8ce4-14542ebd8e7c service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Received unexpected event network-vif-plugged-78ef9969-b62c-4730-8bbf-e5a8d2c75010 for instance with vm_state active and task_state rebuild_spawning.
Nov 15 04:16:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG nova.compute.manager [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUnLfqKY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fdf3e90f-4fd8-4da4-a888-48c7a80fb209', 'attached_at': '', 'detached_at': '', 'volume_id': 'c27c663f-7b69-4434-9bc7-16a40032c7b0', 'serial': 'c27c663f-7b69-4434-9bc7-16a40032c7b0'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FpCDKNtq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '02d1edf9-9210-4f74-8216-f7e9350759aa'}, 'status': 'reserved', 'instance': 'fdf3e90f-4fd8-4da4-a888-48c7a80fb209', 'attached_at': '', 'detached_at': '', 'volume_id': '02d1edf9-9210-4f74-8216-f7e9350759aa', 'serial'} {{(pid=74805) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUnLfqKY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:16:52 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:16:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:16:52 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:16:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:16:52 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[312b4002-f423-4ba6-9abb-66f12cbc1bf7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:16:52 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d53fa1-c968-4730-80a1-1a36cdb81cba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0] added
Nov 15 04:16:52 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5d47a2-47aa-4342-96e6-5155f0a3dacb]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dfdeaa-f74a-4bec-ac9f-207549a30166]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BUnLfqKY {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BUnLfqKY" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f0f7ca-79e9-4ef2-b81c-852afd5f8a1e]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BUnLfqKY'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:52 user nova-compute[74805]: INFO nova.compute.manager [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] [instance: e1a3273f-42d2-4582-b539-3c7c6111cf3c] Took 2.21 seconds to detach 3 volumes for instance.
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc796227-3777-4be8-92ce-67e2da9944a0]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bf8e82-d2af-4f28-8e62-bcd307a2a33a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)
Nov 15 04:16:52 user nova-compute[74805]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)
Nov 15 04:16:52 user nova-compute[74805]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)
Nov 15 04:16:52 user nova-compute[74805]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:52 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:52 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)
Nov 15 04:16:52 user nova-compute[74805]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)
Nov 15 04:16:52 user nova-compute[74805]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)
Nov 15 04:16:52 user nova-compute[74805]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:52 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:52 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f3faa1-a109-4e4e-860c-a72d6e5b3052]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0, portal: 172.16.0.220,3260]
Nov 15 04:16:52 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0, portal: 172.16.0.220,3260] successful.
Nov 15 04:16:52 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f608bf7d-edea-4317-b70b-473e95df8663]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3498560f-7455-4dd5-afbc-88e3e88fbc1f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)
Nov 15 04:16:52 user nova-compute[74805]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)
Nov 15 04:16:52 user nova-compute[74805]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)
Nov 15 04:16:52 user nova-compute[74805]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:52 user nova-compute[74805]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)
Nov 15 04:16:52 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:52 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)
Nov 15 04:16:52 user nova-compute[74805]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)
Nov 15 04:16:52 user nova-compute[74805]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)
Nov 15 04:16:52 user nova-compute[74805]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:52 user nova-compute[74805]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)
Nov 15 04:16:52 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:52 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab61b54-bee5-4614-806b-e2b253741bd1]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:16:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUnLfqKY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:16:53 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:16:53 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:16:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:53 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Deleted allocations for instance e1a3273f-42d2-4582-b539-3c7c6111cf3c
Nov 15 04:16:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7814ade0-e638-42e6-88da-0f6b1c3b92d2 tempest-TaggedBootDevicesTest-1105776980 tempest-TaggedBootDevicesTest-1105776980-project-member] Lock "e1a3273f-42d2-4582-b539-3c7c6111cf3c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.334s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:53 user nova-compute[74805]: DEBUG nova.compute.manager [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:16:53 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:16:53 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Instance spawned successfully.
Nov 15 04:16:53 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:16:53 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:16:53 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:16:53 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:16:53 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:16:53 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:16:53 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:16:53 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:16:53 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23164336463633563', 'path': '/dev/sdc'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:16:53 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164336463633563', 'path': '/dev/sdc'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:16:53 user nova-compute[74805]: DEBUG nova.objects.instance [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Lazy-loading 'flavor' on Instance uuid fdf3e90f-4fd8-4da4-a888-48c7a80fb209 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:16:53 user nova-compute[74805]: DEBUG nova.compute.manager [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:16:53 user nova-compute[74805]: DEBUG nova.compute.manager [req-bf772e6f-62f5-4c8d-ad4e-d97f09a2bcb2 req-9f7c1871-efc1-49e5-a579-081a3ed31bb4 service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Received event network-vif-plugged-78ef9969-b62c-4730-8bbf-e5a8d2c75010 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:16:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bf772e6f-62f5-4c8d-ad4e-d97f09a2bcb2 req-9f7c1871-efc1-49e5-a579-081a3ed31bb4 service nova] Acquiring lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bf772e6f-62f5-4c8d-ad4e-d97f09a2bcb2 req-9f7c1871-efc1-49e5-a579-081a3ed31bb4 service nova] Lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bf772e6f-62f5-4c8d-ad4e-d97f09a2bcb2 req-9f7c1871-efc1-49e5-a579-081a3ed31bb4 service nova] Lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:53 user nova-compute[74805]: DEBUG nova.compute.manager [req-bf772e6f-62f5-4c8d-ad4e-d97f09a2bcb2 req-9f7c1871-efc1-49e5-a579-081a3ed31bb4 service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] No waiting events found dispatching network-vif-plugged-78ef9969-b62c-4730-8bbf-e5a8d2c75010 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:16:53 user nova-compute[74805]: WARNING nova.compute.manager [req-bf772e6f-62f5-4c8d-ad4e-d97f09a2bcb2 req-9f7c1871-efc1-49e5-a579-081a3ed31bb4 service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Received unexpected event network-vif-plugged-78ef9969-b62c-4730-8bbf-e5a8d2c75010 for instance with vm_state active and task_state rebuild_spawning.
Nov 15 04:16:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:16:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:16:53 user nova-compute[74805]: DEBUG nova.objects.instance [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74805) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 15 04:16:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-26e7b8b4-8c1e-40b5-9584-737fc37c7874 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.067s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74805) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 04:16:54 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] COPY block job progress, current cursor: 146800640 final cursor: 1073741824 {{(pid=74805) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 04:16:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] COPY block job progress, current cursor: 314572800 final cursor: 1073741824 {{(pid=74805) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 04:16:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] COPY block job progress, current cursor: 498073600 final cursor: 1073741824 {{(pid=74805) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 04:16:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] COPY block job progress, current cursor: 638582784 final cursor: 1073741824 {{(pid=74805) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 04:16:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] COPY block job progress, current cursor: 818937856 final cursor: 1073741824 {{(pid=74805) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 04:16:57 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] COPY block job progress, current cursor: 976224256 final cursor: 1073741824 {{(pid=74805) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 04:16:57 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] COPY block job progress, current cursor: 1063256064 final cursor: 1073741824 {{(pid=74805) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 04:16:57 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 05f49324-4b7a-4cd4-ada5-9450b9bf1d70 is timed out.
Nov 15 04:16:57 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Successfully detached device vdb from instance 05f49324-4b7a-4cd4-ada5-9450b9bf1d70 from the live domain config.
Nov 15 04:16:57 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:16:57 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QEPMJSkN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:16:57 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:16:57 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:16:57 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:16:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:57 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0610fcc-073f-4239-84ed-8af3c8d9ca08]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:57 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:16:57 user nova-compute[74805]: No targets found.
Nov 15 04:16:57 user nova-compute[74805]: iSNS:
Nov 15 04:16:57 user nova-compute[74805]: No targets found.
Nov 15 04:16:57 user nova-compute[74805]: STATIC:
Nov 15 04:16:57 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0
Nov 15 04:16:57 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:57 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:57 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6
Nov 15 04:16:57 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:57 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:57 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287
Nov 15 04:16:57 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:57 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:57 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d
Nov 15 04:16:57 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:57 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:57 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab
Nov 15 04:16:57 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:57 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:57 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa
Nov 15 04:16:57 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:57 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:57 user nova-compute[74805]: FIRMWARE:
Nov 15 04:16:57 user nova-compute[74805]: No targets found.
Nov 15 04:16:57 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:57 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:16:57 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:16:57 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:16:57 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:16:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[36122ba0-5b42-44e7-90fb-ad4c3ab35995]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d423f9-4b88-48e8-b985-c4b4905a9c3e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)
Nov 15 04:16:58 user nova-compute[74805]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)
Nov 15 04:16:58 user nova-compute[74805]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)
Nov 15 04:16:58 user nova-compute[74805]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:58 user nova-compute[74805]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)
Nov 15 04:16:58 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:58 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab (non-flash)
Nov 15 04:16:58 user nova-compute[74805]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)
Nov 15 04:16:58 user nova-compute[74805]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)
Nov 15 04:16:58 user nova-compute[74805]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:58 user nova-compute[74805]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)
Nov 15 04:16:58 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:58 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2fac2f0820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab'): ({'sdh'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Removing single pathed devices sdh {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bd056d-2e21-42ce-b7eb-f1c746074364]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b35ddc-803f-43a5-a8c8-d3e04245a916]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Flushing IO for device /dev/sdh {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3ac385-96f7-4118-b27a-e9e3a30f225e]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.032s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0afafb6-55e7-457f-a9b4-2069c4a40141]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] SCSI volumes sdh have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fff6ee-ad32-4874-a006-775cecf9df26]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a6400b-8692-4a67-aab4-b5400f4c3a1a]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab, portal: 172.16.0.220,3260]
Nov 15 04:16:58 user nova-compute[74805]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab, portal: 172.16.0.220,3260] successful.
Nov 15 04:16:58 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74805) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:448652d9-1141-4d9d-8f13-dc491f1d50ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e1eb38-99b6-4fb8-9ebe-2599e6c7a6e3]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] <== disconnect_volume: return (313ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FpCDKNtq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '02d1edf9-9210-4f74-8216-f7e9350759aa'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:16:58 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa721746-6614-4748-a6b4-f360db31d6ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:16:58 user nova-compute[74805]: No targets found.
Nov 15 04:16:58 user nova-compute[74805]: iSNS:
Nov 15 04:16:58 user nova-compute[74805]: No targets found.
Nov 15 04:16:58 user nova-compute[74805]: STATIC:
Nov 15 04:16:58 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0
Nov 15 04:16:58 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:58 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:58 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6
Nov 15 04:16:58 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:58 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:58 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287
Nov 15 04:16:58 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:58 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:58 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d
Nov 15 04:16:58 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:58 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:58 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa
Nov 15 04:16:58 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:16:58 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:16:58 user nova-compute[74805]: FIRMWARE:
Nov 15 04:16:58 user nova-compute[74805]: No targets found.
Nov 15 04:16:58 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:16:58 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:16:58 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[06304779-490e-435d-a8c1-3efdadcde5c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79d4db6-d157-41a0-85d7-ace35ef58738]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)
Nov 15 04:16:58 user nova-compute[74805]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)
Nov 15 04:16:58 user nova-compute[74805]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:58 user nova-compute[74805]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)
Nov 15 04:16:58 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:58 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)
Nov 15 04:16:58 user nova-compute[74805]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa (non-flash)
Nov 15 04:16:58 user nova-compute[74805]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:16:58 user nova-compute[74805]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)
Nov 15 04:16:58 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:16:58 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c765ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa'): ({'sdj'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Removing single pathed devices sdj {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[018b06ab-58af-4fc3-b1f6-38b0a388c10a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba84e2a4-a9f6-4cdd-ac9f-7cb614b618f9]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Flushing IO for device /dev/sdj {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3540918-a11b-457b-ac12-63c13c92e771]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.053s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa68259-9a3d-4bd2-887b-b9fd8459f577]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] SCSI volumes sdj have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31567f9-aae7-4f1a-9d65-3a66f7c35676]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.190s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7377af-3849-4646-af0b-071a1f415976]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa, portal: 172.16.0.220,3260]
Nov 15 04:16:58 user nova-compute[74805]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa, portal: 172.16.0.220,3260] successful.
Nov 15 04:16:58 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02d1edf9-9210-4f74-8216-f7e9350759aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2342e2f-ba2b-4630-adba-b64b52d2ab83]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.465s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] <== disconnect_volume: return (466ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:16:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:16:59 user nova-compute[74805]: DEBUG nova.compute.manager [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUnLfqKY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'fdf3e90f-4fd8-4da4-a888-48c7a80fb209', 'attached_at': '', 'detached_at': '', 'volume_id': 'c27c663f-7b69-4434-9bc7-16a40032c7b0', 'serial'} {{(pid=74805) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 15 04:16:59 user nova-compute[74805]: DEBUG nova.compute.manager [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] swap_volume: removing Cinder connection for volume 02d1edf9-9210-4f74-8216-f7e9350759aa {{(pid=74805) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 15 04:16:59 user nova-compute[74805]: DEBUG nova.objects.instance [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lazy-loading 'flavor' on Instance uuid 05f49324-4b7a-4cd4-ada5-9450b9bf1d70 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:16:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a38e8421-3f43-4fdc-ad1a-d136c9cdf41f tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.104s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:16:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:16:59 user nova-compute[74805]: DEBUG nova.compute.manager [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] swap_volume: Updating volume 02d1edf9-9210-4f74-8216-f7e9350759aa BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "BUnLfqKY", "auth_password": "FDJU6Cz2EoxwG3", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "c27c663f-7b69-4434-9bc7-16a40032c7b0"}, "status": "reserved", "instance": "fdf3e90f-4fd8-4da4-a888-48c7a80fb209", "attached_at": "", "detached_at": "", "volume_id": "c27c663f-7b69-4434-9bc7-16a40032c7b0", "serial": "c27c663f-7b69-4434-9bc7-16a40032c7b0"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'c27c663f-7b69-4434-9bc7-16a40032c7b0', 'no_device': None, 'attachment_id': 'd248d623-44e3-49f3-b7d2-e55bf123cdc6'} {{(pid=74805) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 15 04:16:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a8f648e3-0e45-401e-a9ee-5c609d062ff0 tempest-TestVolumeSwap-528526305 tempest-TestVolumeSwap-528526305-project-admin] Lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.507s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Acquiring lock "interface-05f49324-4b7a-4cd4-ada5-9450b9bf1d70-594121f1-1d63-4ca4-8818-51d77f20a391" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "interface-05f49324-4b7a-4cd4-ada5-9450b9bf1d70-594121f1-1d63-4ca4-8818-51d77f20a391" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG nova.objects.instance [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lazy-loading 'flavor' on Instance uuid 05f49324-4b7a-4cd4-ada5-9450b9bf1d70 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-175864182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-175864182',id=8,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqVjB/VXeAAXbcPR9EXCBQSbi0fxJNcG8/LYTw94OkTxRdq8BS1Qip4iGD0FJLZzAa8glLWaInjyzM+FwK314PVqp4xOkTB5SsVxL+0dMsk7No3KOKU2UWDKovL9DtDJQ==',key_name='tempest-keypair-792239620',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:14:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5fa2f59063040d9a58de745e87380a6',ramdisk_id='',reservation_id='r-it125hzz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-986558879',owner_user_name='tempest-TaggedAttachmentsTest-986558879-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:14:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6fca23f109447409a8f31b925071ca7',uuid=05f49324-4b7a-4cd4-ada5-9450b9bf1d70,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "594121f1-1d63-4ca4-8818-51d77f20a391", "address": "fa:16:3e:04:e1:3a", "network": {"id": "c5744827-782d-4634-95a0-c795fcab0619", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-167365921", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a5fa2f59063040d9a58de745e87380a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594121f1-1d", "ovs_interfaceid": "594121f1-1d63-4ca4-8818-51d77f20a391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Converting VIF {"id": "594121f1-1d63-4ca4-8818-51d77f20a391", "address": "fa:16:3e:04:e1:3a", "network": {"id": "c5744827-782d-4634-95a0-c795fcab0619", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-167365921", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a5fa2f59063040d9a58de745e87380a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594121f1-1d", "ovs_interfaceid": "594121f1-1d63-4ca4-8818-51d77f20a391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:e1:3a,bridge_name='br-int',has_traffic_filtering=True,id=594121f1-1d63-4ca4-8818-51d77f20a391,network=Network(c5744827-782d-4634-95a0-c795fcab0619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap594121f1-1d') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:04:e1:3a"/><model type="virtio"/><mtu size="1442"/><target dev="tap594121f1-1d"/></interface> {{(pid=74805) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:04:e1:3a"/><model type="virtio"/><mtu size="1442"/><target dev="tap594121f1-1d"/></interface> {{(pid=74805) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Attempting to detach device tap594121f1-1d from instance 05f49324-4b7a-4cd4-ada5-9450b9bf1d70 from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] detach device xml: <interface type="ethernet">
Nov 15 04:17:00 user nova-compute[74805]:   <mac address="fa:16:3e:04:e1:3a"/>
Nov 15 04:17:00 user nova-compute[74805]:   <model type="virtio"/>
Nov 15 04:17:00 user nova-compute[74805]:   <mtu size="1442"/>
Nov 15 04:17:00 user nova-compute[74805]:   <target dev="tap594121f1-1d"/>
Nov 15 04:17:00 user nova-compute[74805]: </interface>
Nov 15 04:17:00 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:04:e1:3a"/><model type="virtio"/><mtu size="1442"/><target dev="tap594121f1-1d"/></interface> {{(pid=74805) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:04:e1:3a"/><model type="virtio"/><mtu size="1442"/><target dev="tap594121f1-1d"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 15 04:17:00 user nova-compute[74805]:   <name>instance-00000008</name>
Nov 15 04:17:00 user nova-compute[74805]:   <uuid>05f49324-4b7a-4cd4-ada5-9450b9bf1d70</uuid>
Nov 15 04:17:00 user nova-compute[74805]:   <metadata>
Nov 15 04:17:00 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:17:00 user nova-compute[74805]:   <nova:package version="0.0.0"/>
Nov 15 04:17:00 user nova-compute[74805]:   <nova:name>tempest-device-tagging-server-175864182</nova:name>
Nov 15 04:17:00 user nova-compute[74805]:   <nova:creationTime>2023-11-15 04:16:28</nova:creationTime>
Nov 15 04:17:00 user nova-compute[74805]:   <nova:flavor name="m1.tiny">
Nov 15 04:17:00 user nova-compute[74805]:     <nova:memory>512</nova:memory>
Nov 15 04:17:00 user nova-compute[74805]:     <nova:disk>1</nova:disk>
Nov 15 04:17:00 user nova-compute[74805]:     <nova:swap>0</nova:swap>
Nov 15 04:17:00 user nova-compute[74805]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:17:00 user nova-compute[74805]:     <nova:vcpus>1</nova:vcpus>
Nov 15 04:17:00 user nova-compute[74805]:   </nova:flavor>
Nov 15 04:17:00 user nova-compute[74805]:   <nova:owner>
Nov 15 04:17:00 user nova-compute[74805]:     <nova:user uuid="e6fca23f109447409a8f31b925071ca7">tempest-TaggedAttachmentsTest-986558879-project-member</nova:user>
Nov 15 04:17:00 user nova-compute[74805]:     <nova:project uuid="a5fa2f59063040d9a58de745e87380a6">tempest-TaggedAttachmentsTest-986558879</nova:project>
Nov 15 04:17:00 user nova-compute[74805]:   </nova:owner>
Nov 15 04:17:00 user nova-compute[74805]:   <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:17:00 user nova-compute[74805]:   <nova:ports>
Nov 15 04:17:00 user nova-compute[74805]:     <nova:port uuid="51834a6c-a2bb-4135-b3b3-beb4e689e876">
Nov 15 04:17:00 user nova-compute[74805]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 04:17:00 user nova-compute[74805]:     </nova:port>
Nov 15 04:17:00 user nova-compute[74805]:     <nova:port uuid="594121f1-1d63-4ca4-8818-51d77f20a391">
Nov 15 04:17:00 user nova-compute[74805]:       <nova:ip type="fixed" address="10.10.10.160" ipVersion="4"/>
Nov 15 04:17:00 user nova-compute[74805]:     </nova:port>
Nov 15 04:17:00 user nova-compute[74805]:   </nova:ports>
Nov 15 04:17:00 user nova-compute[74805]: </nova:instance>
Nov 15 04:17:00 user nova-compute[74805]:   </metadata>
Nov 15 04:17:00 user nova-compute[74805]:   <memory unit='KiB'>524288</memory>
Nov 15 04:17:00 user nova-compute[74805]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 04:17:00 user nova-compute[74805]:   <vcpu placement='static'>1</vcpu>
Nov 15 04:17:00 user nova-compute[74805]:   <resource>
Nov 15 04:17:00 user nova-compute[74805]:     <partition>/machine</partition>
Nov 15 04:17:00 user nova-compute[74805]:   </resource>
Nov 15 04:17:00 user nova-compute[74805]:   <sysinfo type='smbios'>
Nov 15 04:17:00 user nova-compute[74805]:     <system>
Nov 15 04:17:00 user nova-compute[74805]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 04:17:00 user nova-compute[74805]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 04:17:00 user nova-compute[74805]:       <entry name='version'>0.0.0</entry>
Nov 15 04:17:00 user nova-compute[74805]:       <entry name='serial'>05f49324-4b7a-4cd4-ada5-9450b9bf1d70</entry>
Nov 15 04:17:00 user nova-compute[74805]:       <entry name='uuid'>05f49324-4b7a-4cd4-ada5-9450b9bf1d70</entry>
Nov 15 04:17:00 user nova-compute[74805]:       <entry name='family'>Virtual Machine</entry>
Nov 15 04:17:00 user nova-compute[74805]:     </system>
Nov 15 04:17:00 user nova-compute[74805]:   </sysinfo>
Nov 15 04:17:00 user nova-compute[74805]:   <os>
Nov 15 04:17:00 user nova-compute[74805]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 04:17:00 user nova-compute[74805]:     <boot dev='hd'/>
Nov 15 04:17:00 user nova-compute[74805]:     <smbios mode='sysinfo'/>
Nov 15 04:17:00 user nova-compute[74805]:   </os>
Nov 15 04:17:00 user nova-compute[74805]:   <features>
Nov 15 04:17:00 user nova-compute[74805]:     <acpi/>
Nov 15 04:17:00 user nova-compute[74805]:     <apic/>
Nov 15 04:17:00 user nova-compute[74805]:     <vmcoreinfo state='on'/>
Nov 15 04:17:00 user nova-compute[74805]:   </features>
Nov 15 04:17:00 user nova-compute[74805]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 04:17:00 user nova-compute[74805]:     <model fallback='forbid'>Nehalem</model>
Nov 15 04:17:00 user nova-compute[74805]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 04:17:00 user nova-compute[74805]:     <feature policy='require' name='vme'/>
Nov 15 04:17:00 user nova-compute[74805]:     <feature policy='require' name='x2apic'/>
Nov 15 04:17:00 user nova-compute[74805]:     <feature policy='require' name='hypervisor'/>
Nov 15 04:17:00 user nova-compute[74805]:   </cpu>
Nov 15 04:17:00 user nova-compute[74805]:   <clock offset='utc'>
Nov 15 04:17:00 user nova-compute[74805]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 04:17:00 user nova-compute[74805]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 04:17:00 user nova-compute[74805]:     <timer name='hpet' present='no'/>
Nov 15 04:17:00 user nova-compute[74805]:   </clock>
Nov 15 04:17:00 user nova-compute[74805]:   <on_poweroff>destroy</on_poweroff>
Nov 15 04:17:00 user nova-compute[74805]:   <on_reboot>restart</on_reboot>
Nov 15 04:17:00 user nova-compute[74805]:   <on_crash>destroy</on_crash>
Nov 15 04:17:00 user nova-compute[74805]:   <devices>
Nov 15 04:17:00 user nova-compute[74805]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 04:17:00 user nova-compute[74805]:     <disk type='file' device='disk'>
Nov 15 04:17:00 user nova-compute[74805]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 04:17:00 user nova-compute[74805]:       <source file='/opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk' index='2'/>
Nov 15 04:17:00 user nova-compute[74805]:       <backingStore type='file' index='3'>
Nov 15 04:17:00 user nova-compute[74805]:         <format type='raw'/>
Nov 15 04:17:00 user nova-compute[74805]:         <source file='/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9'/>
Nov 15 04:17:00 user nova-compute[74805]:         <backingStore/>
Nov 15 04:17:00 user nova-compute[74805]:       </backingStore>
Nov 15 04:17:00 user nova-compute[74805]:       <target dev='vda' bus='virtio'/>
Nov 15 04:17:00 user nova-compute[74805]:       <alias name='virtio-disk0'/>
Nov 15 04:17:00 user nova-compute[74805]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 04:17:00 user nova-compute[74805]:     </disk>
Nov 15 04:17:00 user nova-compute[74805]:     <disk type='file' device='cdrom'>
Nov 15 04:17:00 user nova-compute[74805]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 04:17:00 user nova-compute[74805]:       <source file='/opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk.config' index='1'/>
Nov 15 04:17:00 user nova-compute[74805]:       <backingStore/>
Nov 15 04:17:00 user nova-compute[74805]:       <target dev='hda' bus='ide'/>
Nov 15 04:17:00 user nova-compute[74805]:       <readonly/>
Nov 15 04:17:00 user nova-compute[74805]:       <alias name='ide0-0-0'/>
Nov 15 04:17:00 user nova-compute[74805]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 04:17:00 user nova-compute[74805]:     </disk>
Nov 15 04:17:00 user nova-compute[74805]:     <controller type='usb' index='0' model='none'>
Nov 15 04:17:00 user nova-compute[74805]:       <alias name='usb'/>
Nov 15 04:17:00 user nova-compute[74805]:     </controller>
Nov 15 04:17:00 user nova-compute[74805]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 04:17:00 user nova-compute[74805]:       <alias name='pci.0'/>
Nov 15 04:17:00 user nova-compute[74805]:     </controller>
Nov 15 04:17:00 user nova-compute[74805]:     <controller type='ide' index='0'>
Nov 15 04:17:00 user nova-compute[74805]:       <alias name='ide'/>
Nov 15 04:17:00 user nova-compute[74805]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 04:17:00 user nova-compute[74805]:     </controller>
Nov 15 04:17:00 user nova-compute[74805]:     <interface type='ethernet'>
Nov 15 04:17:00 user nova-compute[74805]:       <mac address='fa:16:3e:c4:ea:ce'/>
Nov 15 04:17:00 user nova-compute[74805]:       <target dev='tap51834a6c-a2'/>
Nov 15 04:17:00 user nova-compute[74805]:       <model type='virtio'/>
Nov 15 04:17:00 user nova-compute[74805]:       <mtu size='1442'/>
Nov 15 04:17:00 user nova-compute[74805]:       <alias name='net0'/>
Nov 15 04:17:00 user nova-compute[74805]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 04:17:00 user nova-compute[74805]:     </interface>
Nov 15 04:17:00 user nova-compute[74805]:     <interface type='ethernet'>
Nov 15 04:17:00 user nova-compute[74805]:       <mac address='fa:16:3e:04:e1:3a'/>
Nov 15 04:17:00 user nova-compute[74805]:       <target dev='tap594121f1-1d'/>
Nov 15 04:17:00 user nova-compute[74805]:       <model type='virtio'/>
Nov 15 04:17:00 user nova-compute[74805]:       <mtu size='1442'/>
Nov 15 04:17:00 user nova-compute[74805]:       <alias name='net1'/>
Nov 15 04:17:00 user nova-compute[74805]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 15 04:17:00 user nova-compute[74805]:     </interface>
Nov 15 04:17:00 user nova-compute[74805]:     <serial type='pty'>
Nov 15 04:17:00 user nova-compute[74805]:       <source path='/dev/pts/6'/>
Nov 15 04:17:00 user nova-compute[74805]:       <log file='/opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/console.log' append='off'/>
Nov 15 04:17:00 user nova-compute[74805]:       <target type='isa-serial' port='0'>
Nov 15 04:17:00 user nova-compute[74805]:         <model name='isa-serial'/>
Nov 15 04:17:00 user nova-compute[74805]:       </target>
Nov 15 04:17:00 user nova-compute[74805]:       <alias name='serial0'/>
Nov 15 04:17:00 user nova-compute[74805]:     </serial>
Nov 15 04:17:00 user nova-compute[74805]:     <console type='pty' tty='/dev/pts/6'>
Nov 15 04:17:00 user nova-compute[74805]:       <source path='/dev/pts/6'/>
Nov 15 04:17:00 user nova-compute[74805]:       <log file='/opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/console.log' append='off'/>
Nov 15 04:17:00 user nova-compute[74805]:       <target type='serial' port='0'/>
Nov 15 04:17:00 user nova-compute[74805]:       <alias name='serial0'/>
Nov 15 04:17:00 user nova-compute[74805]:     </console>
Nov 15 04:17:00 user nova-compute[74805]:     <input type='mouse' bus='ps2'>
Nov 15 04:17:00 user nova-compute[74805]:       <alias name='input0'/>
Nov 15 04:17:00 user nova-compute[74805]:     </input>
Nov 15 04:17:00 user nova-compute[74805]:     <input type='keyboard' bus='ps2'>
Nov 15 04:17:00 user nova-compute[74805]:       <alias name='input1'/>
Nov 15 04:17:00 user nova-compute[74805]:     </input>
Nov 15 04:17:00 user nova-compute[74805]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 15 04:17:00 user nova-compute[74805]:       <listen type='address' address='0.0.0.0'/>
Nov 15 04:17:00 user nova-compute[74805]:     </graphics>
Nov 15 04:17:00 user nova-compute[74805]:     <audio id='1' type='none'/>
Nov 15 04:17:00 user nova-compute[74805]:     <video>
Nov 15 04:17:00 user nova-compute[74805]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 04:17:00 user nova-compute[74805]:       <alias name='video0'/>
Nov 15 04:17:00 user nova-compute[74805]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 04:17:00 user nova-compute[74805]:     </video>
Nov 15 04:17:00 user nova-compute[74805]:     <memballoon model='virtio'>
Nov 15 04:17:00 user nova-compute[74805]:       <stats period='10'/>
Nov 15 04:17:00 user nova-compute[74805]:       <alias name='balloon0'/>
Nov 15 04:17:00 user nova-compute[74805]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 04:17:00 user nova-compute[74805]:     </memballoon>
Nov 15 04:17:00 user nova-compute[74805]:     <rng model='virtio'>
Nov 15 04:17:00 user nova-compute[74805]:       <backend model='random'>/dev/urandom</backend>
Nov 15 04:17:00 user nova-compute[74805]:       <alias name='rng0'/>
Nov 15 04:17:00 user nova-compute[74805]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 04:17:00 user nova-compute[74805]:     </rng>
Nov 15 04:17:00 user nova-compute[74805]:   </devices>
Nov 15 04:17:00 user nova-compute[74805]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 04:17:00 user nova-compute[74805]:     <label>libvirt-05f49324-4b7a-4cd4-ada5-9450b9bf1d70</label>
Nov 15 04:17:00 user nova-compute[74805]:     <imagelabel>libvirt-05f49324-4b7a-4cd4-ada5-9450b9bf1d70</imagelabel>
Nov 15 04:17:00 user nova-compute[74805]:   </seclabel>
Nov 15 04:17:00 user nova-compute[74805]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 04:17:00 user nova-compute[74805]:     <label>+64055:+108</label>
Nov 15 04:17:00 user nova-compute[74805]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 04:17:00 user nova-compute[74805]:   </seclabel>
Nov 15 04:17:00 user nova-compute[74805]: </domain>
Nov 15 04:17:00 user nova-compute[74805]:  {{(pid=74805) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 04:17:00 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Successfully detached device tap594121f1-1d from instance 05f49324-4b7a-4cd4-ada5-9450b9bf1d70 from the persistent domain config.
Nov 15 04:17:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] (1/8): Attempting to detach device tap594121f1-1d with device alias net1 from instance 05f49324-4b7a-4cd4-ada5-9450b9bf1d70 from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] detach device xml: <interface type="ethernet">
Nov 15 04:17:00 user nova-compute[74805]:   <mac address="fa:16:3e:04:e1:3a"/>
Nov 15 04:17:00 user nova-compute[74805]:   <model type="virtio"/>
Nov 15 04:17:00 user nova-compute[74805]:   <mtu size="1442"/>
Nov 15 04:17:00 user nova-compute[74805]:   <target dev="tap594121f1-1d"/>
Nov 15 04:17:00 user nova-compute[74805]: </interface>
Nov 15 04:17:00 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:00 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 89dcacb0-6864-4529-903d-ae46a2dc3bdd is timed out.
Nov 15 04:17:00 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Successfully detached device vdb from instance 89dcacb0-6864-4529-903d-ae46a2dc3bdd from the live domain config.
Nov 15 04:17:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ALOSNtnu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:17:00 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:17:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[238100b5-c337-41fe-a5b4-0e6ab82a882a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:17:00 user nova-compute[74805]: No targets found.
Nov 15 04:17:00 user nova-compute[74805]: iSNS:
Nov 15 04:17:00 user nova-compute[74805]: No targets found.
Nov 15 04:17:00 user nova-compute[74805]: STATIC:
Nov 15 04:17:00 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0
Nov 15 04:17:00 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:17:00 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:17:00 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6
Nov 15 04:17:00 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:17:00 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:17:00 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287
Nov 15 04:17:00 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:17:00 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:17:00 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d
Nov 15 04:17:00 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:17:00 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:17:00 user nova-compute[74805]: FIRMWARE:
Nov 15 04:17:00 user nova-compute[74805]: No targets found.
Nov 15 04:17:00 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:17:00 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:17:00 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72e161e-362d-4236-abea-d883172ab3e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b3bee5-6dd2-4fbc-a50c-1a27186bcf3d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)
Nov 15 04:17:00 user nova-compute[74805]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:17:00 user nova-compute[74805]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)
Nov 15 04:17:00 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:17:00 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 (non-flash)
Nov 15 04:17:00 user nova-compute[74805]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:17:00 user nova-compute[74805]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)
Nov 15 04:17:00 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:17:00 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c10b490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287'): ({'sdi'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Removing single pathed devices sdi {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[368e75c8-130a-4339-9d22-6ee79fa24b94]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[415cfbec-1e4f-4a0f-b293-c936aa6ef0a0]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Flushing IO for device /dev/sdi {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dca208-e5e4-48ec-bc06-9c9ecae41ada]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.059s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[be13f193-2634-4097-884d-1fc2fc3ac60d]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] SCSI volumes sdi have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Start waiting for the detach event from libvirt for device tap594121f1-1d with device alias net1 for instance 05f49324-4b7a-4cd4-ada5-9450b9bf1d70 {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[891a3866-95f3-4f35-ad2c-d7c0718fd6a5]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf54a37-68d9-4b75-8a83-d372d71fa50b]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287, portal: 172.16.0.220,3260]
Nov 15 04:17:00 user nova-compute[74805]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287, portal: 172.16.0.220,3260] successful.
Nov 15 04:17:00 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eeda1e3-3470-493c-abc5-0000c70f8287 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb7bbd7-ad46-44e4-a904-0e91ff84be43]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] <== disconnect_volume: return (374ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-5afea97d-3c12-4cd3-9251-2192f421d62a req-92d22286-ad46-4e4c-b697-59adc8d15d79 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Received event network-vif-unplugged-594121f1-1d63-4ca4-8818-51d77f20a391 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5afea97d-3c12-4cd3-9251-2192f421d62a req-92d22286-ad46-4e4c-b697-59adc8d15d79 service nova] Acquiring lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5afea97d-3c12-4cd3-9251-2192f421d62a req-92d22286-ad46-4e4c-b697-59adc8d15d79 service nova] Lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5afea97d-3c12-4cd3-9251-2192f421d62a req-92d22286-ad46-4e4c-b697-59adc8d15d79 service nova] Lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-5afea97d-3c12-4cd3-9251-2192f421d62a req-92d22286-ad46-4e4c-b697-59adc8d15d79 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] No waiting events found dispatching network-vif-unplugged-594121f1-1d63-4ca4-8818-51d77f20a391 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:17:00 user nova-compute[74805]: WARNING nova.compute.manager [req-5afea97d-3c12-4cd3-9251-2192f421d62a req-92d22286-ad46-4e4c-b697-59adc8d15d79 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Received unexpected event network-vif-unplugged-594121f1-1d63-4ca4-8818-51d77f20a391 for instance with vm_state active and task_state None.
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Acquiring lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:00 user nova-compute[74805]: INFO nova.compute.manager [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Detaching volume c27c663f-7b69-4434-9bc7-16a40032c7b0
Nov 15 04:17:00 user nova-compute[74805]: INFO nova.virt.block_device [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Attempting to driver detach volume c27c663f-7b69-4434-9bc7-16a40032c7b0 from mountpoint /dev/vdb
Nov 15 04:17:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Attempting to detach device vdb from instance fdf3e90f-4fd8-4da4-a888-48c7a80fb209 from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:17:00 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:17:00 user nova-compute[74805]:   <source dev="/dev/sdc"/>
Nov 15 04:17:00 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:17:00 user nova-compute[74805]:   <serial>c27c663f-7b69-4434-9bc7-16a40032c7b0</serial>
Nov 15 04:17:00 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:17:00 user nova-compute[74805]: </disk>
Nov 15 04:17:00 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:17:00 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Successfully detached device vdb from instance fdf3e90f-4fd8-4da4-a888-48c7a80fb209 from the persistent domain config.
Nov 15 04:17:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fdf3e90f-4fd8-4da4-a888-48c7a80fb209 from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:17:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:17:00 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:17:00 user nova-compute[74805]:   <source dev="/dev/sdc"/>
Nov 15 04:17:00 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:17:00 user nova-compute[74805]:   <serial>c27c663f-7b69-4434-9bc7-16a40032c7b0</serial>
Nov 15 04:17:00 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:17:00 user nova-compute[74805]: </disk>
Nov 15 04:17:00 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:17:01 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:17:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:01 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:17:01 user nova-compute[74805]: DEBUG nova.objects.instance [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Lazy-loading 'flavor' on Instance uuid 89dcacb0-6864-4529-903d-ae46a2dc3bdd {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:17:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fdf3e90f-4fd8-4da4-a888-48c7a80fb209 {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:17:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3db3c0a2-d4a3-4aae-8152-c956e1ed9a11 tempest-VolumesAssistedSnapshotsTest-1125915468 tempest-VolumesAssistedSnapshotsTest-1125915468-project-admin] Lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.738s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:02 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:17:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:02 user nova-compute[74805]: DEBUG nova.compute.manager [req-603e17b8-8256-4e0a-b674-0853520f0842 req-7f360369-10ba-4d6f-92d5-46c472e338c9 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Received event network-vif-plugged-594121f1-1d63-4ca4-8818-51d77f20a391 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:02 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-603e17b8-8256-4e0a-b674-0853520f0842 req-7f360369-10ba-4d6f-92d5-46c472e338c9 service nova] Acquiring lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:02 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-603e17b8-8256-4e0a-b674-0853520f0842 req-7f360369-10ba-4d6f-92d5-46c472e338c9 service nova] Lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:02 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-603e17b8-8256-4e0a-b674-0853520f0842 req-7f360369-10ba-4d6f-92d5-46c472e338c9 service nova] Lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:02 user nova-compute[74805]: DEBUG nova.compute.manager [req-603e17b8-8256-4e0a-b674-0853520f0842 req-7f360369-10ba-4d6f-92d5-46c472e338c9 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] No waiting events found dispatching network-vif-plugged-594121f1-1d63-4ca4-8818-51d77f20a391 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:17:02 user nova-compute[74805]: WARNING nova.compute.manager [req-603e17b8-8256-4e0a-b674-0853520f0842 req-7f360369-10ba-4d6f-92d5-46c472e338c9 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Received unexpected event network-vif-plugged-594121f1-1d63-4ca4-8818-51d77f20a391 for instance with vm_state active and task_state None.
Nov 15 04:17:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b682db81-a837-49e6-818c-394dd4f1e3f4/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b682db81-a837-49e6-818c-394dd4f1e3f4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b682db81-a837-49e6-818c-394dd4f1e3f4/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b682db81-a837-49e6-818c-394dd4f1e3f4/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:17:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdf3e90f-4fd8-4da4-a888-48c7a80fb209/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdf3e90f-4fd8-4da4-a888-48c7a80fb209/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdf3e90f-4fd8-4da4-a888-48c7a80fb209/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdf3e90f-4fd8-4da4-a888-48c7a80fb209/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89dcacb0-6864-4529-903d-ae46a2dc3bdd/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89dcacb0-6864-4529-903d-ae46a2dc3bdd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89dcacb0-6864-4529-903d-ae46a2dc3bdd/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89dcacb0-6864-4529-903d-ae46a2dc3bdd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:06 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:17:06 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:17:06 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=6801MB free_disk=25.374614715576172GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:17:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:06 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 2b1e540c-6226-445a-bd45-5b7b8807e2b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:17:06 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:17:06 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 1eb9b315-77a9-40f7-8a43-8c40186a0dca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:17:06 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 0de78a8a-d66a-4703-a044-89c2f2006860 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:17:06 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance d63f3726-27df-455f-bda0-3ddca95b70d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:17:06 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance e91a656c-66d6-4a70-a115-8c03ed964f94 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:17:06 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 05f49324-4b7a-4cd4-ada5-9450b9bf1d70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:17:06 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance fdf3e90f-4fd8-4da4-a888-48c7a80fb209 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:17:06 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 89dcacb0-6864-4529-903d-ae46a2dc3bdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:17:06 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance cad2eedf-c1ef-436c-b608-5b6dafa47451 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:17:06 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:17:06 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance b682db81-a837-49e6-818c-394dd4f1e3f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:17:06 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:17:06 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:17:06 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:17:06 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:17:06 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:17:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.516s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:07 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:17:07 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:17:07 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:17:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-1eb9b315-77a9-40f7-8a43-8c40186a0dca" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:17:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-1eb9b315-77a9-40f7-8a43-8c40186a0dca" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:17:08 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:17:08 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Updating instance_info_cache with network_info: [{"id": "94bbd0d6-bf79-45aa-b274-8a9b44dd26ab", "address": "fa:16:3e:80:32:cf", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94bbd0d6-bf", "ovs_interfaceid": "94bbd0d6-bf79-45aa-b274-8a9b44dd26ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:17:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-1eb9b315-77a9-40f7-8a43-8c40186a0dca" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:17:08 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:17:08 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:17:08 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:17:08 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:17:08 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:17:08 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:17:08 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:17:08 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:17:09 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "e5004557-00fa-4824-9233-343c2261588d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "e5004557-00fa-4824-9233-343c2261588d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:12 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:17:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:12 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:17:12 user nova-compute[74805]: INFO nova.compute.claims [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Claim successful on node user
Nov 15 04:17:13 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:17:13 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:17:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:13 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:17:13 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:17:13 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:17:13 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:17:13 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:17:13 user nova-compute[74805]: DEBUG nova.policy [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50fe72dfe19f4c9792c4733f14b2d464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ba201faadb461882c823f9bd895af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:17:13 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:17:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:17:13 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Creating image(s)
Nov 15 04:17:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "/opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "/opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.177s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.174s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk 1073741824" returned: 0 in 0.054s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:14 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Successfully created port: 96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:17:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.189s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:14 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:17:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:14 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Cannot resize image /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:17:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:17:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Ensure instance console log exists: /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:17:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:14 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Successfully updated port: 96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:17:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "refresh_cache-e5004557-00fa-4824-9233-343c2261588d" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:17:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquired lock "refresh_cache-e5004557-00fa-4824-9233-343c2261588d" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:17:14 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:17:14 user nova-compute[74805]: DEBUG nova.compute.manager [req-6c2fe43f-e5b0-47dd-a805-c6f75ebda28b req-80a619bc-391b-4240-866e-6bf85c031599 service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Received event network-changed-96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:14 user nova-compute[74805]: DEBUG nova.compute.manager [req-6c2fe43f-e5b0-47dd-a805-c6f75ebda28b req-80a619bc-391b-4240-866e-6bf85c031599 service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Refreshing instance network info cache due to event network-changed-96104fe5-a8a5-445d-9c2a-6631a15e4349. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:17:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6c2fe43f-e5b0-47dd-a805-c6f75ebda28b req-80a619bc-391b-4240-866e-6bf85c031599 service nova] Acquiring lock "refresh_cache-e5004557-00fa-4824-9233-343c2261588d" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:17:14 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Updating instance_info_cache with network_info: [{"id": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "address": "fa:16:3e:c8:0f:b4", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96104fe5-a8", "ovs_interfaceid": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Releasing lock "refresh_cache-e5004557-00fa-4824-9233-343c2261588d" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Instance network_info: |[{"id": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "address": "fa:16:3e:c8:0f:b4", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96104fe5-a8", "ovs_interfaceid": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6c2fe43f-e5b0-47dd-a805-c6f75ebda28b req-80a619bc-391b-4240-866e-6bf85c031599 service nova] Acquired lock "refresh_cache-e5004557-00fa-4824-9233-343c2261588d" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.network.neutron [req-6c2fe43f-e5b0-47dd-a805-c6f75ebda28b req-80a619bc-391b-4240-866e-6bf85c031599 service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Refreshing network info cache for port 96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Start _get_guest_xml network_info=[{"id": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "address": "fa:16:3e:c8:0f:b4", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96104fe5-a8", "ovs_interfaceid": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:17:15 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:17:15 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:17:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1146298859',display_name='tempest-AttachVolumeTestJSON-server-1146298859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1146298859',id=15,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcDGmoSL9n6BzrErqwQE4CV+qAoPf9h8eN4+5EDz04bsyjTTZ4Sit9JWjEhWommytKEKkL3SeMOXxTqRGtePTLcAr9xdzbbxAAil9ruYGUIPqhf/tGyrXvLN/cCYSgOhg==',key_name='tempest-keypair-2130424993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7ba201faadb461882c823f9bd895af9',ramdisk_id='',reservation_id='r-g45utcp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-17326548',owner_user_name='tempest-AttachVolumeTestJSON-17326548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:17:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50fe72dfe19f4c9792c4733f14b2d464',uuid=e5004557-00fa-4824-9233-343c2261588d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "address": "fa:16:3e:c8:0f:b4", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96104fe5-a8", "ovs_interfaceid": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Converting VIF {"id": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "address": "fa:16:3e:c8:0f:b4", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96104fe5-a8", "ovs_interfaceid": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:0f:b4,bridge_name='br-int',has_traffic_filtering=True,id=96104fe5-a8a5-445d-9c2a-6631a15e4349,network=Network(5b2973a0-643c-4d30-a6cd-3d1391fe2cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96104fe5-a8') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.objects.instance [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'pci_devices' on Instance uuid e5004557-00fa-4824-9233-343c2261588d {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:17:15 user nova-compute[74805]:   <uuid>e5004557-00fa-4824-9233-343c2261588d</uuid>
Nov 15 04:17:15 user nova-compute[74805]:   <name>instance-0000000f</name>
Nov 15 04:17:15 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:17:15 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:17:15 user nova-compute[74805]:   <metadata>
Nov 15 04:17:15 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:17:15 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:17:15 user nova-compute[74805]:       <nova:name>tempest-AttachVolumeTestJSON-server-1146298859</nova:name>
Nov 15 04:17:15 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:17:15</nova:creationTime>
Nov 15 04:17:15 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:17:15 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:17:15 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:17:15 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:17:15 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:17:15 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:17:15 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:17:15 user nova-compute[74805]:       <nova:owner>
Nov 15 04:17:15 user nova-compute[74805]:         <nova:user uuid="50fe72dfe19f4c9792c4733f14b2d464">tempest-AttachVolumeTestJSON-17326548-project-member</nova:user>
Nov 15 04:17:15 user nova-compute[74805]:         <nova:project uuid="b7ba201faadb461882c823f9bd895af9">tempest-AttachVolumeTestJSON-17326548</nova:project>
Nov 15 04:17:15 user nova-compute[74805]:       </nova:owner>
Nov 15 04:17:15 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:17:15 user nova-compute[74805]:       <nova:ports>
Nov 15 04:17:15 user nova-compute[74805]:         <nova:port uuid="96104fe5-a8a5-445d-9c2a-6631a15e4349">
Nov 15 04:17:15 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 04:17:15 user nova-compute[74805]:         </nova:port>
Nov 15 04:17:15 user nova-compute[74805]:       </nova:ports>
Nov 15 04:17:15 user nova-compute[74805]:     </nova:instance>
Nov 15 04:17:15 user nova-compute[74805]:   </metadata>
Nov 15 04:17:15 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:17:15 user nova-compute[74805]:     <system>
Nov 15 04:17:15 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:17:15 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:17:15 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:17:15 user nova-compute[74805]:       <entry name="serial">e5004557-00fa-4824-9233-343c2261588d</entry>
Nov 15 04:17:15 user nova-compute[74805]:       <entry name="uuid">e5004557-00fa-4824-9233-343c2261588d</entry>
Nov 15 04:17:15 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:17:15 user nova-compute[74805]:     </system>
Nov 15 04:17:15 user nova-compute[74805]:   </sysinfo>
Nov 15 04:17:15 user nova-compute[74805]:   <os>
Nov 15 04:17:15 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:17:15 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:17:15 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:17:15 user nova-compute[74805]:   </os>
Nov 15 04:17:15 user nova-compute[74805]:   <features>
Nov 15 04:17:15 user nova-compute[74805]:     <acpi/>
Nov 15 04:17:15 user nova-compute[74805]:     <apic/>
Nov 15 04:17:15 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:17:15 user nova-compute[74805]:   </features>
Nov 15 04:17:15 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:17:15 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:17:15 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:17:15 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:17:15 user nova-compute[74805]:   </clock>
Nov 15 04:17:15 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:17:15 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:17:15 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:17:15 user nova-compute[74805]:   </cpu>
Nov 15 04:17:15 user nova-compute[74805]:   <devices>
Nov 15 04:17:15 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:17:15 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:17:15 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk"/>
Nov 15 04:17:15 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:17:15 user nova-compute[74805]:     </disk>
Nov 15 04:17:15 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:17:15 user nova-compute[74805]:       <mac address="fa:16:3e:c8:0f:b4"/>
Nov 15 04:17:15 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:17:15 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:17:15 user nova-compute[74805]:       <target dev="tap96104fe5-a8"/>
Nov 15 04:17:15 user nova-compute[74805]:     </interface>
Nov 15 04:17:15 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:17:15 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/console.log" append="off"/>
Nov 15 04:17:15 user nova-compute[74805]:     </serial>
Nov 15 04:17:15 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:17:15 user nova-compute[74805]:     <video>
Nov 15 04:17:15 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:17:15 user nova-compute[74805]:     </video>
Nov 15 04:17:15 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:17:15 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:17:15 user nova-compute[74805]:     </rng>
Nov 15 04:17:15 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:17:15 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:17:15 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:17:15 user nova-compute[74805]:     </memballoon>
Nov 15 04:17:15 user nova-compute[74805]:   </devices>
Nov 15 04:17:15 user nova-compute[74805]: </domain>
Nov 15 04:17:15 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:17:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1146298859',display_name='tempest-AttachVolumeTestJSON-server-1146298859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1146298859',id=15,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcDGmoSL9n6BzrErqwQE4CV+qAoPf9h8eN4+5EDz04bsyjTTZ4Sit9JWjEhWommytKEKkL3SeMOXxTqRGtePTLcAr9xdzbbxAAil9ruYGUIPqhf/tGyrXvLN/cCYSgOhg==',key_name='tempest-keypair-2130424993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7ba201faadb461882c823f9bd895af9',ramdisk_id='',reservation_id='r-g45utcp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-17326548',owner_user_name='tempest-AttachVolumeTestJSON-17326548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:17:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50fe72dfe19f4c9792c4733f14b2d464',uuid=e5004557-00fa-4824-9233-343c2261588d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "address": "fa:16:3e:c8:0f:b4", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96104fe5-a8", "ovs_interfaceid": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Converting VIF {"id": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "address": "fa:16:3e:c8:0f:b4", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96104fe5-a8", "ovs_interfaceid": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:0f:b4,bridge_name='br-int',has_traffic_filtering=True,id=96104fe5-a8a5-445d-9c2a-6631a15e4349,network=Network(5b2973a0-643c-4d30-a6cd-3d1391fe2cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96104fe5-a8') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG os_vif [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:0f:b4,bridge_name='br-int',has_traffic_filtering=True,id=96104fe5-a8a5-445d-9c2a-6631a15e4349,network=Network(5b2973a0-643c-4d30-a6cd-3d1391fe2cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96104fe5-a8') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a34ea466-36fd-5891-908e-afd1b72cd053', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96104fe5-a8, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96104fe5-a8, col_values=(('qos', UUID('cc59cdf7-24c6-4f61-9570-7977f5a7862c')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96104fe5-a8, col_values=(('external_ids', {'iface-id': '96104fe5-a8a5-445d-9c2a-6631a15e4349', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:0f:b4', 'vm-uuid': 'e5004557-00fa-4824-9233-343c2261588d'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:15 user nova-compute[74805]: INFO os_vif [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:0f:b4,bridge_name='br-int',has_traffic_filtering=True,id=96104fe5-a8a5-445d-9c2a-6631a15e4349,network=Network(5b2973a0-643c-4d30-a6cd-3d1391fe2cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96104fe5-a8')
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] No VIF found with MAC fa:16:3e:c8:0f:b4, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.network.neutron [req-6c2fe43f-e5b0-47dd-a805-c6f75ebda28b req-80a619bc-391b-4240-866e-6bf85c031599 service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Updated VIF entry in instance network info cache for port 96104fe5-a8a5-445d-9c2a-6631a15e4349. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG nova.network.neutron [req-6c2fe43f-e5b0-47dd-a805-c6f75ebda28b req-80a619bc-391b-4240-866e-6bf85c031599 service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Updating instance_info_cache with network_info: [{"id": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "address": "fa:16:3e:c8:0f:b4", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96104fe5-a8", "ovs_interfaceid": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:17:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6c2fe43f-e5b0-47dd-a805-c6f75ebda28b req-80a619bc-391b-4240-866e-6bf85c031599 service nova] Releasing lock "refresh_cache-e5004557-00fa-4824-9233-343c2261588d" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:17:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:16 user nova-compute[74805]: DEBUG nova.compute.manager [req-dba3161d-27c3-43eb-b861-214124bc62d6 req-3fec53f9-adf9-4719-88d3-2f4760107a0a service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Received event network-vif-plugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-dba3161d-27c3-43eb-b861-214124bc62d6 req-3fec53f9-adf9-4719-88d3-2f4760107a0a service nova] Acquiring lock "e5004557-00fa-4824-9233-343c2261588d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-dba3161d-27c3-43eb-b861-214124bc62d6 req-3fec53f9-adf9-4719-88d3-2f4760107a0a service nova] Lock "e5004557-00fa-4824-9233-343c2261588d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-dba3161d-27c3-43eb-b861-214124bc62d6 req-3fec53f9-adf9-4719-88d3-2f4760107a0a service nova] Lock "e5004557-00fa-4824-9233-343c2261588d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:16 user nova-compute[74805]: DEBUG nova.compute.manager [req-dba3161d-27c3-43eb-b861-214124bc62d6 req-3fec53f9-adf9-4719-88d3-2f4760107a0a service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] No waiting events found dispatching network-vif-plugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:17:16 user nova-compute[74805]: WARNING nova.compute.manager [req-dba3161d-27c3-43eb-b861-214124bc62d6 req-3fec53f9-adf9-4719-88d3-2f4760107a0a service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Received unexpected event network-vif-plugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 for instance with vm_state building and task_state spawning.
Nov 15 04:17:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:18 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:17:18 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:17:18 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: e5004557-00fa-4824-9233-343c2261588d] Instance spawned successfully.
Nov 15 04:17:18 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:17:18 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:17:18 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:17:18 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:17:18 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:17:18 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:17:18 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:17:18 user nova-compute[74805]: INFO nova.compute.manager [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Took 5.01 seconds to spawn the instance on the hypervisor.
Nov 15 04:17:18 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:17:18 user nova-compute[74805]: INFO nova.compute.manager [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Took 5.86 seconds to build instance.
Nov 15 04:17:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cb4fef14-682b-4bdb-ae98-590221014adc tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "e5004557-00fa-4824-9233-343c2261588d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.094s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:18 user nova-compute[74805]: DEBUG nova.compute.manager [req-cab59237-10b3-45f7-9429-6d514a597fd6 req-3b4fdcd2-e464-4cdf-9fcb-d516fcdde026 service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Received event network-vif-plugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-cab59237-10b3-45f7-9429-6d514a597fd6 req-3b4fdcd2-e464-4cdf-9fcb-d516fcdde026 service nova] Acquiring lock "e5004557-00fa-4824-9233-343c2261588d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-cab59237-10b3-45f7-9429-6d514a597fd6 req-3b4fdcd2-e464-4cdf-9fcb-d516fcdde026 service nova] Lock "e5004557-00fa-4824-9233-343c2261588d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-cab59237-10b3-45f7-9429-6d514a597fd6 req-3b4fdcd2-e464-4cdf-9fcb-d516fcdde026 service nova] Lock "e5004557-00fa-4824-9233-343c2261588d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:18 user nova-compute[74805]: DEBUG nova.compute.manager [req-cab59237-10b3-45f7-9429-6d514a597fd6 req-3b4fdcd2-e464-4cdf-9fcb-d516fcdde026 service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] No waiting events found dispatching network-vif-plugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:17:18 user nova-compute[74805]: WARNING nova.compute.manager [req-cab59237-10b3-45f7-9429-6d514a597fd6 req-3b4fdcd2-e464-4cdf-9fcb-d516fcdde026 service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Received unexpected event network-vif-plugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 for instance with vm_state active and task_state None.
Nov 15 04:17:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "cad2eedf-c1ef-436c-b608-5b6dafa47451" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:19 user nova-compute[74805]: DEBUG nova.objects.instance [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lazy-loading 'flavor' on Instance uuid cad2eedf-c1ef-436c-b608-5b6dafa47451 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:17:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "cad2eedf-c1ef-436c-b608-5b6dafa47451" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:19 user nova-compute[74805]: INFO nova.compute.manager [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Attaching volume 96273922-6a78-407c-81c9-059c9e65020d to /dev/vdb
Nov 15 04:17:19 user nova-compute[74805]: DEBUG os_brick.utils [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:17:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[190afa46-9a10-408b-90ee-dd9be7b9e4ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a211e8a7-6160-45bf-b3b6-4079318f47c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d66fc0-ceea-46b7-8db3-20414e108db0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbde34b7-c2e6-47d0-8f56-e2549003130d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:17:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:17:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:17:19 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:17:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6be5b3-a868-4cb3-a13d-8df0cca9e206]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:17:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:17:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:17:19 user nova-compute[74805]: DEBUG os_brick.utils [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:17:19 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Updating existing volume attachment record: 482a3f48-487f-46ed-8429-1d3f587d9395 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:17:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:20 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Waiting for libvirt event about the detach of device tap594121f1-1d with device alias net1 from instance 05f49324-4b7a-4cd4-ada5-9450b9bf1d70 is timed out.
Nov 15 04:17:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:04:e1:3a"/><model type="virtio"/><mtu size="1442"/><target dev="tap594121f1-1d"/></interface> {{(pid=74805) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 04:17:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:04:e1:3a"/><model type="virtio"/><mtu size="1442"/><target dev="tap594121f1-1d"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 15 04:17:20 user nova-compute[74805]:   <name>instance-00000008</name>
Nov 15 04:17:20 user nova-compute[74805]:   <uuid>05f49324-4b7a-4cd4-ada5-9450b9bf1d70</uuid>
Nov 15 04:17:20 user nova-compute[74805]:   <metadata>
Nov 15 04:17:20 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:17:20 user nova-compute[74805]:   <nova:package version="0.0.0"/>
Nov 15 04:17:20 user nova-compute[74805]:   <nova:name>tempest-device-tagging-server-175864182</nova:name>
Nov 15 04:17:20 user nova-compute[74805]:   <nova:creationTime>2023-11-15 04:16:28</nova:creationTime>
Nov 15 04:17:20 user nova-compute[74805]:   <nova:flavor name="m1.tiny">
Nov 15 04:17:20 user nova-compute[74805]:     <nova:memory>512</nova:memory>
Nov 15 04:17:20 user nova-compute[74805]:     <nova:disk>1</nova:disk>
Nov 15 04:17:20 user nova-compute[74805]:     <nova:swap>0</nova:swap>
Nov 15 04:17:20 user nova-compute[74805]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:17:20 user nova-compute[74805]:     <nova:vcpus>1</nova:vcpus>
Nov 15 04:17:20 user nova-compute[74805]:   </nova:flavor>
Nov 15 04:17:20 user nova-compute[74805]:   <nova:owner>
Nov 15 04:17:20 user nova-compute[74805]:     <nova:user uuid="e6fca23f109447409a8f31b925071ca7">tempest-TaggedAttachmentsTest-986558879-project-member</nova:user>
Nov 15 04:17:20 user nova-compute[74805]:     <nova:project uuid="a5fa2f59063040d9a58de745e87380a6">tempest-TaggedAttachmentsTest-986558879</nova:project>
Nov 15 04:17:20 user nova-compute[74805]:   </nova:owner>
Nov 15 04:17:20 user nova-compute[74805]:   <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:17:20 user nova-compute[74805]:   <nova:ports>
Nov 15 04:17:20 user nova-compute[74805]:     <nova:port uuid="51834a6c-a2bb-4135-b3b3-beb4e689e876">
Nov 15 04:17:20 user nova-compute[74805]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 04:17:20 user nova-compute[74805]:     </nova:port>
Nov 15 04:17:20 user nova-compute[74805]:     <nova:port uuid="594121f1-1d63-4ca4-8818-51d77f20a391">
Nov 15 04:17:20 user nova-compute[74805]:       <nova:ip type="fixed" address="10.10.10.160" ipVersion="4"/>
Nov 15 04:17:20 user nova-compute[74805]:     </nova:port>
Nov 15 04:17:20 user nova-compute[74805]:   </nova:ports>
Nov 15 04:17:20 user nova-compute[74805]: </nova:instance>
Nov 15 04:17:20 user nova-compute[74805]:   </metadata>
Nov 15 04:17:20 user nova-compute[74805]:   <memory unit='KiB'>524288</memory>
Nov 15 04:17:20 user nova-compute[74805]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 04:17:20 user nova-compute[74805]:   <vcpu placement='static'>1</vcpu>
Nov 15 04:17:20 user nova-compute[74805]:   <resource>
Nov 15 04:17:20 user nova-compute[74805]:     <partition>/machine</partition>
Nov 15 04:17:20 user nova-compute[74805]:   </resource>
Nov 15 04:17:20 user nova-compute[74805]:   <sysinfo type='smbios'>
Nov 15 04:17:20 user nova-compute[74805]:     <system>
Nov 15 04:17:20 user nova-compute[74805]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 04:17:20 user nova-compute[74805]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 04:17:20 user nova-compute[74805]:       <entry name='version'>0.0.0</entry>
Nov 15 04:17:20 user nova-compute[74805]:       <entry name='serial'>05f49324-4b7a-4cd4-ada5-9450b9bf1d70</entry>
Nov 15 04:17:20 user nova-compute[74805]:       <entry name='uuid'>05f49324-4b7a-4cd4-ada5-9450b9bf1d70</entry>
Nov 15 04:17:20 user nova-compute[74805]:       <entry name='family'>Virtual Machine</entry>
Nov 15 04:17:20 user nova-compute[74805]:     </system>
Nov 15 04:17:20 user nova-compute[74805]:   </sysinfo>
Nov 15 04:17:20 user nova-compute[74805]:   <os>
Nov 15 04:17:20 user nova-compute[74805]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 04:17:20 user nova-compute[74805]:     <boot dev='hd'/>
Nov 15 04:17:20 user nova-compute[74805]:     <smbios mode='sysinfo'/>
Nov 15 04:17:20 user nova-compute[74805]:   </os>
Nov 15 04:17:20 user nova-compute[74805]:   <features>
Nov 15 04:17:20 user nova-compute[74805]:     <acpi/>
Nov 15 04:17:20 user nova-compute[74805]:     <apic/>
Nov 15 04:17:20 user nova-compute[74805]:     <vmcoreinfo state='on'/>
Nov 15 04:17:20 user nova-compute[74805]:   </features>
Nov 15 04:17:20 user nova-compute[74805]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 04:17:20 user nova-compute[74805]:     <model fallback='forbid'>Nehalem</model>
Nov 15 04:17:20 user nova-compute[74805]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 04:17:20 user nova-compute[74805]:     <feature policy='require' name='vme'/>
Nov 15 04:17:20 user nova-compute[74805]:     <feature policy='require' name='x2apic'/>
Nov 15 04:17:20 user nova-compute[74805]:     <feature policy='require' name='hypervisor'/>
Nov 15 04:17:20 user nova-compute[74805]:   </cpu>
Nov 15 04:17:20 user nova-compute[74805]:   <clock offset='utc'>
Nov 15 04:17:20 user nova-compute[74805]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 04:17:20 user nova-compute[74805]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 04:17:20 user nova-compute[74805]:     <timer name='hpet' present='no'/>
Nov 15 04:17:20 user nova-compute[74805]:   </clock>
Nov 15 04:17:20 user nova-compute[74805]:   <on_poweroff>destroy</on_poweroff>
Nov 15 04:17:20 user nova-compute[74805]:   <on_reboot>restart</on_reboot>
Nov 15 04:17:20 user nova-compute[74805]:   <on_crash>destroy</on_crash>
Nov 15 04:17:20 user nova-compute[74805]:   <devices>
Nov 15 04:17:20 user nova-compute[74805]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 04:17:20 user nova-compute[74805]:     <disk type='file' device='disk'>
Nov 15 04:17:20 user nova-compute[74805]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 04:17:20 user nova-compute[74805]:       <source file='/opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk' index='2'/>
Nov 15 04:17:20 user nova-compute[74805]:       <backingStore type='file' index='3'>
Nov 15 04:17:20 user nova-compute[74805]:         <format type='raw'/>
Nov 15 04:17:20 user nova-compute[74805]:         <source file='/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9'/>
Nov 15 04:17:20 user nova-compute[74805]:         <backingStore/>
Nov 15 04:17:20 user nova-compute[74805]:       </backingStore>
Nov 15 04:17:20 user nova-compute[74805]:       <target dev='vda' bus='virtio'/>
Nov 15 04:17:20 user nova-compute[74805]:       <alias name='virtio-disk0'/>
Nov 15 04:17:20 user nova-compute[74805]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 04:17:20 user nova-compute[74805]:     </disk>
Nov 15 04:17:20 user nova-compute[74805]:     <disk type='file' device='cdrom'>
Nov 15 04:17:20 user nova-compute[74805]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 04:17:20 user nova-compute[74805]:       <source file='/opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk.config' index='1'/>
Nov 15 04:17:20 user nova-compute[74805]:       <backingStore/>
Nov 15 04:17:20 user nova-compute[74805]:       <target dev='hda' bus='ide'/>
Nov 15 04:17:20 user nova-compute[74805]:       <readonly/>
Nov 15 04:17:20 user nova-compute[74805]:       <alias name='ide0-0-0'/>
Nov 15 04:17:20 user nova-compute[74805]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 04:17:20 user nova-compute[74805]:     </disk>
Nov 15 04:17:20 user nova-compute[74805]:     <controller type='usb' index='0' model='none'>
Nov 15 04:17:20 user nova-compute[74805]:       <alias name='usb'/>
Nov 15 04:17:20 user nova-compute[74805]:     </controller>
Nov 15 04:17:20 user nova-compute[74805]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 04:17:20 user nova-compute[74805]:       <alias name='pci.0'/>
Nov 15 04:17:20 user nova-compute[74805]:     </controller>
Nov 15 04:17:20 user nova-compute[74805]:     <controller type='ide' index='0'>
Nov 15 04:17:20 user nova-compute[74805]:       <alias name='ide'/>
Nov 15 04:17:20 user nova-compute[74805]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 04:17:20 user nova-compute[74805]:     </controller>
Nov 15 04:17:20 user nova-compute[74805]:     <interface type='ethernet'>
Nov 15 04:17:20 user nova-compute[74805]:       <mac address='fa:16:3e:c4:ea:ce'/>
Nov 15 04:17:20 user nova-compute[74805]:       <target dev='tap51834a6c-a2'/>
Nov 15 04:17:20 user nova-compute[74805]:       <model type='virtio'/>
Nov 15 04:17:20 user nova-compute[74805]:       <mtu size='1442'/>
Nov 15 04:17:20 user nova-compute[74805]:       <alias name='net0'/>
Nov 15 04:17:20 user nova-compute[74805]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 04:17:20 user nova-compute[74805]:     </interface>
Nov 15 04:17:20 user nova-compute[74805]:     <serial type='pty'>
Nov 15 04:17:20 user nova-compute[74805]:       <source path='/dev/pts/6'/>
Nov 15 04:17:20 user nova-compute[74805]:       <log file='/opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/console.log' append='off'/>
Nov 15 04:17:20 user nova-compute[74805]:       <target type='isa-serial' port='0'>
Nov 15 04:17:20 user nova-compute[74805]:         <model name='isa-serial'/>
Nov 15 04:17:20 user nova-compute[74805]:       </target>
Nov 15 04:17:20 user nova-compute[74805]:       <alias name='serial0'/>
Nov 15 04:17:20 user nova-compute[74805]:     </serial>
Nov 15 04:17:20 user nova-compute[74805]:     <console type='pty' tty='/dev/pts/6'>
Nov 15 04:17:20 user nova-compute[74805]:       <source path='/dev/pts/6'/>
Nov 15 04:17:20 user nova-compute[74805]:       <log file='/opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/console.log' append='off'/>
Nov 15 04:17:20 user nova-compute[74805]:       <target type='serial' port='0'/>
Nov 15 04:17:20 user nova-compute[74805]:       <alias name='serial0'/>
Nov 15 04:17:20 user nova-compute[74805]:     </console>
Nov 15 04:17:20 user nova-compute[74805]:     <input type='mouse' bus='ps2'>
Nov 15 04:17:20 user nova-compute[74805]:       <alias name='input0'/>
Nov 15 04:17:20 user nova-compute[74805]:     </input>
Nov 15 04:17:20 user nova-compute[74805]:     <input type='keyboard' bus='ps2'>
Nov 15 04:17:20 user nova-compute[74805]:       <alias name='input1'/>
Nov 15 04:17:20 user nova-compute[74805]:     </input>
Nov 15 04:17:20 user nova-compute[74805]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 15 04:17:20 user nova-compute[74805]:       <listen type='address' address='0.0.0.0'/>
Nov 15 04:17:20 user nova-compute[74805]:     </graphics>
Nov 15 04:17:20 user nova-compute[74805]:     <audio id='1' type='none'/>
Nov 15 04:17:20 user nova-compute[74805]:     <video>
Nov 15 04:17:20 user nova-compute[74805]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 04:17:20 user nova-compute[74805]:       <alias name='video0'/>
Nov 15 04:17:20 user nova-compute[74805]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 04:17:20 user nova-compute[74805]:     </video>
Nov 15 04:17:20 user nova-compute[74805]:     <memballoon model='virtio'>
Nov 15 04:17:20 user nova-compute[74805]:       <stats period='10'/>
Nov 15 04:17:20 user nova-compute[74805]:       <alias name='balloon0'/>
Nov 15 04:17:20 user nova-compute[74805]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 04:17:20 user nova-compute[74805]:     </memballoon>
Nov 15 04:17:20 user nova-compute[74805]:     <rng model='virtio'>
Nov 15 04:17:20 user nova-compute[74805]:       <backend model='random'>/dev/urandom</backend>
Nov 15 04:17:20 user nova-compute[74805]:       <alias name='rng0'/>
Nov 15 04:17:20 user nova-compute[74805]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 04:17:20 user nova-compute[74805]:     </rng>
Nov 15 04:17:20 user nova-compute[74805]:   </devices>
Nov 15 04:17:20 user nova-compute[74805]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 04:17:20 user nova-compute[74805]:     <label>libvirt-05f49324-4b7a-4cd4-ada5-9450b9bf1d70</label>
Nov 15 04:17:20 user nova-compute[74805]:     <imagelabel>libvirt-05f49324-4b7a-4cd4-ada5-9450b9bf1d70</imagelabel>
Nov 15 04:17:20 user nova-compute[74805]:   </seclabel>
Nov 15 04:17:20 user nova-compute[74805]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 04:17:20 user nova-compute[74805]:     <label>+64055:+108</label>
Nov 15 04:17:20 user nova-compute[74805]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 04:17:20 user nova-compute[74805]:   </seclabel>
Nov 15 04:17:20 user nova-compute[74805]: </domain>
Nov 15 04:17:20 user nova-compute[74805]:  {{(pid=74805) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 04:17:20 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Successfully detached device tap594121f1-1d from instance 05f49324-4b7a-4cd4-ada5-9450b9bf1d70 from the live domain config.
Nov 15 04:17:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-175864182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-175864182',id=8,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqVjB/VXeAAXbcPR9EXCBQSbi0fxJNcG8/LYTw94OkTxRdq8BS1Qip4iGD0FJLZzAa8glLWaInjyzM+FwK314PVqp4xOkTB5SsVxL+0dMsk7No3KOKU2UWDKovL9DtDJQ==',key_name='tempest-keypair-792239620',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:14:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5fa2f59063040d9a58de745e87380a6',ramdisk_id='',reservation_id='r-it125hzz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-986558879',owner_user_name='tempest-TaggedAttachmentsTest-986558879-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:14:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6fca23f109447409a8f31b925071ca7',uuid=05f49324-4b7a-4cd4-ada5-9450b9bf1d70,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "594121f1-1d63-4ca4-8818-51d77f20a391", "address": "fa:16:3e:04:e1:3a", "network": {"id": "c5744827-782d-4634-95a0-c795fcab0619", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-167365921", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a5fa2f59063040d9a58de745e87380a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594121f1-1d", "ovs_interfaceid": "594121f1-1d63-4ca4-8818-51d77f20a391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:17:20 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Converting VIF {"id": "594121f1-1d63-4ca4-8818-51d77f20a391", "address": "fa:16:3e:04:e1:3a", "network": {"id": "c5744827-782d-4634-95a0-c795fcab0619", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-167365921", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a5fa2f59063040d9a58de745e87380a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594121f1-1d", "ovs_interfaceid": "594121f1-1d63-4ca4-8818-51d77f20a391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:17:20 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:e1:3a,bridge_name='br-int',has_traffic_filtering=True,id=594121f1-1d63-4ca4-8818-51d77f20a391,network=Network(c5744827-782d-4634-95a0-c795fcab0619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap594121f1-1d') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:17:20 user nova-compute[74805]: DEBUG os_vif [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:e1:3a,bridge_name='br-int',has_traffic_filtering=True,id=594121f1-1d63-4ca4-8818-51d77f20a391,network=Network(c5744827-782d-4634-95a0-c795fcab0619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap594121f1-1d') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:17:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap594121f1-1d, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:17:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3036a06-cba7-4544-a627-ecaaaee98062) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:17:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:20 user nova-compute[74805]: INFO os_vif [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:e1:3a,bridge_name='br-int',has_traffic_filtering=True,id=594121f1-1d63-4ca4-8818-51d77f20a391,network=Network(c5744827-782d-4634-95a0-c795fcab0619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap594121f1-1d')
Nov 15 04:17:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:17:20 user nova-compute[74805]:   <nova:package version="0.0.0"/>
Nov 15 04:17:20 user nova-compute[74805]:   <nova:name>tempest-device-tagging-server-175864182</nova:name>
Nov 15 04:17:20 user nova-compute[74805]:   <nova:creationTime>2023-11-15 04:17:20</nova:creationTime>
Nov 15 04:17:20 user nova-compute[74805]:   <nova:flavor name="m1.tiny">
Nov 15 04:17:20 user nova-compute[74805]:     <nova:memory>512</nova:memory>
Nov 15 04:17:20 user nova-compute[74805]:     <nova:disk>1</nova:disk>
Nov 15 04:17:20 user nova-compute[74805]:     <nova:swap>0</nova:swap>
Nov 15 04:17:20 user nova-compute[74805]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:17:20 user nova-compute[74805]:     <nova:vcpus>1</nova:vcpus>
Nov 15 04:17:20 user nova-compute[74805]:   </nova:flavor>
Nov 15 04:17:20 user nova-compute[74805]:   <nova:owner>
Nov 15 04:17:20 user nova-compute[74805]:     <nova:user uuid="e6fca23f109447409a8f31b925071ca7">tempest-TaggedAttachmentsTest-986558879-project-member</nova:user>
Nov 15 04:17:20 user nova-compute[74805]:     <nova:project uuid="a5fa2f59063040d9a58de745e87380a6">tempest-TaggedAttachmentsTest-986558879</nova:project>
Nov 15 04:17:20 user nova-compute[74805]:   </nova:owner>
Nov 15 04:17:20 user nova-compute[74805]:   <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:17:20 user nova-compute[74805]:   <nova:ports>
Nov 15 04:17:20 user nova-compute[74805]:     <nova:port uuid="51834a6c-a2bb-4135-b3b3-beb4e689e876">
Nov 15 04:17:20 user nova-compute[74805]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 04:17:20 user nova-compute[74805]:     </nova:port>
Nov 15 04:17:20 user nova-compute[74805]:   </nova:ports>
Nov 15 04:17:20 user nova-compute[74805]: </nova:instance>
Nov 15 04:17:20 user nova-compute[74805]:  {{(pid=74805) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG nova.compute.manager [req-7fcb2a28-a46c-4cc5-a220-abf9cb165ba9 req-2c0e3bd2-9ec2-4d1f-9392-027c1c6171e8 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Received event network-vif-deleted-594121f1-1d63-4ca4-8818-51d77f20a391 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:21 user nova-compute[74805]: INFO nova.compute.manager [req-7fcb2a28-a46c-4cc5-a220-abf9cb165ba9 req-2c0e3bd2-9ec2-4d1f-9392-027c1c6171e8 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Neutron deleted interface 594121f1-1d63-4ca4-8818-51d77f20a391; detaching it from the instance and deleting it from the info cache
Nov 15 04:17:21 user nova-compute[74805]: DEBUG nova.network.neutron [req-7fcb2a28-a46c-4cc5-a220-abf9cb165ba9 req-2c0e3bd2-9ec2-4d1f-9392-027c1c6171e8 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Updating instance_info_cache with network_info: [{"id": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "address": "fa:16:3e:c4:ea:ce", "network": {"id": "faafe4eb-0b41-4c3a-bce5-3d65543bc634", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-431209234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5fa2f59063040d9a58de745e87380a6", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51834a6c-a2", "ovs_interfaceid": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Acquiring lock "refresh_cache-05f49324-4b7a-4cd4-ada5-9450b9bf1d70" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Acquired lock "refresh_cache-05f49324-4b7a-4cd4-ada5-9450b9bf1d70" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG nova.objects.instance [req-7fcb2a28-a46c-4cc5-a220-abf9cb165ba9 req-2c0e3bd2-9ec2-4d1f-9392-027c1c6171e8 service nova] Lazy-loading 'system_metadata' on Instance uuid 05f49324-4b7a-4cd4-ada5-9450b9bf1d70 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG nova.objects.instance [req-7fcb2a28-a46c-4cc5-a220-abf9cb165ba9 req-2c0e3bd2-9ec2-4d1f-9392-027c1c6171e8 service nova] Lazy-loading 'flavor' on Instance uuid 05f49324-4b7a-4cd4-ada5-9450b9bf1d70 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG nova.objects.base [req-7fcb2a28-a46c-4cc5-a220-abf9cb165ba9 req-2c0e3bd2-9ec2-4d1f-9392-027c1c6171e8 service nova] Object Instance<05f49324-4b7a-4cd4-ada5-9450b9bf1d70> lazy-loaded attributes: system_metadata,flavor {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [req-7fcb2a28-a46c-4cc5-a220-abf9cb165ba9 req-2c0e3bd2-9ec2-4d1f-9392-027c1c6171e8 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-175864182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-175864182',id=8,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqVjB/VXeAAXbcPR9EXCBQSbi0fxJNcG8/LYTw94OkTxRdq8BS1Qip4iGD0FJLZzAa8glLWaInjyzM+FwK314PVqp4xOkTB5SsVxL+0dMsk7No3KOKU2UWDKovL9DtDJQ==',key_name='tempest-keypair-792239620',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:14:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5fa2f59063040d9a58de745e87380a6',ramdisk_id='',reservation_id='r-it125hzz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-986558879',owner_user_name='tempest-TaggedAttachmentsTest-986558879-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:14:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6fca23f109447409a8f31b925071ca7',uuid=05f49324-4b7a-4cd4-ada5-9450b9bf1d70,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "594121f1-1d63-4ca4-8818-51d77f20a391", "address": "fa:16:3e:04:e1:3a", "network": {"id": "c5744827-782d-4634-95a0-c795fcab0619", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-167365921", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a5fa2f59063040d9a58de745e87380a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594121f1-1d", "ovs_interfaceid": "594121f1-1d63-4ca4-8818-51d77f20a391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG nova.network.os_vif_util [req-7fcb2a28-a46c-4cc5-a220-abf9cb165ba9 req-2c0e3bd2-9ec2-4d1f-9392-027c1c6171e8 service nova] Converting VIF {"id": "594121f1-1d63-4ca4-8818-51d77f20a391", "address": "fa:16:3e:04:e1:3a", "network": {"id": "c5744827-782d-4634-95a0-c795fcab0619", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-167365921", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a5fa2f59063040d9a58de745e87380a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594121f1-1d", "ovs_interfaceid": "594121f1-1d63-4ca4-8818-51d77f20a391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG nova.network.os_vif_util [req-7fcb2a28-a46c-4cc5-a220-abf9cb165ba9 req-2c0e3bd2-9ec2-4d1f-9392-027c1c6171e8 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:e1:3a,bridge_name='br-int',has_traffic_filtering=True,id=594121f1-1d63-4ca4-8818-51d77f20a391,network=Network(c5744827-782d-4634-95a0-c795fcab0619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap594121f1-1d') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [req-7fcb2a28-a46c-4cc5-a220-abf9cb165ba9 req-2c0e3bd2-9ec2-4d1f-9392-027c1c6171e8 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:04:e1:3a"/><model type="virtio"/><mtu size="1442"/><target dev="tap594121f1-1d"/></interface> {{(pid=74805) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [req-7fcb2a28-a46c-4cc5-a220-abf9cb165ba9 req-2c0e3bd2-9ec2-4d1f-9392-027c1c6171e8 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:04:e1:3a"/><model type="virtio"/><mtu size="1442"/><target dev="tap594121f1-1d"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 15 04:17:21 user nova-compute[74805]:   <name>instance-00000008</name>
Nov 15 04:17:21 user nova-compute[74805]:   <uuid>05f49324-4b7a-4cd4-ada5-9450b9bf1d70</uuid>
Nov 15 04:17:21 user nova-compute[74805]:   <metadata>
Nov 15 04:17:21 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:17:21 user nova-compute[74805]:   <nova:package version="0.0.0"/>
Nov 15 04:17:21 user nova-compute[74805]:   <nova:name>tempest-device-tagging-server-175864182</nova:name>
Nov 15 04:17:21 user nova-compute[74805]:   <nova:creationTime>2023-11-15 04:17:20</nova:creationTime>
Nov 15 04:17:21 user nova-compute[74805]:   <nova:flavor name="m1.tiny">
Nov 15 04:17:21 user nova-compute[74805]:     <nova:memory>512</nova:memory>
Nov 15 04:17:21 user nova-compute[74805]:     <nova:disk>1</nova:disk>
Nov 15 04:17:21 user nova-compute[74805]:     <nova:swap>0</nova:swap>
Nov 15 04:17:21 user nova-compute[74805]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:17:21 user nova-compute[74805]:     <nova:vcpus>1</nova:vcpus>
Nov 15 04:17:21 user nova-compute[74805]:   </nova:flavor>
Nov 15 04:17:21 user nova-compute[74805]:   <nova:owner>
Nov 15 04:17:21 user nova-compute[74805]:     <nova:user uuid="e6fca23f109447409a8f31b925071ca7">tempest-TaggedAttachmentsTest-986558879-project-member</nova:user>
Nov 15 04:17:21 user nova-compute[74805]:     <nova:project uuid="a5fa2f59063040d9a58de745e87380a6">tempest-TaggedAttachmentsTest-986558879</nova:project>
Nov 15 04:17:21 user nova-compute[74805]:   </nova:owner>
Nov 15 04:17:21 user nova-compute[74805]:   <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:17:21 user nova-compute[74805]:   <nova:ports>
Nov 15 04:17:21 user nova-compute[74805]:     <nova:port uuid="51834a6c-a2bb-4135-b3b3-beb4e689e876">
Nov 15 04:17:21 user nova-compute[74805]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 04:17:21 user nova-compute[74805]:     </nova:port>
Nov 15 04:17:21 user nova-compute[74805]:   </nova:ports>
Nov 15 04:17:21 user nova-compute[74805]: </nova:instance>
Nov 15 04:17:21 user nova-compute[74805]:   </metadata>
Nov 15 04:17:21 user nova-compute[74805]:   <memory unit='KiB'>524288</memory>
Nov 15 04:17:21 user nova-compute[74805]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 04:17:21 user nova-compute[74805]:   <vcpu placement='static'>1</vcpu>
Nov 15 04:17:21 user nova-compute[74805]:   <resource>
Nov 15 04:17:21 user nova-compute[74805]:     <partition>/machine</partition>
Nov 15 04:17:21 user nova-compute[74805]:   </resource>
Nov 15 04:17:21 user nova-compute[74805]:   <sysinfo type='smbios'>
Nov 15 04:17:21 user nova-compute[74805]:     <system>
Nov 15 04:17:21 user nova-compute[74805]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 04:17:21 user nova-compute[74805]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 04:17:21 user nova-compute[74805]:       <entry name='version'>0.0.0</entry>
Nov 15 04:17:21 user nova-compute[74805]:       <entry name='serial'>05f49324-4b7a-4cd4-ada5-9450b9bf1d70</entry>
Nov 15 04:17:21 user nova-compute[74805]:       <entry name='uuid'>05f49324-4b7a-4cd4-ada5-9450b9bf1d70</entry>
Nov 15 04:17:21 user nova-compute[74805]:       <entry name='family'>Virtual Machine</entry>
Nov 15 04:17:21 user nova-compute[74805]:     </system>
Nov 15 04:17:21 user nova-compute[74805]:   </sysinfo>
Nov 15 04:17:21 user nova-compute[74805]:   <os>
Nov 15 04:17:21 user nova-compute[74805]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 04:17:21 user nova-compute[74805]:     <boot dev='hd'/>
Nov 15 04:17:21 user nova-compute[74805]:     <smbios mode='sysinfo'/>
Nov 15 04:17:21 user nova-compute[74805]:   </os>
Nov 15 04:17:21 user nova-compute[74805]:   <features>
Nov 15 04:17:21 user nova-compute[74805]:     <acpi/>
Nov 15 04:17:21 user nova-compute[74805]:     <apic/>
Nov 15 04:17:21 user nova-compute[74805]:     <vmcoreinfo state='on'/>
Nov 15 04:17:21 user nova-compute[74805]:   </features>
Nov 15 04:17:21 user nova-compute[74805]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 04:17:21 user nova-compute[74805]:     <model fallback='forbid'>Nehalem</model>
Nov 15 04:17:21 user nova-compute[74805]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 04:17:21 user nova-compute[74805]:     <feature policy='require' name='vme'/>
Nov 15 04:17:21 user nova-compute[74805]:     <feature policy='require' name='x2apic'/>
Nov 15 04:17:21 user nova-compute[74805]:     <feature policy='require' name='hypervisor'/>
Nov 15 04:17:21 user nova-compute[74805]:   </cpu>
Nov 15 04:17:21 user nova-compute[74805]:   <clock offset='utc'>
Nov 15 04:17:21 user nova-compute[74805]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 04:17:21 user nova-compute[74805]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 04:17:21 user nova-compute[74805]:     <timer name='hpet' present='no'/>
Nov 15 04:17:21 user nova-compute[74805]:   </clock>
Nov 15 04:17:21 user nova-compute[74805]:   <on_poweroff>destroy</on_poweroff>
Nov 15 04:17:21 user nova-compute[74805]:   <on_reboot>restart</on_reboot>
Nov 15 04:17:21 user nova-compute[74805]:   <on_crash>destroy</on_crash>
Nov 15 04:17:21 user nova-compute[74805]:   <devices>
Nov 15 04:17:21 user nova-compute[74805]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 04:17:21 user nova-compute[74805]:     <disk type='file' device='disk'>
Nov 15 04:17:21 user nova-compute[74805]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 04:17:21 user nova-compute[74805]:       <source file='/opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk' index='2'/>
Nov 15 04:17:21 user nova-compute[74805]:       <backingStore type='file' index='3'>
Nov 15 04:17:21 user nova-compute[74805]:         <format type='raw'/>
Nov 15 04:17:21 user nova-compute[74805]:         <source file='/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9'/>
Nov 15 04:17:21 user nova-compute[74805]:         <backingStore/>
Nov 15 04:17:21 user nova-compute[74805]:       </backingStore>
Nov 15 04:17:21 user nova-compute[74805]:       <target dev='vda' bus='virtio'/>
Nov 15 04:17:21 user nova-compute[74805]:       <alias name='virtio-disk0'/>
Nov 15 04:17:21 user nova-compute[74805]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 04:17:21 user nova-compute[74805]:     </disk>
Nov 15 04:17:21 user nova-compute[74805]:     <disk type='file' device='cdrom'>
Nov 15 04:17:21 user nova-compute[74805]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 04:17:21 user nova-compute[74805]:       <source file='/opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk.config' index='1'/>
Nov 15 04:17:21 user nova-compute[74805]:       <backingStore/>
Nov 15 04:17:21 user nova-compute[74805]:       <target dev='hda' bus='ide'/>
Nov 15 04:17:21 user nova-compute[74805]:       <readonly/>
Nov 15 04:17:21 user nova-compute[74805]:       <alias name='ide0-0-0'/>
Nov 15 04:17:21 user nova-compute[74805]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 04:17:21 user nova-compute[74805]:     </disk>
Nov 15 04:17:21 user nova-compute[74805]:     <controller type='usb' index='0' model='none'>
Nov 15 04:17:21 user nova-compute[74805]:       <alias name='usb'/>
Nov 15 04:17:21 user nova-compute[74805]:     </controller>
Nov 15 04:17:21 user nova-compute[74805]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 04:17:21 user nova-compute[74805]:       <alias name='pci.0'/>
Nov 15 04:17:21 user nova-compute[74805]:     </controller>
Nov 15 04:17:21 user nova-compute[74805]:     <controller type='ide' index='0'>
Nov 15 04:17:21 user nova-compute[74805]:       <alias name='ide'/>
Nov 15 04:17:21 user nova-compute[74805]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 04:17:21 user nova-compute[74805]:     </controller>
Nov 15 04:17:21 user nova-compute[74805]:     <interface type='ethernet'>
Nov 15 04:17:21 user nova-compute[74805]:       <mac address='fa:16:3e:c4:ea:ce'/>
Nov 15 04:17:21 user nova-compute[74805]:       <target dev='tap51834a6c-a2'/>
Nov 15 04:17:21 user nova-compute[74805]:       <model type='virtio'/>
Nov 15 04:17:21 user nova-compute[74805]:       <mtu size='1442'/>
Nov 15 04:17:21 user nova-compute[74805]:       <alias name='net0'/>
Nov 15 04:17:21 user nova-compute[74805]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 04:17:21 user nova-compute[74805]:     </interface>
Nov 15 04:17:21 user nova-compute[74805]:     <serial type='pty'>
Nov 15 04:17:21 user nova-compute[74805]:       <source path='/dev/pts/6'/>
Nov 15 04:17:21 user nova-compute[74805]:       <log file='/opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/console.log' append='off'/>
Nov 15 04:17:21 user nova-compute[74805]:       <target type='isa-serial' port='0'>
Nov 15 04:17:21 user nova-compute[74805]:         <model name='isa-serial'/>
Nov 15 04:17:21 user nova-compute[74805]:       </target>
Nov 15 04:17:21 user nova-compute[74805]:       <alias name='serial0'/>
Nov 15 04:17:21 user nova-compute[74805]:     </serial>
Nov 15 04:17:21 user nova-compute[74805]:     <console type='pty' tty='/dev/pts/6'>
Nov 15 04:17:21 user nova-compute[74805]:       <source path='/dev/pts/6'/>
Nov 15 04:17:21 user nova-compute[74805]:       <log file='/opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/console.log' append='off'/>
Nov 15 04:17:21 user nova-compute[74805]:       <target type='serial' port='0'/>
Nov 15 04:17:21 user nova-compute[74805]:       <alias name='serial0'/>
Nov 15 04:17:21 user nova-compute[74805]:     </console>
Nov 15 04:17:21 user nova-compute[74805]:     <input type='mouse' bus='ps2'>
Nov 15 04:17:21 user nova-compute[74805]:       <alias name='input0'/>
Nov 15 04:17:21 user nova-compute[74805]:     </input>
Nov 15 04:17:21 user nova-compute[74805]:     <input type='keyboard' bus='ps2'>
Nov 15 04:17:21 user nova-compute[74805]:       <alias name='input1'/>
Nov 15 04:17:21 user nova-compute[74805]:     </input>
Nov 15 04:17:21 user nova-compute[74805]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 15 04:17:21 user nova-compute[74805]:       <listen type='address' address='0.0.0.0'/>
Nov 15 04:17:21 user nova-compute[74805]:     </graphics>
Nov 15 04:17:21 user nova-compute[74805]:     <audio id='1' type='none'/>
Nov 15 04:17:21 user nova-compute[74805]:     <video>
Nov 15 04:17:21 user nova-compute[74805]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 04:17:21 user nova-compute[74805]:       <alias name='video0'/>
Nov 15 04:17:21 user nova-compute[74805]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 04:17:21 user nova-compute[74805]:     </video>
Nov 15 04:17:21 user nova-compute[74805]:     <memballoon model='virtio'>
Nov 15 04:17:21 user nova-compute[74805]:       <stats period='10'/>
Nov 15 04:17:21 user nova-compute[74805]:       <alias name='balloon0'/>
Nov 15 04:17:21 user nova-compute[74805]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 04:17:21 user nova-compute[74805]:     </memballoon>
Nov 15 04:17:21 user nova-compute[74805]:     <rng model='virtio'>
Nov 15 04:17:21 user nova-compute[74805]:       <backend model='random'>/dev/urandom</backend>
Nov 15 04:17:21 user nova-compute[74805]:       <alias name='rng0'/>
Nov 15 04:17:21 user nova-compute[74805]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 04:17:21 user nova-compute[74805]:     </rng>
Nov 15 04:17:21 user nova-compute[74805]:   </devices>
Nov 15 04:17:21 user nova-compute[74805]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 04:17:21 user nova-compute[74805]:     <label>libvirt-05f49324-4b7a-4cd4-ada5-9450b9bf1d70</label>
Nov 15 04:17:21 user nova-compute[74805]:     <imagelabel>libvirt-05f49324-4b7a-4cd4-ada5-9450b9bf1d70</imagelabel>
Nov 15 04:17:21 user nova-compute[74805]:   </seclabel>
Nov 15 04:17:21 user nova-compute[74805]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 04:17:21 user nova-compute[74805]:     <label>+64055:+108</label>
Nov 15 04:17:21 user nova-compute[74805]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 04:17:21 user nova-compute[74805]:   </seclabel>
Nov 15 04:17:21 user nova-compute[74805]: </domain>
Nov 15 04:17:21 user nova-compute[74805]:  {{(pid=74805) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [req-7fcb2a28-a46c-4cc5-a220-abf9cb165ba9 req-2c0e3bd2-9ec2-4d1f-9392-027c1c6171e8 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:04:e1:3a"/><model type="virtio"/><mtu size="1442"/><target dev="tap594121f1-1d"/></interface> {{(pid=74805) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [req-7fcb2a28-a46c-4cc5-a220-abf9cb165ba9 req-2c0e3bd2-9ec2-4d1f-9392-027c1c6171e8 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:04:e1:3a"/><model type="virtio"/><mtu size="1442"/><target dev="tap594121f1-1d"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 15 04:17:21 user nova-compute[74805]:   <name>instance-00000008</name>
Nov 15 04:17:21 user nova-compute[74805]:   <uuid>05f49324-4b7a-4cd4-ada5-9450b9bf1d70</uuid>
Nov 15 04:17:21 user nova-compute[74805]:   <metadata>
Nov 15 04:17:21 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:17:21 user nova-compute[74805]:   <nova:package version="0.0.0"/>
Nov 15 04:17:21 user nova-compute[74805]:   <nova:name>tempest-device-tagging-server-175864182</nova:name>
Nov 15 04:17:21 user nova-compute[74805]:   <nova:creationTime>2023-11-15 04:17:20</nova:creationTime>
Nov 15 04:17:21 user nova-compute[74805]:   <nova:flavor name="m1.tiny">
Nov 15 04:17:21 user nova-compute[74805]:     <nova:memory>512</nova:memory>
Nov 15 04:17:21 user nova-compute[74805]:     <nova:disk>1</nova:disk>
Nov 15 04:17:21 user nova-compute[74805]:     <nova:swap>0</nova:swap>
Nov 15 04:17:21 user nova-compute[74805]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:17:21 user nova-compute[74805]:     <nova:vcpus>1</nova:vcpus>
Nov 15 04:17:21 user nova-compute[74805]:   </nova:flavor>
Nov 15 04:17:21 user nova-compute[74805]:   <nova:owner>
Nov 15 04:17:21 user nova-compute[74805]:     <nova:user uuid="e6fca23f109447409a8f31b925071ca7">tempest-TaggedAttachmentsTest-986558879-project-member</nova:user>
Nov 15 04:17:21 user nova-compute[74805]:     <nova:project uuid="a5fa2f59063040d9a58de745e87380a6">tempest-TaggedAttachmentsTest-986558879</nova:project>
Nov 15 04:17:21 user nova-compute[74805]:   </nova:owner>
Nov 15 04:17:21 user nova-compute[74805]:   <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:17:21 user nova-compute[74805]:   <nova:ports>
Nov 15 04:17:21 user nova-compute[74805]:     <nova:port uuid="51834a6c-a2bb-4135-b3b3-beb4e689e876">
Nov 15 04:17:21 user nova-compute[74805]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 04:17:21 user nova-compute[74805]:     </nova:port>
Nov 15 04:17:21 user nova-compute[74805]:   </nova:ports>
Nov 15 04:17:21 user nova-compute[74805]: </nova:instance>
Nov 15 04:17:21 user nova-compute[74805]:   </metadata>
Nov 15 04:17:21 user nova-compute[74805]:   <memory unit='KiB'>524288</memory>
Nov 15 04:17:21 user nova-compute[74805]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 04:17:21 user nova-compute[74805]:   <vcpu placement='static'>1</vcpu>
Nov 15 04:17:21 user nova-compute[74805]:   <resource>
Nov 15 04:17:21 user nova-compute[74805]:     <partition>/machine</partition>
Nov 15 04:17:21 user nova-compute[74805]:   </resource>
Nov 15 04:17:21 user nova-compute[74805]:   <sysinfo type='smbios'>
Nov 15 04:17:21 user nova-compute[74805]:     <system>
Nov 15 04:17:21 user nova-compute[74805]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 04:17:21 user nova-compute[74805]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 04:17:21 user nova-compute[74805]:       <entry name='version'>0.0.0</entry>
Nov 15 04:17:21 user nova-compute[74805]:       <entry name='serial'>05f49324-4b7a-4cd4-ada5-9450b9bf1d70</entry>
Nov 15 04:17:21 user nova-compute[74805]:       <entry name='uuid'>05f49324-4b7a-4cd4-ada5-9450b9bf1d70</entry>
Nov 15 04:17:21 user nova-compute[74805]:       <entry name='family'>Virtual Machine</entry>
Nov 15 04:17:21 user nova-compute[74805]:     </system>
Nov 15 04:17:21 user nova-compute[74805]:   </sysinfo>
Nov 15 04:17:21 user nova-compute[74805]:   <os>
Nov 15 04:17:21 user nova-compute[74805]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 04:17:21 user nova-compute[74805]:     <boot dev='hd'/>
Nov 15 04:17:21 user nova-compute[74805]:     <smbios mode='sysinfo'/>
Nov 15 04:17:21 user nova-compute[74805]:   </os>
Nov 15 04:17:21 user nova-compute[74805]:   <features>
Nov 15 04:17:21 user nova-compute[74805]:     <acpi/>
Nov 15 04:17:21 user nova-compute[74805]:     <apic/>
Nov 15 04:17:21 user nova-compute[74805]:     <vmcoreinfo state='on'/>
Nov 15 04:17:21 user nova-compute[74805]:   </features>
Nov 15 04:17:21 user nova-compute[74805]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 04:17:21 user nova-compute[74805]:     <model fallback='forbid'>Nehalem</model>
Nov 15 04:17:21 user nova-compute[74805]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 04:17:21 user nova-compute[74805]:     <feature policy='require' name='vme'/>
Nov 15 04:17:21 user nova-compute[74805]:     <feature policy='require' name='x2apic'/>
Nov 15 04:17:21 user nova-compute[74805]:     <feature policy='require' name='hypervisor'/>
Nov 15 04:17:21 user nova-compute[74805]:   </cpu>
Nov 15 04:17:21 user nova-compute[74805]:   <clock offset='utc'>
Nov 15 04:17:21 user nova-compute[74805]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 04:17:21 user nova-compute[74805]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 04:17:21 user nova-compute[74805]:     <timer name='hpet' present='no'/>
Nov 15 04:17:21 user nova-compute[74805]:   </clock>
Nov 15 04:17:21 user nova-compute[74805]:   <on_poweroff>destroy</on_poweroff>
Nov 15 04:17:21 user nova-compute[74805]:   <on_reboot>restart</on_reboot>
Nov 15 04:17:21 user nova-compute[74805]:   <on_crash>destroy</on_crash>
Nov 15 04:17:21 user nova-compute[74805]:   <devices>
Nov 15 04:17:21 user nova-compute[74805]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 04:17:21 user nova-compute[74805]:     <disk type='file' device='disk'>
Nov 15 04:17:21 user nova-compute[74805]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 04:17:21 user nova-compute[74805]:       <source file='/opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk' index='2'/>
Nov 15 04:17:21 user nova-compute[74805]:       <backingStore type='file' index='3'>
Nov 15 04:17:21 user nova-compute[74805]:         <format type='raw'/>
Nov 15 04:17:21 user nova-compute[74805]:         <source file='/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9'/>
Nov 15 04:17:21 user nova-compute[74805]:         <backingStore/>
Nov 15 04:17:21 user nova-compute[74805]:       </backingStore>
Nov 15 04:17:21 user nova-compute[74805]:       <target dev='vda' bus='virtio'/>
Nov 15 04:17:21 user nova-compute[74805]:       <alias name='virtio-disk0'/>
Nov 15 04:17:21 user nova-compute[74805]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 04:17:21 user nova-compute[74805]:     </disk>
Nov 15 04:17:21 user nova-compute[74805]:     <disk type='file' device='cdrom'>
Nov 15 04:17:21 user nova-compute[74805]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 04:17:21 user nova-compute[74805]:       <source file='/opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/disk.config' index='1'/>
Nov 15 04:17:21 user nova-compute[74805]:       <backingStore/>
Nov 15 04:17:21 user nova-compute[74805]:       <target dev='hda' bus='ide'/>
Nov 15 04:17:21 user nova-compute[74805]:       <readonly/>
Nov 15 04:17:21 user nova-compute[74805]:       <alias name='ide0-0-0'/>
Nov 15 04:17:21 user nova-compute[74805]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 04:17:21 user nova-compute[74805]:     </disk>
Nov 15 04:17:21 user nova-compute[74805]:     <controller type='usb' index='0' model='none'>
Nov 15 04:17:21 user nova-compute[74805]:       <alias name='usb'/>
Nov 15 04:17:21 user nova-compute[74805]:     </controller>
Nov 15 04:17:21 user nova-compute[74805]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 04:17:21 user nova-compute[74805]:       <alias name='pci.0'/>
Nov 15 04:17:21 user nova-compute[74805]:     </controller>
Nov 15 04:17:21 user nova-compute[74805]:     <controller type='ide' index='0'>
Nov 15 04:17:21 user nova-compute[74805]:       <alias name='ide'/>
Nov 15 04:17:21 user nova-compute[74805]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 04:17:21 user nova-compute[74805]:     </controller>
Nov 15 04:17:21 user nova-compute[74805]:     <interface type='ethernet'>
Nov 15 04:17:21 user nova-compute[74805]:       <mac address='fa:16:3e:c4:ea:ce'/>
Nov 15 04:17:21 user nova-compute[74805]:       <target dev='tap51834a6c-a2'/>
Nov 15 04:17:21 user nova-compute[74805]:       <model type='virtio'/>
Nov 15 04:17:21 user nova-compute[74805]:       <mtu size='1442'/>
Nov 15 04:17:21 user nova-compute[74805]:       <alias name='net0'/>
Nov 15 04:17:21 user nova-compute[74805]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 04:17:21 user nova-compute[74805]:     </interface>
Nov 15 04:17:21 user nova-compute[74805]:     <serial type='pty'>
Nov 15 04:17:21 user nova-compute[74805]:       <source path='/dev/pts/6'/>
Nov 15 04:17:21 user nova-compute[74805]:       <log file='/opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/console.log' append='off'/>
Nov 15 04:17:21 user nova-compute[74805]:       <target type='isa-serial' port='0'>
Nov 15 04:17:21 user nova-compute[74805]:         <model name='isa-serial'/>
Nov 15 04:17:21 user nova-compute[74805]:       </target>
Nov 15 04:17:21 user nova-compute[74805]:       <alias name='serial0'/>
Nov 15 04:17:21 user nova-compute[74805]:     </serial>
Nov 15 04:17:21 user nova-compute[74805]:     <console type='pty' tty='/dev/pts/6'>
Nov 15 04:17:21 user nova-compute[74805]:       <source path='/dev/pts/6'/>
Nov 15 04:17:21 user nova-compute[74805]:       <log file='/opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70/console.log' append='off'/>
Nov 15 04:17:21 user nova-compute[74805]:       <target type='serial' port='0'/>
Nov 15 04:17:21 user nova-compute[74805]:       <alias name='serial0'/>
Nov 15 04:17:21 user nova-compute[74805]:     </console>
Nov 15 04:17:21 user nova-compute[74805]:     <input type='mouse' bus='ps2'>
Nov 15 04:17:21 user nova-compute[74805]:       <alias name='input0'/>
Nov 15 04:17:21 user nova-compute[74805]:     </input>
Nov 15 04:17:21 user nova-compute[74805]:     <input type='keyboard' bus='ps2'>
Nov 15 04:17:21 user nova-compute[74805]:       <alias name='input1'/>
Nov 15 04:17:21 user nova-compute[74805]:     </input>
Nov 15 04:17:21 user nova-compute[74805]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 15 04:17:21 user nova-compute[74805]:       <listen type='address' address='0.0.0.0'/>
Nov 15 04:17:21 user nova-compute[74805]:     </graphics>
Nov 15 04:17:21 user nova-compute[74805]:     <audio id='1' type='none'/>
Nov 15 04:17:21 user nova-compute[74805]:     <video>
Nov 15 04:17:21 user nova-compute[74805]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 04:17:21 user nova-compute[74805]:       <alias name='video0'/>
Nov 15 04:17:21 user nova-compute[74805]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 04:17:21 user nova-compute[74805]:     </video>
Nov 15 04:17:21 user nova-compute[74805]:     <memballoon model='virtio'>
Nov 15 04:17:21 user nova-compute[74805]:       <stats period='10'/>
Nov 15 04:17:21 user nova-compute[74805]:       <alias name='balloon0'/>
Nov 15 04:17:21 user nova-compute[74805]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 04:17:21 user nova-compute[74805]:     </memballoon>
Nov 15 04:17:21 user nova-compute[74805]:     <rng model='virtio'>
Nov 15 04:17:21 user nova-compute[74805]:       <backend model='random'>/dev/urandom</backend>
Nov 15 04:17:21 user nova-compute[74805]:       <alias name='rng0'/>
Nov 15 04:17:21 user nova-compute[74805]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 04:17:21 user nova-compute[74805]:     </rng>
Nov 15 04:17:21 user nova-compute[74805]:   </devices>
Nov 15 04:17:21 user nova-compute[74805]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 04:17:21 user nova-compute[74805]:     <label>libvirt-05f49324-4b7a-4cd4-ada5-9450b9bf1d70</label>
Nov 15 04:17:21 user nova-compute[74805]:     <imagelabel>libvirt-05f49324-4b7a-4cd4-ada5-9450b9bf1d70</imagelabel>
Nov 15 04:17:21 user nova-compute[74805]:   </seclabel>
Nov 15 04:17:21 user nova-compute[74805]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 04:17:21 user nova-compute[74805]:     <label>+64055:+108</label>
Nov 15 04:17:21 user nova-compute[74805]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 04:17:21 user nova-compute[74805]:   </seclabel>
Nov 15 04:17:21 user nova-compute[74805]: </domain>
Nov 15 04:17:21 user nova-compute[74805]:  {{(pid=74805) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 04:17:21 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [req-7fcb2a28-a46c-4cc5-a220-abf9cb165ba9 req-2c0e3bd2-9ec2-4d1f-9392-027c1c6171e8 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Detaching interface fa:16:3e:04:e1:3a failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap594121f1-1d' not found.
Nov 15 04:17:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [req-7fcb2a28-a46c-4cc5-a220-abf9cb165ba9 req-2c0e3bd2-9ec2-4d1f-9392-027c1c6171e8 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-175864182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-175864182',id=8,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqVjB/VXeAAXbcPR9EXCBQSbi0fxJNcG8/LYTw94OkTxRdq8BS1Qip4iGD0FJLZzAa8glLWaInjyzM+FwK314PVqp4xOkTB5SsVxL+0dMsk7No3KOKU2UWDKovL9DtDJQ==',key_name='tempest-keypair-792239620',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:14:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5fa2f59063040d9a58de745e87380a6',ramdisk_id='',reservation_id='r-it125hzz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-986558879',owner_user_name='tempest-TaggedAttachmentsTest-986558879-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:14:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6fca23f109447409a8f31b925071ca7',uuid=05f49324-4b7a-4cd4-ada5-9450b9bf1d70,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "594121f1-1d63-4ca4-8818-51d77f20a391", "address": "fa:16:3e:04:e1:3a", "network": {"id": "c5744827-782d-4634-95a0-c795fcab0619", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-167365921", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a5fa2f59063040d9a58de745e87380a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594121f1-1d", "ovs_interfaceid": "594121f1-1d63-4ca4-8818-51d77f20a391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG nova.network.os_vif_util [req-7fcb2a28-a46c-4cc5-a220-abf9cb165ba9 req-2c0e3bd2-9ec2-4d1f-9392-027c1c6171e8 service nova] Converting VIF {"id": "594121f1-1d63-4ca4-8818-51d77f20a391", "address": "fa:16:3e:04:e1:3a", "network": {"id": "c5744827-782d-4634-95a0-c795fcab0619", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-167365921", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a5fa2f59063040d9a58de745e87380a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594121f1-1d", "ovs_interfaceid": "594121f1-1d63-4ca4-8818-51d77f20a391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG nova.network.os_vif_util [req-7fcb2a28-a46c-4cc5-a220-abf9cb165ba9 req-2c0e3bd2-9ec2-4d1f-9392-027c1c6171e8 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:e1:3a,bridge_name='br-int',has_traffic_filtering=True,id=594121f1-1d63-4ca4-8818-51d77f20a391,network=Network(c5744827-782d-4634-95a0-c795fcab0619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap594121f1-1d') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG os_vif [req-7fcb2a28-a46c-4cc5-a220-abf9cb165ba9 req-2c0e3bd2-9ec2-4d1f-9392-027c1c6171e8 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:e1:3a,bridge_name='br-int',has_traffic_filtering=True,id=594121f1-1d63-4ca4-8818-51d77f20a391,network=Network(c5744827-782d-4634-95a0-c795fcab0619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap594121f1-1d') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap594121f1-1d, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:17:21 user nova-compute[74805]: INFO os_vif [req-7fcb2a28-a46c-4cc5-a220-abf9cb165ba9 req-2c0e3bd2-9ec2-4d1f-9392-027c1c6171e8 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:e1:3a,bridge_name='br-int',has_traffic_filtering=True,id=594121f1-1d63-4ca4-8818-51d77f20a391,network=Network(c5744827-782d-4634-95a0-c795fcab0619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap594121f1-1d')
Nov 15 04:17:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [req-7fcb2a28-a46c-4cc5-a220-abf9cb165ba9 req-2c0e3bd2-9ec2-4d1f-9392-027c1c6171e8 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:17:21 user nova-compute[74805]:   <nova:package version="0.0.0"/>
Nov 15 04:17:21 user nova-compute[74805]:   <nova:name>tempest-device-tagging-server-175864182</nova:name>
Nov 15 04:17:21 user nova-compute[74805]:   <nova:creationTime>2023-11-15 04:17:21</nova:creationTime>
Nov 15 04:17:21 user nova-compute[74805]:   <nova:flavor name="m1.tiny">
Nov 15 04:17:21 user nova-compute[74805]:     <nova:memory>512</nova:memory>
Nov 15 04:17:21 user nova-compute[74805]:     <nova:disk>1</nova:disk>
Nov 15 04:17:21 user nova-compute[74805]:     <nova:swap>0</nova:swap>
Nov 15 04:17:21 user nova-compute[74805]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:17:21 user nova-compute[74805]:     <nova:vcpus>1</nova:vcpus>
Nov 15 04:17:21 user nova-compute[74805]:   </nova:flavor>
Nov 15 04:17:21 user nova-compute[74805]:   <nova:owner>
Nov 15 04:17:21 user nova-compute[74805]:     <nova:user uuid="e6fca23f109447409a8f31b925071ca7">tempest-TaggedAttachmentsTest-986558879-project-member</nova:user>
Nov 15 04:17:21 user nova-compute[74805]:     <nova:project uuid="a5fa2f59063040d9a58de745e87380a6">tempest-TaggedAttachmentsTest-986558879</nova:project>
Nov 15 04:17:21 user nova-compute[74805]:   </nova:owner>
Nov 15 04:17:21 user nova-compute[74805]:   <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:17:21 user nova-compute[74805]:   <nova:ports>
Nov 15 04:17:21 user nova-compute[74805]:     <nova:port uuid="51834a6c-a2bb-4135-b3b3-beb4e689e876">
Nov 15 04:17:21 user nova-compute[74805]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 04:17:21 user nova-compute[74805]:     </nova:port>
Nov 15 04:17:21 user nova-compute[74805]:   </nova:ports>
Nov 15 04:17:21 user nova-compute[74805]: </nova:instance>
Nov 15 04:17:21 user nova-compute[74805]:  {{(pid=74805) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 04:17:21 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fdf3e90f-4fd8-4da4-a888-48c7a80fb209 is timed out.
Nov 15 04:17:21 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Successfully detached device vdb from instance fdf3e90f-4fd8-4da4-a888-48c7a80fb209 from the live domain config.
Nov 15 04:17:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUnLfqKY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': 'c27c663f-7b69-4434-9bc7-16a40032c7b0'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:17:21 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:17:21 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b36bee-777a-40de-bad7-56da799b8515]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:17:21 user nova-compute[74805]: No targets found.
Nov 15 04:17:21 user nova-compute[74805]: iSNS:
Nov 15 04:17:21 user nova-compute[74805]: No targets found.
Nov 15 04:17:21 user nova-compute[74805]: STATIC:
Nov 15 04:17:21 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0
Nov 15 04:17:21 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:17:21 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:17:21 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6
Nov 15 04:17:21 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:17:21 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:17:21 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d
Nov 15 04:17:21 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:17:21 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:17:21 user nova-compute[74805]: FIRMWARE:
Nov 15 04:17:21 user nova-compute[74805]: No targets found.
Nov 15 04:17:21 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:17:21 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:17:21 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ded4b9d-98e5-441a-9eae-299080e43ba6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f5dd7a-6c1e-44a0-9e3e-5c0ca1a656ce]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:17:21 user nova-compute[74805]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)
Nov 15 04:17:21 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:17:21 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:17:21 user nova-compute[74805]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 (non-flash)
Nov 15 04:17:21 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:17:21 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c131fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0'): ({'sdc'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Removing single pathed devices sdc {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f77bf84-89b8-4800-807c-b1388b5cf19e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f77656-03c1-4294-a635-a25fbdd7e24d]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Flushing IO for device /dev/sdc {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14c6f88-e3d9-40ed-8583-6910eec9517d]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a1720c-0e27-465d-addc-db04152e221e]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3bd4f6-381d-445d-ab96-042b9b53608e]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Updating instance_info_cache with network_info: [{"id": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "address": "fa:16:3e:c4:ea:ce", "network": {"id": "faafe4eb-0b41-4c3a-bce5-3d65543bc634", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-431209234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5fa2f59063040d9a58de745e87380a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51834a6c-a2", "ovs_interfaceid": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[364c211a-92a7-4a7c-96a1-0178f7ca246e]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0, portal: 172.16.0.220,3260]
Nov 15 04:17:21 user nova-compute[74805]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0, portal: 172.16.0.220,3260] successful.
Nov 15 04:17:21 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Releasing lock "refresh_cache-05f49324-4b7a-4cd4-ada5-9450b9bf1d70" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27c663f-7b69-4434-9bc7-16a40032c7b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ce7e7e-f71f-4434-9014-e04fdba53ea6]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] <== disconnect_volume: return (322ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:17:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b7e36a47-e40a-4a6e-84b2-21c9d3fc1e0d tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "interface-05f49324-4b7a-4cd4-ada5-9450b9bf1d70-594121f1-1d63-4ca4-8818-51d77f20a391" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.685s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:22 user nova-compute[74805]: DEBUG nova.objects.instance [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lazy-loading 'flavor' on Instance uuid fdf3e90f-4fd8-4da4-a888-48c7a80fb209 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:17:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2755ae7a-da9f-47c3-8f2c-f15a704c230c tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.831s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SyLpHCfM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:17:24 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:17:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:17:24 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:17:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:17:24 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e85a23-2c82-424c-adc4-c6b5fdd3d45c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:17:24 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d8e408-050c-49f7-a129-96c517b6e6ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d] added
Nov 15 04:17:24 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0935103a-c98d-457c-b111-878e28e2320d]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.048s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a8c032-7892-4179-addc-4a866ff53b37]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SyLpHCfM {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SyLpHCfM" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[64795268-1714-407d-8153-dac787e2b807]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SyLpHCfM'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62d7b28-969d-4ee2-aab7-9426503d836f]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46a0a0d-5fde-4f54-a4dc-f17814734b34]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:17:24 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:17:24 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:17:24 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:17:24 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b230a333-f1cf-4f43-a946-9ee898af49c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d, portal: 172.16.0.220,3260]
Nov 15 04:17:24 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d, portal: 172.16.0.220,3260] successful.
Nov 15 04:17:24 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcaa0d64-1018-446f-bd45-c549fcb20635]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3673e9-2002-4f2c-8283-ce5e88b27385]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:17:24 user nova-compute[74805]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:17:24 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:17:24 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:17:24 user nova-compute[74805]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:17:24 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:17:24 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8241cb0d-556b-4791-80a0-f0fd177bc451]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:17:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SyLpHCfM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:17:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:17:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23461356462373163', 'path': '/dev/sdc'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:17:25 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461356462373163', 'path': '/dev/sdc'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:17:25 user nova-compute[74805]: DEBUG nova.objects.instance [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lazy-loading 'flavor' on Instance uuid cad2eedf-c1ef-436c-b608-5b6dafa47451 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:17:25 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:17:25 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:17:25 user nova-compute[74805]:   <source dev="/dev/sdc"/>
Nov 15 04:17:25 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:17:25 user nova-compute[74805]:   <serial>96273922-6a78-407c-81c9-059c9e65020d</serial>
Nov 15 04:17:25 user nova-compute[74805]: </disk>
Nov 15 04:17:25 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:17:26 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:17:26 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:17:26 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] No VIF found with MAC fa:16:3e:ff:8a:9e, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:17:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d18a13cf-480a-4ffa-9262-d03ac8d1f100 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.059s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:30 user nova-compute[74805]: DEBUG nova.compute.manager [req-72d27bf1-a456-45e1-b93e-9871b6a93afa req-362aa35f-8e86-4edf-a0bd-1160b6bc5789 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Received event network-changed-333d7ad3-7a5b-49e8-a657-a712443ad922 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:30 user nova-compute[74805]: DEBUG nova.compute.manager [req-72d27bf1-a456-45e1-b93e-9871b6a93afa req-362aa35f-8e86-4edf-a0bd-1160b6bc5789 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Refreshing instance network info cache due to event network-changed-333d7ad3-7a5b-49e8-a657-a712443ad922. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:17:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-72d27bf1-a456-45e1-b93e-9871b6a93afa req-362aa35f-8e86-4edf-a0bd-1160b6bc5789 service nova] Acquiring lock "refresh_cache-cad2eedf-c1ef-436c-b608-5b6dafa47451" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:17:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-72d27bf1-a456-45e1-b93e-9871b6a93afa req-362aa35f-8e86-4edf-a0bd-1160b6bc5789 service nova] Acquired lock "refresh_cache-cad2eedf-c1ef-436c-b608-5b6dafa47451" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:17:30 user nova-compute[74805]: DEBUG nova.network.neutron [req-72d27bf1-a456-45e1-b93e-9871b6a93afa req-362aa35f-8e86-4edf-a0bd-1160b6bc5789 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Refreshing network info cache for port 333d7ad3-7a5b-49e8-a657-a712443ad922 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:17:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:17:30 user nova-compute[74805]: DEBUG nova.network.neutron [req-72d27bf1-a456-45e1-b93e-9871b6a93afa req-362aa35f-8e86-4edf-a0bd-1160b6bc5789 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Updated VIF entry in instance network info cache for port 333d7ad3-7a5b-49e8-a657-a712443ad922. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:17:30 user nova-compute[74805]: DEBUG nova.network.neutron [req-72d27bf1-a456-45e1-b93e-9871b6a93afa req-362aa35f-8e86-4edf-a0bd-1160b6bc5789 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Updating instance_info_cache with network_info: [{"id": "333d7ad3-7a5b-49e8-a657-a712443ad922", "address": "fa:16:3e:ff:8a:9e", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333d7ad3-7a", "ovs_interfaceid": "333d7ad3-7a5b-49e8-a657-a712443ad922", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:17:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-72d27bf1-a456-45e1-b93e-9871b6a93afa req-362aa35f-8e86-4edf-a0bd-1160b6bc5789 service nova] Releasing lock "refresh_cache-cad2eedf-c1ef-436c-b608-5b6dafa47451" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:17:32 user nova-compute[74805]: DEBUG nova.compute.manager [req-c0f74dd9-15aa-40e2-92af-5a0b45c8a51c req-b55c7806-b5b5-469a-938d-96f07dc69ac9 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Received event network-changed-333d7ad3-7a5b-49e8-a657-a712443ad922 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:32 user nova-compute[74805]: DEBUG nova.compute.manager [req-c0f74dd9-15aa-40e2-92af-5a0b45c8a51c req-b55c7806-b5b5-469a-938d-96f07dc69ac9 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Refreshing instance network info cache due to event network-changed-333d7ad3-7a5b-49e8-a657-a712443ad922. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:17:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c0f74dd9-15aa-40e2-92af-5a0b45c8a51c req-b55c7806-b5b5-469a-938d-96f07dc69ac9 service nova] Acquiring lock "refresh_cache-cad2eedf-c1ef-436c-b608-5b6dafa47451" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:17:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c0f74dd9-15aa-40e2-92af-5a0b45c8a51c req-b55c7806-b5b5-469a-938d-96f07dc69ac9 service nova] Acquired lock "refresh_cache-cad2eedf-c1ef-436c-b608-5b6dafa47451" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:17:32 user nova-compute[74805]: DEBUG nova.network.neutron [req-c0f74dd9-15aa-40e2-92af-5a0b45c8a51c req-b55c7806-b5b5-469a-938d-96f07dc69ac9 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Refreshing network info cache for port 333d7ad3-7a5b-49e8-a657-a712443ad922 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:17:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-061a1032-bdd5-4bab-93f5-6804ecf03d65 tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Acquiring lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-061a1032-bdd5-4bab-93f5-6804ecf03d65 tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-061a1032-bdd5-4bab-93f5-6804ecf03d65 tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Acquiring lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-061a1032-bdd5-4bab-93f5-6804ecf03d65 tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-061a1032-bdd5-4bab-93f5-6804ecf03d65 tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:32 user nova-compute[74805]: INFO nova.compute.manager [None req-061a1032-bdd5-4bab-93f5-6804ecf03d65 tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Terminating instance
Nov 15 04:17:32 user nova-compute[74805]: DEBUG nova.compute.manager [None req-061a1032-bdd5-4bab-93f5-6804ecf03d65 tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:17:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:32 user nova-compute[74805]: DEBUG nova.compute.manager [req-83b51e11-1a44-48d6-a3f3-0d89abf08723 req-d3576c8e-5789-45b6-a539-40ada9fe6d20 service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Received event network-vif-unplugged-8008b41a-f1bc-4a16-b839-17f69eea93e5 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-83b51e11-1a44-48d6-a3f3-0d89abf08723 req-d3576c8e-5789-45b6-a539-40ada9fe6d20 service nova] Acquiring lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-83b51e11-1a44-48d6-a3f3-0d89abf08723 req-d3576c8e-5789-45b6-a539-40ada9fe6d20 service nova] Lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-83b51e11-1a44-48d6-a3f3-0d89abf08723 req-d3576c8e-5789-45b6-a539-40ada9fe6d20 service nova] Lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:32 user nova-compute[74805]: DEBUG nova.compute.manager [req-83b51e11-1a44-48d6-a3f3-0d89abf08723 req-d3576c8e-5789-45b6-a539-40ada9fe6d20 service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] No waiting events found dispatching network-vif-unplugged-8008b41a-f1bc-4a16-b839-17f69eea93e5 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:17:32 user nova-compute[74805]: DEBUG nova.compute.manager [req-83b51e11-1a44-48d6-a3f3-0d89abf08723 req-d3576c8e-5789-45b6-a539-40ada9fe6d20 service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Received event network-vif-unplugged-8008b41a-f1bc-4a16-b839-17f69eea93e5 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:17:32 user nova-compute[74805]: DEBUG nova.network.neutron [req-c0f74dd9-15aa-40e2-92af-5a0b45c8a51c req-b55c7806-b5b5-469a-938d-96f07dc69ac9 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Updated VIF entry in instance network info cache for port 333d7ad3-7a5b-49e8-a657-a712443ad922. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:17:32 user nova-compute[74805]: DEBUG nova.network.neutron [req-c0f74dd9-15aa-40e2-92af-5a0b45c8a51c req-b55c7806-b5b5-469a-938d-96f07dc69ac9 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Updating instance_info_cache with network_info: [{"id": "333d7ad3-7a5b-49e8-a657-a712443ad922", "address": "fa:16:3e:ff:8a:9e", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333d7ad3-7a", "ovs_interfaceid": "333d7ad3-7a5b-49e8-a657-a712443ad922", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:17:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c0f74dd9-15aa-40e2-92af-5a0b45c8a51c req-b55c7806-b5b5-469a-938d-96f07dc69ac9 service nova] Releasing lock "refresh_cache-cad2eedf-c1ef-436c-b608-5b6dafa47451" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:17:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:33 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Instance destroyed successfully.
Nov 15 04:17:33 user nova-compute[74805]: DEBUG nova.objects.instance [None req-061a1032-bdd5-4bab-93f5-6804ecf03d65 tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Lazy-loading 'resources' on Instance uuid 89dcacb0-6864-4529-903d-ae46a2dc3bdd {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:17:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-061a1032-bdd5-4bab-93f5-6804ecf03d65 tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-104897397',display_name='tempest-VolumesAssistedSnapshotsTest-server-104897397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-104897397',id=10,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJc1Yu6QkUOn79rDuAwEWVcecQCBh1BjhfHf4zoamr8WEqOwZNXEamWJK+plVdnQsiM8kgBOcZty0zODYPowPa3i+V6obYHycYZT74cwzcBaI/AUfQaYj+qwMGu8xFSDFg==',key_name='tempest-keypair-113998826',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:14:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ddc0430dda414f238788cc4d75813097',ramdisk_id='',reservation_id='r-w7w4u5q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-2010741569',owner_user_name='tempest-VolumesAssistedSnapshotsTest-2010741569-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d4ea132d2434552a89e95d35060dbd6',uuid=89dcacb0-6864-4529-903d-ae46a2dc3bdd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8008b41a-f1bc-4a16-b839-17f69eea93e5", "address": "fa:16:3e:ea:64:39", "network": {"id": "6765ab2e-ca61-4ee7-873b-c41ae0c8f751", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-335552907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc0430dda414f238788cc4d75813097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8008b41a-f1", "ovs_interfaceid": "8008b41a-f1bc-4a16-b839-17f69eea93e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:17:33 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-061a1032-bdd5-4bab-93f5-6804ecf03d65 tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Converting VIF {"id": "8008b41a-f1bc-4a16-b839-17f69eea93e5", "address": "fa:16:3e:ea:64:39", "network": {"id": "6765ab2e-ca61-4ee7-873b-c41ae0c8f751", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-335552907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc0430dda414f238788cc4d75813097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8008b41a-f1", "ovs_interfaceid": "8008b41a-f1bc-4a16-b839-17f69eea93e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:17:33 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-061a1032-bdd5-4bab-93f5-6804ecf03d65 tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:64:39,bridge_name='br-int',has_traffic_filtering=True,id=8008b41a-f1bc-4a16-b839-17f69eea93e5,network=Network(6765ab2e-ca61-4ee7-873b-c41ae0c8f751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8008b41a-f1') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:17:33 user nova-compute[74805]: DEBUG os_vif [None req-061a1032-bdd5-4bab-93f5-6804ecf03d65 tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:64:39,bridge_name='br-int',has_traffic_filtering=True,id=8008b41a-f1bc-4a16-b839-17f69eea93e5,network=Network(6765ab2e-ca61-4ee7-873b-c41ae0c8f751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8008b41a-f1') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:17:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8008b41a-f1, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:17:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9ea709f-b2cd-457a-bc1f-f91827cef7aa) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:17:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:17:33 user nova-compute[74805]: INFO os_vif [None req-061a1032-bdd5-4bab-93f5-6804ecf03d65 tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:64:39,bridge_name='br-int',has_traffic_filtering=True,id=8008b41a-f1bc-4a16-b839-17f69eea93e5,network=Network(6765ab2e-ca61-4ee7-873b-c41ae0c8f751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8008b41a-f1')
Nov 15 04:17:33 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-061a1032-bdd5-4bab-93f5-6804ecf03d65 tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Deleting instance files /opt/stack/data/nova/instances/89dcacb0-6864-4529-903d-ae46a2dc3bdd_del
Nov 15 04:17:33 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-061a1032-bdd5-4bab-93f5-6804ecf03d65 tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Deletion of /opt/stack/data/nova/instances/89dcacb0-6864-4529-903d-ae46a2dc3bdd_del complete
Nov 15 04:17:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:33 user nova-compute[74805]: INFO nova.compute.manager [None req-061a1032-bdd5-4bab-93f5-6804ecf03d65 tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 15 04:17:33 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-061a1032-bdd5-4bab-93f5-6804ecf03d65 tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:17:33 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:17:33 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:17:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:17:34 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Took 0.86 seconds to deallocate network for instance.
Nov 15 04:17:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-061a1032-bdd5-4bab-93f5-6804ecf03d65 tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-061a1032-bdd5-4bab-93f5-6804ecf03d65 tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG nova.compute.manager [req-0427ce7d-c800-4d7c-bca6-1f8fd2d4dc13 req-be429966-b46f-4cef-982f-b1c48e0f44d4 service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Received event network-vif-deleted-8008b41a-f1bc-4a16-b839-17f69eea93e5 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "cad2eedf-c1ef-436c-b608-5b6dafa47451" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:34 user nova-compute[74805]: INFO nova.compute.manager [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Rebooting instance
Nov 15 04:17:34 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-061a1032-bdd5-4bab-93f5-6804ecf03d65 tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-061a1032-bdd5-4bab-93f5-6804ecf03d65 tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "refresh_cache-cad2eedf-c1ef-436c-b608-5b6dafa47451" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquired lock "refresh_cache-cad2eedf-c1ef-436c-b608-5b6dafa47451" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG nova.network.neutron [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-061a1032-bdd5-4bab-93f5-6804ecf03d65 tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:34 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-061a1032-bdd5-4bab-93f5-6804ecf03d65 tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Deleted allocations for instance 89dcacb0-6864-4529-903d-ae46a2dc3bdd
Nov 15 04:17:34 user nova-compute[74805]: DEBUG nova.compute.manager [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Received event network-vif-plugged-8008b41a-f1bc-4a16-b839-17f69eea93e5 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] Acquiring lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] Lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] Lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG nova.compute.manager [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] No waiting events found dispatching network-vif-plugged-8008b41a-f1bc-4a16-b839-17f69eea93e5 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:17:34 user nova-compute[74805]: WARNING nova.compute.manager [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Received unexpected event network-vif-plugged-8008b41a-f1bc-4a16-b839-17f69eea93e5 for instance with vm_state deleted and task_state None.
Nov 15 04:17:34 user nova-compute[74805]: DEBUG nova.compute.manager [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Received event network-vif-plugged-8008b41a-f1bc-4a16-b839-17f69eea93e5 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] Acquiring lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] Lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] Lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG nova.compute.manager [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] No waiting events found dispatching network-vif-plugged-8008b41a-f1bc-4a16-b839-17f69eea93e5 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:17:34 user nova-compute[74805]: WARNING nova.compute.manager [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Received unexpected event network-vif-plugged-8008b41a-f1bc-4a16-b839-17f69eea93e5 for instance with vm_state deleted and task_state None.
Nov 15 04:17:34 user nova-compute[74805]: DEBUG nova.compute.manager [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Received event network-vif-plugged-8008b41a-f1bc-4a16-b839-17f69eea93e5 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] Acquiring lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] Lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] Lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG nova.compute.manager [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] No waiting events found dispatching network-vif-plugged-8008b41a-f1bc-4a16-b839-17f69eea93e5 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:17:34 user nova-compute[74805]: WARNING nova.compute.manager [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Received unexpected event network-vif-plugged-8008b41a-f1bc-4a16-b839-17f69eea93e5 for instance with vm_state deleted and task_state None.
Nov 15 04:17:34 user nova-compute[74805]: DEBUG nova.compute.manager [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Received event network-vif-unplugged-8008b41a-f1bc-4a16-b839-17f69eea93e5 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] Acquiring lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] Lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] Lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG nova.compute.manager [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] No waiting events found dispatching network-vif-unplugged-8008b41a-f1bc-4a16-b839-17f69eea93e5 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:17:34 user nova-compute[74805]: WARNING nova.compute.manager [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Received unexpected event network-vif-unplugged-8008b41a-f1bc-4a16-b839-17f69eea93e5 for instance with vm_state deleted and task_state None.
Nov 15 04:17:34 user nova-compute[74805]: DEBUG nova.compute.manager [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Received event network-vif-plugged-8008b41a-f1bc-4a16-b839-17f69eea93e5 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] Acquiring lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] Lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] Lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:34 user nova-compute[74805]: DEBUG nova.compute.manager [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] No waiting events found dispatching network-vif-plugged-8008b41a-f1bc-4a16-b839-17f69eea93e5 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:17:34 user nova-compute[74805]: WARNING nova.compute.manager [req-3b81df0b-3677-45f6-afd3-bd94e8910137 req-a7db605d-a750-4d83-b34b-75cc23f8008d service nova] [instance: 89dcacb0-6864-4529-903d-ae46a2dc3bdd] Received unexpected event network-vif-plugged-8008b41a-f1bc-4a16-b839-17f69eea93e5 for instance with vm_state deleted and task_state None.
Nov 15 04:17:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-061a1032-bdd5-4bab-93f5-6804ecf03d65 tempest-VolumesAssistedSnapshotsTest-2010741569 tempest-VolumesAssistedSnapshotsTest-2010741569-project-member] Lock "89dcacb0-6864-4529-903d-ae46a2dc3bdd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.423s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:35 user nova-compute[74805]: DEBUG nova.network.neutron [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Updating instance_info_cache with network_info: [{"id": "333d7ad3-7a5b-49e8-a657-a712443ad922", "address": "fa:16:3e:ff:8a:9e", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333d7ad3-7a", "ovs_interfaceid": "333d7ad3-7a5b-49e8-a657-a712443ad922", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:17:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Releasing lock "refresh_cache-cad2eedf-c1ef-436c-b608-5b6dafa47451" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:17:35 user nova-compute[74805]: DEBUG nova.compute.manager [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:36 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Instance destroyed successfully.
Nov 15 04:17:36 user nova-compute[74805]: DEBUG nova.objects.instance [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lazy-loading 'resources' on Instance uuid cad2eedf-c1ef-436c-b608-5b6dafa47451 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-882338115',display_name='tempest-TestMinimumBasicScenario-server-882338115',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-882338115',id=12,image_ref='c40fd4f6-246a-4fa8-80fa-f56a69d0386c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoM4mPJpNa3lSZNqZNye7yd+TzehokoE4PQcucjBnq3agpjLVjHz6yfP2n5YbekRY7ga7hrRvA9IilP2Z+bVGfBl94B2ikgCr8ddgEyR544o0t1jjaQlKeA+jJsJfPcaA==',key_name='tempest-TestMinimumBasicScenario-883673859',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:15:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ddde64bc93cc40f189e1d0b6d948cd0a',ramdisk_id='',reservation_id='r-a1rc5i03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c40fd4f6-246a-4fa8-80fa-f56a69d0386c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-342422642',owner_user_name='tempest-TestMinimumBasicScenario-342422642-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:17:35Z,user_data=None,user_id='eac59db39ba64883a64ab3133eaf1972',uuid=cad2eedf-c1ef-436c-b608-5b6dafa47451,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "333d7ad3-7a5b-49e8-a657-a712443ad922", "address": "fa:16:3e:ff:8a:9e", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333d7ad3-7a", "ovs_interfaceid": "333d7ad3-7a5b-49e8-a657-a712443ad922", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Converting VIF {"id": "333d7ad3-7a5b-49e8-a657-a712443ad922", "address": "fa:16:3e:ff:8a:9e", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333d7ad3-7a", "ovs_interfaceid": "333d7ad3-7a5b-49e8-a657-a712443ad922", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:8a:9e,bridge_name='br-int',has_traffic_filtering=True,id=333d7ad3-7a5b-49e8-a657-a712443ad922,network=Network(8408f959-0c0d-4a22-afa0-b51304c254ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333d7ad3-7a') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG os_vif [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:8a:9e,bridge_name='br-int',has_traffic_filtering=True,id=333d7ad3-7a5b-49e8-a657-a712443ad922,network=Network(8408f959-0c0d-4a22-afa0-b51304c254ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333d7ad3-7a') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap333d7ad3-7a, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7899a5e9-c257-44cf-9431-65b92e60c1c4) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:36 user nova-compute[74805]: INFO os_vif [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:8a:9e,bridge_name='br-int',has_traffic_filtering=True,id=333d7ad3-7a5b-49e8-a657-a712443ad922,network=Network(8408f959-0c0d-4a22-afa0-b51304c254ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333d7ad3-7a')
Nov 15 04:17:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SyLpHCfM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:17:36 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:17:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc924d1-7d03-42e1-8022-b1b0df5b8aef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:17:36 user nova-compute[74805]: No targets found.
Nov 15 04:17:36 user nova-compute[74805]: iSNS:
Nov 15 04:17:36 user nova-compute[74805]: No targets found.
Nov 15 04:17:36 user nova-compute[74805]: STATIC:
Nov 15 04:17:36 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6
Nov 15 04:17:36 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:17:36 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:17:36 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d
Nov 15 04:17:36 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:17:36 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:17:36 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d
Nov 15 04:17:36 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:17:36 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:17:36 user nova-compute[74805]: FIRMWARE:
Nov 15 04:17:36 user nova-compute[74805]: No targets found.
Nov 15 04:17:36 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:17:36 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:17:36 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f22656-eb7f-470d-8d06-488c2252e5b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG nova.compute.manager [req-4a41ad18-134e-4e67-9303-48b269a447a6 req-35c94e85-88ac-4aa0-bf5f-69ea4a75d1ac service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Received event network-vif-unplugged-333d7ad3-7a5b-49e8-a657-a712443ad922 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-4a41ad18-134e-4e67-9303-48b269a447a6 req-35c94e85-88ac-4aa0-bf5f-69ea4a75d1ac service nova] Acquiring lock "cad2eedf-c1ef-436c-b608-5b6dafa47451-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-4a41ad18-134e-4e67-9303-48b269a447a6 req-35c94e85-88ac-4aa0-bf5f-69ea4a75d1ac service nova] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-4a41ad18-134e-4e67-9303-48b269a447a6 req-35c94e85-88ac-4aa0-bf5f-69ea4a75d1ac service nova] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG nova.compute.manager [req-4a41ad18-134e-4e67-9303-48b269a447a6 req-35c94e85-88ac-4aa0-bf5f-69ea4a75d1ac service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] No waiting events found dispatching network-vif-unplugged-333d7ad3-7a5b-49e8-a657-a712443ad922 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:17:36 user nova-compute[74805]: WARNING nova.compute.manager [req-4a41ad18-134e-4e67-9303-48b269a447a6 req-35c94e85-88ac-4aa0-bf5f-69ea4a75d1ac service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Received unexpected event network-vif-unplugged-333d7ad3-7a5b-49e8-a657-a712443ad922 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 04:17:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c6586c-901f-41a1-bf05-9e0767b14f68]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:17:36 user nova-compute[74805]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:17:36 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:17:36 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:17:36 user nova-compute[74805]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:17:36 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:17:36 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c1305e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d'): ({'sdc'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Removing single pathed devices sdc {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5271c1-de22-4b8b-911b-5f8379952022]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb5d8ee-76d0-412c-bed0-c35507dcd820]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Flushing IO for device /dev/sdc {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3146cdde-e67f-4d0b-b962-21e4d6aa5231]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:17:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb6b409-079d-4d9a-b7ce-24b884518e66]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17a5f5d-9d5a-47f4-81c4-aae3f06061ee]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44d32b1-3729-4a34-995e-0583643172b1]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d, portal: 172.16.0.220,3260]
Nov 15 04:17:37 user nova-compute[74805]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d, portal: 172.16.0.220,3260] successful.
Nov 15 04:17:37 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e39b64a-25f1-409b-9a75-6bfe71f6e2bc]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] <== disconnect_volume: return (309ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Start _get_guest_xml network_info=[{"id": "333d7ad3-7a5b-49e8-a657-a712443ad922", "address": "fa:16:3e:ff:8a:9e", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333d7ad3-7a", "ovs_interfaceid": "333d7ad3-7a5b-49e8-a657-a712443ad922", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c40fd4f6-246a-4fa8-80fa-f56a69d0386c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'c40fd4f6-246a-4fa8-80fa-f56a69d0386c'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SyLpHCfM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'cad2eedf-c1ef-436c-b608-5b6dafa47451', 'attached_at': '', 'detached_at': '', 'volume_id': '96273922-6a78-407c-81c9-059c9e65020d', 'serial': '96273922-6a78-407c-81c9-059c9e65020d'}, 'delete_on_termination': False, 'attachment_id': '482a3f48-487f-46ed-8429-1d3f587d9395', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:17:37 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:17:37 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:17:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c40fd4f6-246a-4fa8-80fa-f56a69d0386c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG nova.objects.instance [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lazy-loading 'vcpu_model' on Instance uuid cad2eedf-c1ef-436c-b608-5b6dafa47451 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG nova.objects.base [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Object Instance<cad2eedf-c1ef-436c-b608-5b6dafa47451> lazy-loaded attributes: resources,vcpu_model {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SyLpHCfM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:17:37 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:17:37 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:17:37 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5b3fc8-33d1-4041-b3f1-6d6aae4fff01]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:17:37 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3df33e-d50f-49c6-bdc3-c6c5537027fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d] added
Nov 15 04:17:37 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4af49ae-51fb-4718-832e-2639439155c8]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0b361c-3ee3-4a88-8c34-7dc2e0446985]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SyLpHCfM {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SyLpHCfM" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbed297e-f166-47f2-bd5b-7411b93dc3b7]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SyLpHCfM'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfffe929-efd5-4b5d-9c0b-f54470b316ac]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[31dab9be-a7df-4e83-b040-20ee7a60b3a5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:17:37 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:17:37 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:17:37 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:17:37 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4a529a-b618-410d-9c71-f14bcfce3f31]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d, portal: 172.16.0.220,3260]
Nov 15 04:17:37 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d, portal: 172.16.0.220,3260] successful.
Nov 15 04:17:37 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04b612d-c4db-432e-becd-c6e46461c6ca]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8991ba29-0e54-4ea8-9150-e7a57fa8a9e4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:17:37 user nova-compute[74805]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:17:37 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:17:37 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:17:37 user nova-compute[74805]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:17:37 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:17:37 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a12d999-1a35-4e1d-b388-760d40b56b59]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:17:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SyLpHCfM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:17:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:17:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23461356462373163', 'path': '/dev/sdc'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:17:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461356462373163', 'path': '/dev/sdc'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:17:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-882338115',display_name='tempest-TestMinimumBasicScenario-server-882338115',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-882338115',id=12,image_ref='c40fd4f6-246a-4fa8-80fa-f56a69d0386c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoM4mPJpNa3lSZNqZNye7yd+TzehokoE4PQcucjBnq3agpjLVjHz6yfP2n5YbekRY7ga7hrRvA9IilP2Z+bVGfBl94B2ikgCr8ddgEyR544o0t1jjaQlKeA+jJsJfPcaA==',key_name='tempest-TestMinimumBasicScenario-883673859',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:15:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ddde64bc93cc40f189e1d0b6d948cd0a',ramdisk_id='',reservation_id='r-a1rc5i03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c40fd4f6-246a-4fa8-80fa-f56a69d0386c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-342422642',owner_user_name='tempest-TestMinimumBasicScenario-342422642-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:17:35Z,user_data=None,user_id='eac59db39ba64883a64ab3133eaf1972',uuid=cad2eedf-c1ef-436c-b608-5b6dafa47451,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "333d7ad3-7a5b-49e8-a657-a712443ad922", "address": "fa:16:3e:ff:8a:9e", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333d7ad3-7a", "ovs_interfaceid": "333d7ad3-7a5b-49e8-a657-a712443ad922", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:17:38 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Converting VIF {"id": "333d7ad3-7a5b-49e8-a657-a712443ad922", "address": "fa:16:3e:ff:8a:9e", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333d7ad3-7a", "ovs_interfaceid": "333d7ad3-7a5b-49e8-a657-a712443ad922", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:17:38 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:8a:9e,bridge_name='br-int',has_traffic_filtering=True,id=333d7ad3-7a5b-49e8-a657-a712443ad922,network=Network(8408f959-0c0d-4a22-afa0-b51304c254ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333d7ad3-7a') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:17:38 user nova-compute[74805]: DEBUG nova.objects.instance [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lazy-loading 'pci_devices' on Instance uuid cad2eedf-c1ef-436c-b608-5b6dafa47451 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:17:38 user nova-compute[74805]: DEBUG nova.objects.base [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Object Instance<cad2eedf-c1ef-436c-b608-5b6dafa47451> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:17:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:17:38 user nova-compute[74805]:   <uuid>cad2eedf-c1ef-436c-b608-5b6dafa47451</uuid>
Nov 15 04:17:38 user nova-compute[74805]:   <name>instance-0000000c</name>
Nov 15 04:17:38 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:17:38 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:17:38 user nova-compute[74805]:   <metadata>
Nov 15 04:17:38 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:17:38 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:17:38 user nova-compute[74805]:       <nova:name>tempest-TestMinimumBasicScenario-server-882338115</nova:name>
Nov 15 04:17:38 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:17:37</nova:creationTime>
Nov 15 04:17:38 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:17:38 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:17:38 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:17:38 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:17:38 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:17:38 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:17:38 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:17:38 user nova-compute[74805]:       <nova:owner>
Nov 15 04:17:38 user nova-compute[74805]:         <nova:user uuid="eac59db39ba64883a64ab3133eaf1972">tempest-TestMinimumBasicScenario-342422642-project-member</nova:user>
Nov 15 04:17:38 user nova-compute[74805]:         <nova:project uuid="ddde64bc93cc40f189e1d0b6d948cd0a">tempest-TestMinimumBasicScenario-342422642</nova:project>
Nov 15 04:17:38 user nova-compute[74805]:       </nova:owner>
Nov 15 04:17:38 user nova-compute[74805]:       <nova:root type="image" uuid="c40fd4f6-246a-4fa8-80fa-f56a69d0386c"/>
Nov 15 04:17:38 user nova-compute[74805]:       <nova:ports>
Nov 15 04:17:38 user nova-compute[74805]:         <nova:port uuid="333d7ad3-7a5b-49e8-a657-a712443ad922">
Nov 15 04:17:38 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 04:17:38 user nova-compute[74805]:         </nova:port>
Nov 15 04:17:38 user nova-compute[74805]:       </nova:ports>
Nov 15 04:17:38 user nova-compute[74805]:     </nova:instance>
Nov 15 04:17:38 user nova-compute[74805]:   </metadata>
Nov 15 04:17:38 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:17:38 user nova-compute[74805]:     <system>
Nov 15 04:17:38 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:17:38 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:17:38 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:17:38 user nova-compute[74805]:       <entry name="serial">cad2eedf-c1ef-436c-b608-5b6dafa47451</entry>
Nov 15 04:17:38 user nova-compute[74805]:       <entry name="uuid">cad2eedf-c1ef-436c-b608-5b6dafa47451</entry>
Nov 15 04:17:38 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:17:38 user nova-compute[74805]:     </system>
Nov 15 04:17:38 user nova-compute[74805]:   </sysinfo>
Nov 15 04:17:38 user nova-compute[74805]:   <os>
Nov 15 04:17:38 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:17:38 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:17:38 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:17:38 user nova-compute[74805]:   </os>
Nov 15 04:17:38 user nova-compute[74805]:   <features>
Nov 15 04:17:38 user nova-compute[74805]:     <acpi/>
Nov 15 04:17:38 user nova-compute[74805]:     <apic/>
Nov 15 04:17:38 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:17:38 user nova-compute[74805]:   </features>
Nov 15 04:17:38 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:17:38 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:17:38 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:17:38 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:17:38 user nova-compute[74805]:   </clock>
Nov 15 04:17:38 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:17:38 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:17:38 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:17:38 user nova-compute[74805]:   </cpu>
Nov 15 04:17:38 user nova-compute[74805]:   <devices>
Nov 15 04:17:38 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:17:38 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:17:38 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk"/>
Nov 15 04:17:38 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:17:38 user nova-compute[74805]:     </disk>
Nov 15 04:17:38 user nova-compute[74805]:     <disk type="block" device="disk">
Nov 15 04:17:38 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:17:38 user nova-compute[74805]:       <source dev="/dev/sdc"/>
Nov 15 04:17:38 user nova-compute[74805]:       <target dev="vdb" bus="virtio"/>
Nov 15 04:17:38 user nova-compute[74805]:       <serial>96273922-6a78-407c-81c9-059c9e65020d</serial>
Nov 15 04:17:38 user nova-compute[74805]:     </disk>
Nov 15 04:17:38 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:17:38 user nova-compute[74805]:       <mac address="fa:16:3e:ff:8a:9e"/>
Nov 15 04:17:38 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:17:38 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:17:38 user nova-compute[74805]:       <target dev="tap333d7ad3-7a"/>
Nov 15 04:17:38 user nova-compute[74805]:     </interface>
Nov 15 04:17:38 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:17:38 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/console.log" append="off"/>
Nov 15 04:17:38 user nova-compute[74805]:     </serial>
Nov 15 04:17:38 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:17:38 user nova-compute[74805]:     <video>
Nov 15 04:17:38 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:17:38 user nova-compute[74805]:     </video>
Nov 15 04:17:38 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:17:38 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:17:38 user nova-compute[74805]:     </rng>
Nov 15 04:17:38 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:17:38 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:17:38 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:17:38 user nova-compute[74805]:     </memballoon>
Nov 15 04:17:38 user nova-compute[74805]:   </devices>
Nov 15 04:17:38 user nova-compute[74805]: </domain>
Nov 15 04:17:38 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:17:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:38 user nova-compute[74805]: DEBUG nova.compute.manager [req-57125c13-45e2-4ca1-bbad-5d66feae3bd9 req-38050010-afcb-4ee3-b14e-0dab23f963db service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Received event network-vif-plugged-333d7ad3-7a5b-49e8-a657-a712443ad922 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-57125c13-45e2-4ca1-bbad-5d66feae3bd9 req-38050010-afcb-4ee3-b14e-0dab23f963db service nova] Acquiring lock "cad2eedf-c1ef-436c-b608-5b6dafa47451-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-57125c13-45e2-4ca1-bbad-5d66feae3bd9 req-38050010-afcb-4ee3-b14e-0dab23f963db service nova] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-57125c13-45e2-4ca1-bbad-5d66feae3bd9 req-38050010-afcb-4ee3-b14e-0dab23f963db service nova] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:38 user nova-compute[74805]: DEBUG nova.compute.manager [req-57125c13-45e2-4ca1-bbad-5d66feae3bd9 req-38050010-afcb-4ee3-b14e-0dab23f963db service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] No waiting events found dispatching network-vif-plugged-333d7ad3-7a5b-49e8-a657-a712443ad922 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:17:38 user nova-compute[74805]: WARNING nova.compute.manager [req-57125c13-45e2-4ca1-bbad-5d66feae3bd9 req-38050010-afcb-4ee3-b14e-0dab23f963db service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Received unexpected event network-vif-plugged-333d7ad3-7a5b-49e8-a657-a712443ad922 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 04:17:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:17:38 user nova-compute[74805]: DEBUG nova.objects.instance [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lazy-loading 'trusted_certs' on Instance uuid cad2eedf-c1ef-436c-b608-5b6dafa47451 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:17:38 user nova-compute[74805]: DEBUG nova.objects.base [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Object Instance<cad2eedf-c1ef-436c-b608-5b6dafa47451> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:17:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f8e877eca710056507fc43c4370f51f1ffb7aa0 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f8e877eca710056507fc43c4370f51f1ffb7aa0 --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:39 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:17:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:39 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Cannot resize image /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:17:39 user nova-compute[74805]: DEBUG nova.objects.instance [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lazy-loading 'migration_context' on Instance uuid cad2eedf-c1ef-436c-b608-5b6dafa47451 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:17:39 user nova-compute[74805]: DEBUG nova.objects.base [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Object Instance<cad2eedf-c1ef-436c-b608-5b6dafa47451> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:17:39 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-882338115',display_name='tempest-TestMinimumBasicScenario-server-882338115',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-882338115',id=12,image_ref='c40fd4f6-246a-4fa8-80fa-f56a69d0386c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoM4mPJpNa3lSZNqZNye7yd+TzehokoE4PQcucjBnq3agpjLVjHz6yfP2n5YbekRY7ga7hrRvA9IilP2Z+bVGfBl94B2ikgCr8ddgEyR544o0t1jjaQlKeA+jJsJfPcaA==',key_name='tempest-TestMinimumBasicScenario-883673859',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:15:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='ddde64bc93cc40f189e1d0b6d948cd0a',ramdisk_id='',reservation_id='r-a1rc5i03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c40fd4f6-246a-4fa8-80fa-f56a69d0386c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-342422642',owner_user_name='tempest-TestMinimumBasicScenario-342422642-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:17:35Z,user_data=None,user_id='eac59db39ba64883a64ab3133eaf1972',uuid=cad2eedf-c1ef-436c-b608-5b6dafa47451,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "333d7ad3-7a5b-49e8-a657-a712443ad922", "address": "fa:16:3e:ff:8a:9e", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333d7ad3-7a", "ovs_interfaceid": "333d7ad3-7a5b-49e8-a657-a712443ad922", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:17:39 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Converting VIF {"id": "333d7ad3-7a5b-49e8-a657-a712443ad922", "address": "fa:16:3e:ff:8a:9e", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333d7ad3-7a", "ovs_interfaceid": "333d7ad3-7a5b-49e8-a657-a712443ad922", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:17:39 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:8a:9e,bridge_name='br-int',has_traffic_filtering=True,id=333d7ad3-7a5b-49e8-a657-a712443ad922,network=Network(8408f959-0c0d-4a22-afa0-b51304c254ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333d7ad3-7a') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:17:39 user nova-compute[74805]: DEBUG os_vif [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:8a:9e,bridge_name='br-int',has_traffic_filtering=True,id=333d7ad3-7a5b-49e8-a657-a712443ad922,network=Network(8408f959-0c0d-4a22-afa0-b51304c254ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333d7ad3-7a') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:17:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:17:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:17:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ecacd528-58e5-5bb7-8a2e-e0526cd1ae74', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:17:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap333d7ad3-7a, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:17:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap333d7ad3-7a, col_values=(('qos', UUID('5f2e93d3-56cf-4e43-904f-43e211ed02ea')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:17:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap333d7ad3-7a, col_values=(('external_ids', {'iface-id': '333d7ad3-7a5b-49e8-a657-a712443ad922', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:8a:9e', 'vm-uuid': 'cad2eedf-c1ef-436c-b608-5b6dafa47451'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:17:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:17:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:39 user nova-compute[74805]: INFO os_vif [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:8a:9e,bridge_name='br-int',has_traffic_filtering=True,id=333d7ad3-7a5b-49e8-a657-a712443ad922,network=Network(8408f959-0c0d-4a22-afa0-b51304c254ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333d7ad3-7a')
Nov 15 04:17:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:41 user nova-compute[74805]: DEBUG nova.compute.manager [req-bcb04d59-3c39-4cd0-a66f-f11dd4155c54 req-26742cc0-2e28-41a0-a9b0-c83a470eccfa service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Received event network-vif-plugged-333d7ad3-7a5b-49e8-a657-a712443ad922 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bcb04d59-3c39-4cd0-a66f-f11dd4155c54 req-26742cc0-2e28-41a0-a9b0-c83a470eccfa service nova] Acquiring lock "cad2eedf-c1ef-436c-b608-5b6dafa47451-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bcb04d59-3c39-4cd0-a66f-f11dd4155c54 req-26742cc0-2e28-41a0-a9b0-c83a470eccfa service nova] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bcb04d59-3c39-4cd0-a66f-f11dd4155c54 req-26742cc0-2e28-41a0-a9b0-c83a470eccfa service nova] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:41 user nova-compute[74805]: DEBUG nova.compute.manager [req-bcb04d59-3c39-4cd0-a66f-f11dd4155c54 req-26742cc0-2e28-41a0-a9b0-c83a470eccfa service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] No waiting events found dispatching network-vif-plugged-333d7ad3-7a5b-49e8-a657-a712443ad922 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:17:41 user nova-compute[74805]: WARNING nova.compute.manager [req-bcb04d59-3c39-4cd0-a66f-f11dd4155c54 req-26742cc0-2e28-41a0-a9b0-c83a470eccfa service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Received unexpected event network-vif-plugged-333d7ad3-7a5b-49e8-a657-a712443ad922 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 04:17:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:42 user nova-compute[74805]: DEBUG nova.compute.manager [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:17:42 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Instance rebooted successfully.
Nov 15 04:17:42 user nova-compute[74805]: DEBUG nova.compute.manager [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:17:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-053d519f-e1a3-4440-904b-439b9017fdf2 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.577s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:43 user nova-compute[74805]: DEBUG nova.compute.manager [req-71108c1a-5ca3-4df5-8b04-ecdc779faa18 req-c6a408d5-2158-4dc8-aca6-561b1b01d170 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Received event network-vif-plugged-333d7ad3-7a5b-49e8-a657-a712443ad922 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-71108c1a-5ca3-4df5-8b04-ecdc779faa18 req-c6a408d5-2158-4dc8-aca6-561b1b01d170 service nova] Acquiring lock "cad2eedf-c1ef-436c-b608-5b6dafa47451-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-71108c1a-5ca3-4df5-8b04-ecdc779faa18 req-c6a408d5-2158-4dc8-aca6-561b1b01d170 service nova] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-71108c1a-5ca3-4df5-8b04-ecdc779faa18 req-c6a408d5-2158-4dc8-aca6-561b1b01d170 service nova] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:43 user nova-compute[74805]: DEBUG nova.compute.manager [req-71108c1a-5ca3-4df5-8b04-ecdc779faa18 req-c6a408d5-2158-4dc8-aca6-561b1b01d170 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] No waiting events found dispatching network-vif-plugged-333d7ad3-7a5b-49e8-a657-a712443ad922 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:17:43 user nova-compute[74805]: WARNING nova.compute.manager [req-71108c1a-5ca3-4df5-8b04-ecdc779faa18 req-c6a408d5-2158-4dc8-aca6-561b1b01d170 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Received unexpected event network-vif-plugged-333d7ad3-7a5b-49e8-a657-a712443ad922 for instance with vm_state active and task_state None.
Nov 15 04:17:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f8a61306-326d-41ed-b669-9d511d50d425 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Acquiring lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f8a61306-326d-41ed-b669-9d511d50d425 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f8a61306-326d-41ed-b669-9d511d50d425 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Acquiring lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f8a61306-326d-41ed-b669-9d511d50d425 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f8a61306-326d-41ed-b669-9d511d50d425 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:44 user nova-compute[74805]: INFO nova.compute.manager [None req-f8a61306-326d-41ed-b669-9d511d50d425 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Terminating instance
Nov 15 04:17:44 user nova-compute[74805]: DEBUG nova.compute.manager [None req-f8a61306-326d-41ed-b669-9d511d50d425 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:17:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:44 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Instance destroyed successfully.
Nov 15 04:17:44 user nova-compute[74805]: DEBUG nova.objects.instance [None req-f8a61306-326d-41ed-b669-9d511d50d425 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lazy-loading 'resources' on Instance uuid 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:17:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-f8a61306-326d-41ed-b669-9d511d50d425 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:15:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2059736734',display_name='tempest-ServersNegativeTestJSON-server-2059736734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2059736734',id=13,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:16:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18dc7dbc597f4befb565dcff5a92db74',ramdisk_id='',reservation_id='r-rc6ytc54',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2049948325',owner_user_name='tempest-ServersNegativeTestJSON-2049948325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:16:01Z,user_data=None,user_id='6db3bb1be1914a19afb67cac89f0a35e',uuid=78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48712489-c49e-4e52-9c79-fc1a1aa13077", "address": "fa:16:3e:1f:3c:ac", "network": {"id": "d6c12b22-58d0-4d38-aa41-0e08de44bb3a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1369824742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dc7dbc597f4befb565dcff5a92db74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48712489-c4", "ovs_interfaceid": "48712489-c49e-4e52-9c79-fc1a1aa13077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:17:44 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-f8a61306-326d-41ed-b669-9d511d50d425 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Converting VIF {"id": "48712489-c49e-4e52-9c79-fc1a1aa13077", "address": "fa:16:3e:1f:3c:ac", "network": {"id": "d6c12b22-58d0-4d38-aa41-0e08de44bb3a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1369824742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dc7dbc597f4befb565dcff5a92db74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48712489-c4", "ovs_interfaceid": "48712489-c49e-4e52-9c79-fc1a1aa13077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:17:44 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-f8a61306-326d-41ed-b669-9d511d50d425 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3c:ac,bridge_name='br-int',has_traffic_filtering=True,id=48712489-c49e-4e52-9c79-fc1a1aa13077,network=Network(d6c12b22-58d0-4d38-aa41-0e08de44bb3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48712489-c4') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:17:44 user nova-compute[74805]: DEBUG os_vif [None req-f8a61306-326d-41ed-b669-9d511d50d425 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3c:ac,bridge_name='br-int',has_traffic_filtering=True,id=48712489-c49e-4e52-9c79-fc1a1aa13077,network=Network(d6c12b22-58d0-4d38-aa41-0e08de44bb3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48712489-c4') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:17:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48712489-c4, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:17:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:17:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=035a5c1e-8104-47ec-bc9d-d0f99acf84e6) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:17:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:44 user nova-compute[74805]: INFO os_vif [None req-f8a61306-326d-41ed-b669-9d511d50d425 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3c:ac,bridge_name='br-int',has_traffic_filtering=True,id=48712489-c49e-4e52-9c79-fc1a1aa13077,network=Network(d6c12b22-58d0-4d38-aa41-0e08de44bb3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48712489-c4')
Nov 15 04:17:44 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-f8a61306-326d-41ed-b669-9d511d50d425 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Deleting instance files /opt/stack/data/nova/instances/78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff_del
Nov 15 04:17:44 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-f8a61306-326d-41ed-b669-9d511d50d425 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Deletion of /opt/stack/data/nova/instances/78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff_del complete
Nov 15 04:17:44 user nova-compute[74805]: INFO nova.compute.manager [None req-f8a61306-326d-41ed-b669-9d511d50d425 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 15 04:17:44 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-f8a61306-326d-41ed-b669-9d511d50d425 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:17:44 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:17:44 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:17:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-b5f34649-3e4f-483e-8d64-de15c9ff483a req-adb3788f-b548-4b99-a3b4-583e09dd4dad service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Received event network-vif-unplugged-48712489-c49e-4e52-9c79-fc1a1aa13077 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5f34649-3e4f-483e-8d64-de15c9ff483a req-adb3788f-b548-4b99-a3b4-583e09dd4dad service nova] Acquiring lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5f34649-3e4f-483e-8d64-de15c9ff483a req-adb3788f-b548-4b99-a3b4-583e09dd4dad service nova] Lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5f34649-3e4f-483e-8d64-de15c9ff483a req-adb3788f-b548-4b99-a3b4-583e09dd4dad service nova] Lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-b5f34649-3e4f-483e-8d64-de15c9ff483a req-adb3788f-b548-4b99-a3b4-583e09dd4dad service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] No waiting events found dispatching network-vif-unplugged-48712489-c49e-4e52-9c79-fc1a1aa13077 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:17:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-b5f34649-3e4f-483e-8d64-de15c9ff483a req-adb3788f-b548-4b99-a3b4-583e09dd4dad service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Received event network-vif-unplugged-48712489-c49e-4e52-9c79-fc1a1aa13077 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:17:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-b5f34649-3e4f-483e-8d64-de15c9ff483a req-adb3788f-b548-4b99-a3b4-583e09dd4dad service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Received event network-vif-plugged-48712489-c49e-4e52-9c79-fc1a1aa13077 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5f34649-3e4f-483e-8d64-de15c9ff483a req-adb3788f-b548-4b99-a3b4-583e09dd4dad service nova] Acquiring lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5f34649-3e4f-483e-8d64-de15c9ff483a req-adb3788f-b548-4b99-a3b4-583e09dd4dad service nova] Lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5f34649-3e4f-483e-8d64-de15c9ff483a req-adb3788f-b548-4b99-a3b4-583e09dd4dad service nova] Lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-b5f34649-3e4f-483e-8d64-de15c9ff483a req-adb3788f-b548-4b99-a3b4-583e09dd4dad service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] No waiting events found dispatching network-vif-plugged-48712489-c49e-4e52-9c79-fc1a1aa13077 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:17:45 user nova-compute[74805]: WARNING nova.compute.manager [req-b5f34649-3e4f-483e-8d64-de15c9ff483a req-adb3788f-b548-4b99-a3b4-583e09dd4dad service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Received unexpected event network-vif-plugged-48712489-c49e-4e52-9c79-fc1a1aa13077 for instance with vm_state active and task_state deleting.
Nov 15 04:17:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-b5f34649-3e4f-483e-8d64-de15c9ff483a req-adb3788f-b548-4b99-a3b4-583e09dd4dad service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Received event network-vif-plugged-48712489-c49e-4e52-9c79-fc1a1aa13077 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5f34649-3e4f-483e-8d64-de15c9ff483a req-adb3788f-b548-4b99-a3b4-583e09dd4dad service nova] Acquiring lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5f34649-3e4f-483e-8d64-de15c9ff483a req-adb3788f-b548-4b99-a3b4-583e09dd4dad service nova] Lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5f34649-3e4f-483e-8d64-de15c9ff483a req-adb3788f-b548-4b99-a3b4-583e09dd4dad service nova] Lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-b5f34649-3e4f-483e-8d64-de15c9ff483a req-adb3788f-b548-4b99-a3b4-583e09dd4dad service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] No waiting events found dispatching network-vif-plugged-48712489-c49e-4e52-9c79-fc1a1aa13077 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:17:45 user nova-compute[74805]: WARNING nova.compute.manager [req-b5f34649-3e4f-483e-8d64-de15c9ff483a req-adb3788f-b548-4b99-a3b4-583e09dd4dad service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Received unexpected event network-vif-plugged-48712489-c49e-4e52-9c79-fc1a1aa13077 for instance with vm_state active and task_state deleting.
Nov 15 04:17:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-b5f34649-3e4f-483e-8d64-de15c9ff483a req-adb3788f-b548-4b99-a3b4-583e09dd4dad service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Received event network-vif-plugged-48712489-c49e-4e52-9c79-fc1a1aa13077 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5f34649-3e4f-483e-8d64-de15c9ff483a req-adb3788f-b548-4b99-a3b4-583e09dd4dad service nova] Acquiring lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5f34649-3e4f-483e-8d64-de15c9ff483a req-adb3788f-b548-4b99-a3b4-583e09dd4dad service nova] Lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5f34649-3e4f-483e-8d64-de15c9ff483a req-adb3788f-b548-4b99-a3b4-583e09dd4dad service nova] Lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-b5f34649-3e4f-483e-8d64-de15c9ff483a req-adb3788f-b548-4b99-a3b4-583e09dd4dad service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] No waiting events found dispatching network-vif-plugged-48712489-c49e-4e52-9c79-fc1a1aa13077 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:17:45 user nova-compute[74805]: WARNING nova.compute.manager [req-b5f34649-3e4f-483e-8d64-de15c9ff483a req-adb3788f-b548-4b99-a3b4-583e09dd4dad service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Received unexpected event network-vif-plugged-48712489-c49e-4e52-9c79-fc1a1aa13077 for instance with vm_state active and task_state deleting.
Nov 15 04:17:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:45 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:17:45 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Took 0.54 seconds to deallocate network for instance.
Nov 15 04:17:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-07905b7b-1820-4725-adfc-fbc050674888 req-402192b8-db87-4096-9530-66cb78bac3d9 service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Received event network-vif-deleted-48712489-c49e-4e52-9c79-fc1a1aa13077 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:45 user nova-compute[74805]: INFO nova.compute.manager [req-07905b7b-1820-4725-adfc-fbc050674888 req-402192b8-db87-4096-9530-66cb78bac3d9 service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Neutron deleted interface 48712489-c49e-4e52-9c79-fc1a1aa13077; detaching it from the instance and deleting it from the info cache
Nov 15 04:17:45 user nova-compute[74805]: DEBUG nova.network.neutron [req-07905b7b-1820-4725-adfc-fbc050674888 req-402192b8-db87-4096-9530-66cb78bac3d9 service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:17:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-07905b7b-1820-4725-adfc-fbc050674888 req-402192b8-db87-4096-9530-66cb78bac3d9 service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Detach interface failed, port_id=48712489-c49e-4e52-9c79-fc1a1aa13077, reason: Instance 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff could not be found. {{(pid=74805) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 04:17:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f8a61306-326d-41ed-b669-9d511d50d425 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f8a61306-326d-41ed-b669-9d511d50d425 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:45 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-f8a61306-326d-41ed-b669-9d511d50d425 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:17:45 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-f8a61306-326d-41ed-b669-9d511d50d425 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:17:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f8a61306-326d-41ed-b669-9d511d50d425 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.406s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:45 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-f8a61306-326d-41ed-b669-9d511d50d425 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Deleted allocations for instance 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff
Nov 15 04:17:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f8a61306-326d-41ed-b669-9d511d50d425 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.892s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:47 user nova-compute[74805]: DEBUG nova.compute.manager [req-5fbc24d7-c4aa-4173-97f5-9b4104bf14af req-2384f716-fa93-4a03-87f6-5ce343dd9b3e service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Received event network-vif-unplugged-48712489-c49e-4e52-9c79-fc1a1aa13077 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5fbc24d7-c4aa-4173-97f5-9b4104bf14af req-2384f716-fa93-4a03-87f6-5ce343dd9b3e service nova] Acquiring lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5fbc24d7-c4aa-4173-97f5-9b4104bf14af req-2384f716-fa93-4a03-87f6-5ce343dd9b3e service nova] Lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5fbc24d7-c4aa-4173-97f5-9b4104bf14af req-2384f716-fa93-4a03-87f6-5ce343dd9b3e service nova] Lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:47 user nova-compute[74805]: DEBUG nova.compute.manager [req-5fbc24d7-c4aa-4173-97f5-9b4104bf14af req-2384f716-fa93-4a03-87f6-5ce343dd9b3e service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] No waiting events found dispatching network-vif-unplugged-48712489-c49e-4e52-9c79-fc1a1aa13077 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:17:47 user nova-compute[74805]: WARNING nova.compute.manager [req-5fbc24d7-c4aa-4173-97f5-9b4104bf14af req-2384f716-fa93-4a03-87f6-5ce343dd9b3e service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Received unexpected event network-vif-unplugged-48712489-c49e-4e52-9c79-fc1a1aa13077 for instance with vm_state deleted and task_state None.
Nov 15 04:17:47 user nova-compute[74805]: DEBUG nova.compute.manager [req-5fbc24d7-c4aa-4173-97f5-9b4104bf14af req-2384f716-fa93-4a03-87f6-5ce343dd9b3e service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Received event network-vif-plugged-48712489-c49e-4e52-9c79-fc1a1aa13077 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5fbc24d7-c4aa-4173-97f5-9b4104bf14af req-2384f716-fa93-4a03-87f6-5ce343dd9b3e service nova] Acquiring lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5fbc24d7-c4aa-4173-97f5-9b4104bf14af req-2384f716-fa93-4a03-87f6-5ce343dd9b3e service nova] Lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5fbc24d7-c4aa-4173-97f5-9b4104bf14af req-2384f716-fa93-4a03-87f6-5ce343dd9b3e service nova] Lock "78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:47 user nova-compute[74805]: DEBUG nova.compute.manager [req-5fbc24d7-c4aa-4173-97f5-9b4104bf14af req-2384f716-fa93-4a03-87f6-5ce343dd9b3e service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] No waiting events found dispatching network-vif-plugged-48712489-c49e-4e52-9c79-fc1a1aa13077 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:17:47 user nova-compute[74805]: WARNING nova.compute.manager [req-5fbc24d7-c4aa-4173-97f5-9b4104bf14af req-2384f716-fa93-4a03-87f6-5ce343dd9b3e service nova] [instance: 78f11c5b-04ae-4ea9-9bd5-54fa2b28b3ff] Received unexpected event network-vif-plugged-48712489-c49e-4e52-9c79-fc1a1aa13077 for instance with vm_state deleted and task_state None.
Nov 15 04:17:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c8fbd19c-55c4-48de-a88c-0f66a6978b20 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Acquiring lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c8fbd19c-55c4-48de-a88c-0f66a6978b20 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c8fbd19c-55c4-48de-a88c-0f66a6978b20 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Acquiring lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c8fbd19c-55c4-48de-a88c-0f66a6978b20 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c8fbd19c-55c4-48de-a88c-0f66a6978b20 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:51 user nova-compute[74805]: INFO nova.compute.manager [None req-c8fbd19c-55c4-48de-a88c-0f66a6978b20 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Terminating instance
Nov 15 04:17:51 user nova-compute[74805]: DEBUG nova.compute.manager [None req-c8fbd19c-55c4-48de-a88c-0f66a6978b20 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b6b807c6-e225-4616-97c0-37ae5ab60486 tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Acquiring lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b6b807c6-e225-4616-97c0-37ae5ab60486 tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b6b807c6-e225-4616-97c0-37ae5ab60486 tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Acquiring lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b6b807c6-e225-4616-97c0-37ae5ab60486 tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b6b807c6-e225-4616-97c0-37ae5ab60486 tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:51 user nova-compute[74805]: INFO nova.compute.manager [None req-b6b807c6-e225-4616-97c0-37ae5ab60486 tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Terminating instance
Nov 15 04:17:51 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b6b807c6-e225-4616-97c0-37ae5ab60486 tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG nova.compute.manager [req-05494a98-7d4b-44ba-953b-c5ebb4e6afba req-04d9640b-e20e-4f20-b87e-135a0dcf2a97 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Received event network-vif-unplugged-51834a6c-a2bb-4135-b3b3-beb4e689e876 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-05494a98-7d4b-44ba-953b-c5ebb4e6afba req-04d9640b-e20e-4f20-b87e-135a0dcf2a97 service nova] Acquiring lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-05494a98-7d4b-44ba-953b-c5ebb4e6afba req-04d9640b-e20e-4f20-b87e-135a0dcf2a97 service nova] Lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-05494a98-7d4b-44ba-953b-c5ebb4e6afba req-04d9640b-e20e-4f20-b87e-135a0dcf2a97 service nova] Lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG nova.compute.manager [req-05494a98-7d4b-44ba-953b-c5ebb4e6afba req-04d9640b-e20e-4f20-b87e-135a0dcf2a97 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] No waiting events found dispatching network-vif-unplugged-51834a6c-a2bb-4135-b3b3-beb4e689e876 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG nova.compute.manager [req-05494a98-7d4b-44ba-953b-c5ebb4e6afba req-04d9640b-e20e-4f20-b87e-135a0dcf2a97 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Received event network-vif-unplugged-51834a6c-a2bb-4135-b3b3-beb4e689e876 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG nova.compute.manager [req-b79db06a-712a-4b2c-bc20-763bf276b0e6 req-3543b799-e03c-4faf-bb15-38500c53a477 service nova] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Received event network-vif-unplugged-88133a1b-c635-48f8-b84d-891f943b38f2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b79db06a-712a-4b2c-bc20-763bf276b0e6 req-3543b799-e03c-4faf-bb15-38500c53a477 service nova] Acquiring lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b79db06a-712a-4b2c-bc20-763bf276b0e6 req-3543b799-e03c-4faf-bb15-38500c53a477 service nova] Lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b79db06a-712a-4b2c-bc20-763bf276b0e6 req-3543b799-e03c-4faf-bb15-38500c53a477 service nova] Lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG nova.compute.manager [req-b79db06a-712a-4b2c-bc20-763bf276b0e6 req-3543b799-e03c-4faf-bb15-38500c53a477 service nova] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] No waiting events found dispatching network-vif-unplugged-88133a1b-c635-48f8-b84d-891f943b38f2 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG nova.compute.manager [req-b79db06a-712a-4b2c-bc20-763bf276b0e6 req-3543b799-e03c-4faf-bb15-38500c53a477 service nova] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Received event network-vif-unplugged-88133a1b-c635-48f8-b84d-891f943b38f2 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:52 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Instance destroyed successfully.
Nov 15 04:17:52 user nova-compute[74805]: DEBUG nova.objects.instance [None req-c8fbd19c-55c4-48de-a88c-0f66a6978b20 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lazy-loading 'resources' on Instance uuid 05f49324-4b7a-4cd4-ada5-9450b9bf1d70 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:17:52 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Instance destroyed successfully.
Nov 15 04:17:52 user nova-compute[74805]: DEBUG nova.objects.instance [None req-b6b807c6-e225-4616-97c0-37ae5ab60486 tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lazy-loading 'resources' on Instance uuid fdf3e90f-4fd8-4da4-a888-48c7a80fb209 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-c8fbd19c-55c4-48de-a88c-0f66a6978b20 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:14:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-175864182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-175864182',id=8,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqVjB/VXeAAXbcPR9EXCBQSbi0fxJNcG8/LYTw94OkTxRdq8BS1Qip4iGD0FJLZzAa8glLWaInjyzM+FwK314PVqp4xOkTB5SsVxL+0dMsk7No3KOKU2UWDKovL9DtDJQ==',key_name='tempest-keypair-792239620',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:14:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5fa2f59063040d9a58de745e87380a6',ramdisk_id='',reservation_id='r-it125hzz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-986558879',owner_user_name='tempest-TaggedAttachmentsTest-986558879-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:14:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6fca23f109447409a8f31b925071ca7',uuid=05f49324-4b7a-4cd4-ada5-9450b9bf1d70,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "address": "fa:16:3e:c4:ea:ce", "network": {"id": "faafe4eb-0b41-4c3a-bce5-3d65543bc634", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-431209234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5fa2f59063040d9a58de745e87380a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51834a6c-a2", "ovs_interfaceid": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-c8fbd19c-55c4-48de-a88c-0f66a6978b20 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Converting VIF {"id": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "address": "fa:16:3e:c4:ea:ce", "network": {"id": "faafe4eb-0b41-4c3a-bce5-3d65543bc634", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-431209234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5fa2f59063040d9a58de745e87380a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51834a6c-a2", "ovs_interfaceid": "51834a6c-a2bb-4135-b3b3-beb4e689e876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-c8fbd19c-55c4-48de-a88c-0f66a6978b20 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:ea:ce,bridge_name='br-int',has_traffic_filtering=True,id=51834a6c-a2bb-4135-b3b3-beb4e689e876,network=Network(faafe4eb-0b41-4c3a-bce5-3d65543bc634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51834a6c-a2') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG os_vif [None req-c8fbd19c-55c4-48de-a88c-0f66a6978b20 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:ea:ce,bridge_name='br-int',has_traffic_filtering=True,id=51834a6c-a2bb-4135-b3b3-beb4e689e876,network=Network(faafe4eb-0b41-4c3a-bce5-3d65543bc634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51834a6c-a2') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-b6b807c6-e225-4616-97c0-37ae5ab60486 tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-82558028',display_name='tempest-TestVolumeSwap-server-82558028',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-82558028',id=9,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdj0iY6WOn05o9jSVyj5DqblOKivlMowh4ipI5M3rq0VQ7A3SjCc5Og+2VaHGf+eoJ3GUfju1oHWs4wB45XQejYHEr5DOMxDhMt6yCWfc5CAAhiCl8OiH9GSPrsVH0Gcw==',key_name='tempest-keypair-1613958558',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:14:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='354b7353cecf4f7e8bd6fbc058dd15fc',ramdisk_id='',reservation_id='r-sub53257',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1057016380',owner_user_name='tempest-TestVolumeSwap-1057016380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:14:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4f7d19d481d452d9fbd4c7db2e7eb10',uuid=fdf3e90f-4fd8-4da4-a888-48c7a80fb209,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88133a1b-c635-48f8-b84d-891f943b38f2", "address": "fa:16:3e:bb:68:f4", "network": {"id": "e5fa9b51-eaad-4687-9ae5-01132e7768e0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-778141578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "354b7353cecf4f7e8bd6fbc058dd15fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88133a1b-c6", "ovs_interfaceid": "88133a1b-c635-48f8-b84d-891f943b38f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-b6b807c6-e225-4616-97c0-37ae5ab60486 tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Converting VIF {"id": "88133a1b-c635-48f8-b84d-891f943b38f2", "address": "fa:16:3e:bb:68:f4", "network": {"id": "e5fa9b51-eaad-4687-9ae5-01132e7768e0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-778141578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "354b7353cecf4f7e8bd6fbc058dd15fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88133a1b-c6", "ovs_interfaceid": "88133a1b-c635-48f8-b84d-891f943b38f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-b6b807c6-e225-4616-97c0-37ae5ab60486 tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:68:f4,bridge_name='br-int',has_traffic_filtering=True,id=88133a1b-c635-48f8-b84d-891f943b38f2,network=Network(e5fa9b51-eaad-4687-9ae5-01132e7768e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88133a1b-c6') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG os_vif [None req-b6b807c6-e225-4616-97c0-37ae5ab60486 tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:68:f4,bridge_name='br-int',has_traffic_filtering=True,id=88133a1b-c635-48f8-b84d-891f943b38f2,network=Network(e5fa9b51-eaad-4687-9ae5-01132e7768e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88133a1b-c6') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51834a6c-a2, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88133a1b-c6, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=31e21fdc-f8fe-43ca-ac96-9ef73d9c23ba) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d114250-09b6-4b69-bf22-ca8e875a2ad0) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:17:52 user nova-compute[74805]: INFO os_vif [None req-c8fbd19c-55c4-48de-a88c-0f66a6978b20 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:ea:ce,bridge_name='br-int',has_traffic_filtering=True,id=51834a6c-a2bb-4135-b3b3-beb4e689e876,network=Network(faafe4eb-0b41-4c3a-bce5-3d65543bc634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51834a6c-a2')
Nov 15 04:17:52 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-c8fbd19c-55c4-48de-a88c-0f66a6978b20 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Deleting instance files /opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70_del
Nov 15 04:17:52 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-c8fbd19c-55c4-48de-a88c-0f66a6978b20 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Deletion of /opt/stack/data/nova/instances/05f49324-4b7a-4cd4-ada5-9450b9bf1d70_del complete
Nov 15 04:17:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:17:52 user nova-compute[74805]: INFO os_vif [None req-b6b807c6-e225-4616-97c0-37ae5ab60486 tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:68:f4,bridge_name='br-int',has_traffic_filtering=True,id=88133a1b-c635-48f8-b84d-891f943b38f2,network=Network(e5fa9b51-eaad-4687-9ae5-01132e7768e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88133a1b-c6')
Nov 15 04:17:52 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-b6b807c6-e225-4616-97c0-37ae5ab60486 tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Deleting instance files /opt/stack/data/nova/instances/fdf3e90f-4fd8-4da4-a888-48c7a80fb209_del
Nov 15 04:17:52 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-b6b807c6-e225-4616-97c0-37ae5ab60486 tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Deletion of /opt/stack/data/nova/instances/fdf3e90f-4fd8-4da4-a888-48c7a80fb209_del complete
Nov 15 04:17:52 user nova-compute[74805]: INFO nova.compute.manager [None req-c8fbd19c-55c4-48de-a88c-0f66a6978b20 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 15 04:17:52 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-c8fbd19c-55c4-48de-a88c-0f66a6978b20 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:17:52 user nova-compute[74805]: INFO nova.compute.manager [None req-b6b807c6-e225-4616-97c0-37ae5ab60486 tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 15 04:17:52 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-b6b807c6-e225-4616-97c0-37ae5ab60486 tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:53 user nova-compute[74805]: DEBUG nova.compute.manager [req-b22424cd-cea2-44d2-a705-087655dbc575 req-f621fd0e-58c6-45b2-889e-4eb0cecfc897 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Received event network-vif-plugged-51834a6c-a2bb-4135-b3b3-beb4e689e876 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b22424cd-cea2-44d2-a705-087655dbc575 req-f621fd0e-58c6-45b2-889e-4eb0cecfc897 service nova] Acquiring lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b22424cd-cea2-44d2-a705-087655dbc575 req-f621fd0e-58c6-45b2-889e-4eb0cecfc897 service nova] Lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b22424cd-cea2-44d2-a705-087655dbc575 req-f621fd0e-58c6-45b2-889e-4eb0cecfc897 service nova] Lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:53 user nova-compute[74805]: DEBUG nova.compute.manager [req-b22424cd-cea2-44d2-a705-087655dbc575 req-f621fd0e-58c6-45b2-889e-4eb0cecfc897 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] No waiting events found dispatching network-vif-plugged-51834a6c-a2bb-4135-b3b3-beb4e689e876 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:17:53 user nova-compute[74805]: WARNING nova.compute.manager [req-b22424cd-cea2-44d2-a705-087655dbc575 req-f621fd0e-58c6-45b2-889e-4eb0cecfc897 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Received unexpected event network-vif-plugged-51834a6c-a2bb-4135-b3b3-beb4e689e876 for instance with vm_state active and task_state deleting.
Nov 15 04:17:53 user nova-compute[74805]: DEBUG nova.compute.manager [req-477bbef3-9085-4ae1-b3cf-700e49aead97 req-73aa190b-23da-472c-a012-93ae9176cd41 service nova] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Received event network-vif-plugged-88133a1b-c635-48f8-b84d-891f943b38f2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-477bbef3-9085-4ae1-b3cf-700e49aead97 req-73aa190b-23da-472c-a012-93ae9176cd41 service nova] Acquiring lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-477bbef3-9085-4ae1-b3cf-700e49aead97 req-73aa190b-23da-472c-a012-93ae9176cd41 service nova] Lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-477bbef3-9085-4ae1-b3cf-700e49aead97 req-73aa190b-23da-472c-a012-93ae9176cd41 service nova] Lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:53 user nova-compute[74805]: DEBUG nova.compute.manager [req-477bbef3-9085-4ae1-b3cf-700e49aead97 req-73aa190b-23da-472c-a012-93ae9176cd41 service nova] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] No waiting events found dispatching network-vif-plugged-88133a1b-c635-48f8-b84d-891f943b38f2 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:17:53 user nova-compute[74805]: WARNING nova.compute.manager [req-477bbef3-9085-4ae1-b3cf-700e49aead97 req-73aa190b-23da-472c-a012-93ae9176cd41 service nova] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Received unexpected event network-vif-plugged-88133a1b-c635-48f8-b84d-891f943b38f2 for instance with vm_state active and task_state deleting.
Nov 15 04:17:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquiring lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:53 user nova-compute[74805]: DEBUG nova.objects.instance [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lazy-loading 'flavor' on Instance uuid 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:17:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Acquiring lock "0de78a8a-d66a-4703-a044-89c2f2006860" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "0de78a8a-d66a-4703-a044-89c2f2006860" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG nova.objects.instance [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lazy-loading 'flavor' on Instance uuid 0de78a8a-d66a-4703-a044-89c2f2006860 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "0de78a8a-d66a-4703-a044-89c2f2006860" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquiring lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:54 user nova-compute[74805]: INFO nova.compute.manager [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Attaching volume 7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 to /dev/vdb
Nov 15 04:17:54 user nova-compute[74805]: DEBUG os_brick.utils [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[390b235f-b9bb-418a-a458-905de768b0e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.037s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4febf7-d8a4-448e-8bbc-42d2ee7ce36f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9193eb2-380e-4307-b2fc-5859240d6fcd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[74466ee8-0da4-4ece-8a2d-354a29782861]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:17:54 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5955500b-ef22-43a5-905d-6948ae4bf4ca]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG os_brick.utils [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] <== get_connector_properties: return (184ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Updating existing volume attachment record: 663949ed-3203-4c54-af98-3d09aa46f657 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Acquiring lock "0de78a8a-d66a-4703-a044-89c2f2006860" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "0de78a8a-d66a-4703-a044-89c2f2006860" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:54 user nova-compute[74805]: INFO nova.compute.manager [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Attaching volume e8b620f1-dd0d-423d-bcfe-927abccb9402 to /dev/vdb
Nov 15 04:17:54 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:17:54 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Took 2.05 seconds to deallocate network for instance.
Nov 15 04:17:54 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Took 2.05 seconds to deallocate network for instance.
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c8fbd19c-55c4-48de-a88c-0f66a6978b20 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c8fbd19c-55c4-48de-a88c-0f66a6978b20 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG os_brick.utils [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb5f41d-1818-47a8-958a-6f9ea2de8fe5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b6b807c6-e225-4616-97c0-37ae5ab60486 tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1c261a-3adf-4496-a788-6d6f60109398]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[21446be2-987d-4885-aeb2-ae567ffa3bba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd743856-075f-4cf0-9afa-5cb12b04803c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:17:54 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:17:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b707134-03f6-4b8c-a735-ad6d27dcf467]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG os_brick.utils [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Updating existing volume attachment record: 56e89167-1589-40c6-bbd3-3c2e1c19adf1 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-c8fbd19c-55c4-48de-a88c-0f66a6978b20 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:17:54 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-c8fbd19c-55c4-48de-a88c-0f66a6978b20 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:17:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c8fbd19c-55c4-48de-a88c-0f66a6978b20 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.482s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b6b807c6-e225-4616-97c0-37ae5ab60486 tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.456s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:55 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-c8fbd19c-55c4-48de-a88c-0f66a6978b20 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Deleted allocations for instance 05f49324-4b7a-4cd4-ada5-9450b9bf1d70
Nov 15 04:17:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c8fbd19c-55c4-48de-a88c-0f66a6978b20 tempest-TaggedAttachmentsTest-986558879 tempest-TaggedAttachmentsTest-986558879-project-member] Lock "05f49324-4b7a-4cd4-ada5-9450b9bf1d70" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.084s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:55 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-b6b807c6-e225-4616-97c0-37ae5ab60486 tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:17:55 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-b6b807c6-e225-4616-97c0-37ae5ab60486 tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:17:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b6b807c6-e225-4616-97c0-37ae5ab60486 tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:55 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-b6b807c6-e225-4616-97c0-37ae5ab60486 tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Deleted allocations for instance fdf3e90f-4fd8-4da4-a888-48c7a80fb209
Nov 15 04:17:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b6b807c6-e225-4616-97c0-37ae5ab60486 tempest-TestVolumeSwap-1057016380 tempest-TestVolumeSwap-1057016380-project-member] Lock "fdf3e90f-4fd8-4da4-a888-48c7a80fb209" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.344s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:55 user nova-compute[74805]: DEBUG nova.compute.manager [req-67def677-ad28-4a49-9c6f-de60702804c1 req-6c3a346a-c2f6-4176-ab69-1d6d2e7cb455 service nova] [instance: 05f49324-4b7a-4cd4-ada5-9450b9bf1d70] Received event network-vif-deleted-51834a6c-a2bb-4135-b3b3-beb4e689e876 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:55 user nova-compute[74805]: DEBUG nova.compute.manager [req-67def677-ad28-4a49-9c6f-de60702804c1 req-6c3a346a-c2f6-4176-ab69-1d6d2e7cb455 service nova] [instance: fdf3e90f-4fd8-4da4-a888-48c7a80fb209] Received event network-vif-deleted-88133a1b-c635-48f8-b84d-891f943b38f2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "51e0a627-f95e-4347-92a7-4a218413e884" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "51e0a627-f95e-4347-92a7-4a218413e884" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:56 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:17:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:57 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:17:57 user nova-compute[74805]: INFO nova.compute.claims [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Claim successful on node user
Nov 15 04:17:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:57 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:17:57 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:17:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:57 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:17:57 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:17:57 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:17:57 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:17:57 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:17:57 user nova-compute[74805]: DEBUG nova.policy [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0b6a8eff61f4d6ba2e83d7939143112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcdb40f067540dab36661ea0586f1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:17:57 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:17:57 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:17:57 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Creating image(s)
Nov 15 04:17:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "/opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "/opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "/opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.223s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.199s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk 1073741824" returned: 0 in 0.046s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:58 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Successfully created port: 62730abb-e77d-4e27-8e57-929086b708e3 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:17:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.203s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:58 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Checking if we can resize image /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:17:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:58 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Cannot resize image /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:17:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:17:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Ensure instance console log exists: /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:17:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:17:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:17:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:17:58 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Successfully updated port: 62730abb-e77d-4e27-8e57-929086b708e3 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "refresh_cache-51e0a627-f95e-4347-92a7-4a218413e884" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquired lock "refresh_cache-51e0a627-f95e-4347-92a7-4a218413e884" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.compute.manager [req-c5b54edc-cbd8-4869-8d85-d50abe29050a req-f2110d19-4c49-48d7-8267-54641335b1c7 service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Received event network-changed-62730abb-e77d-4e27-8e57-929086b708e3 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.compute.manager [req-c5b54edc-cbd8-4869-8d85-d50abe29050a req-f2110d19-4c49-48d7-8267-54641335b1c7 service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Refreshing instance network info cache due to event network-changed-62730abb-e77d-4e27-8e57-929086b708e3. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c5b54edc-cbd8-4869-8d85-d50abe29050a req-f2110d19-4c49-48d7-8267-54641335b1c7 service nova] Acquiring lock "refresh_cache-51e0a627-f95e-4347-92a7-4a218413e884" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Updating instance_info_cache with network_info: [{"id": "62730abb-e77d-4e27-8e57-929086b708e3", "address": "fa:16:3e:b0:20:4f", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62730abb-e7", "ovs_interfaceid": "62730abb-e77d-4e27-8e57-929086b708e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Releasing lock "refresh_cache-51e0a627-f95e-4347-92a7-4a218413e884" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Instance network_info: |[{"id": "62730abb-e77d-4e27-8e57-929086b708e3", "address": "fa:16:3e:b0:20:4f", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62730abb-e7", "ovs_interfaceid": "62730abb-e77d-4e27-8e57-929086b708e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c5b54edc-cbd8-4869-8d85-d50abe29050a req-f2110d19-4c49-48d7-8267-54641335b1c7 service nova] Acquired lock "refresh_cache-51e0a627-f95e-4347-92a7-4a218413e884" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.network.neutron [req-c5b54edc-cbd8-4869-8d85-d50abe29050a req-f2110d19-4c49-48d7-8267-54641335b1c7 service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Refreshing network info cache for port 62730abb-e77d-4e27-8e57-929086b708e3 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Start _get_guest_xml network_info=[{"id": "62730abb-e77d-4e27-8e57-929086b708e3", "address": "fa:16:3e:b0:20:4f", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62730abb-e7", "ovs_interfaceid": "62730abb-e77d-4e27-8e57-929086b708e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:17:59 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:17:59 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1880386667',display_name='tempest-tempest.common.compute-instance-1880386667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1880386667',id=16,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNL2QOXLXk1x9TsxLURUmSVRJaTx/RlWkfU3Js5N8CQyrY9MmbOAU4o8C49ofySnmFHbhPtn/D/NU/tAJtyE07dTKcQEk2x0+rT7NunvFZegFW77bWCq6V++KJvKeWIEWg==',key_name='tempest-keypair-86981041',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dcdb40f067540dab36661ea0586f1d5',ramdisk_id='',reservation_id='r-a6zdjf19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1623992712',owner_user_name='tempest-ServerActionsTestOtherA-1623992712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b6a8eff61f4d6ba2e83d7939143112',uuid=51e0a627-f95e-4347-92a7-4a218413e884,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62730abb-e77d-4e27-8e57-929086b708e3", "address": "fa:16:3e:b0:20:4f", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62730abb-e7", "ovs_interfaceid": "62730abb-e77d-4e27-8e57-929086b708e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converting VIF {"id": "62730abb-e77d-4e27-8e57-929086b708e3", "address": "fa:16:3e:b0:20:4f", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62730abb-e7", "ovs_interfaceid": "62730abb-e77d-4e27-8e57-929086b708e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:20:4f,bridge_name='br-int',has_traffic_filtering=True,id=62730abb-e77d-4e27-8e57-929086b708e3,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62730abb-e7') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.objects.instance [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lazy-loading 'pci_devices' on Instance uuid 51e0a627-f95e-4347-92a7-4a218413e884 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:17:59 user nova-compute[74805]:   <uuid>51e0a627-f95e-4347-92a7-4a218413e884</uuid>
Nov 15 04:17:59 user nova-compute[74805]:   <name>instance-00000010</name>
Nov 15 04:17:59 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:17:59 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:17:59 user nova-compute[74805]:   <metadata>
Nov 15 04:17:59 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:17:59 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:17:59 user nova-compute[74805]:       <nova:name>tempest-tempest.common.compute-instance-1880386667</nova:name>
Nov 15 04:17:59 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:17:59</nova:creationTime>
Nov 15 04:17:59 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:17:59 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:17:59 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:17:59 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:17:59 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:17:59 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:17:59 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:17:59 user nova-compute[74805]:       <nova:owner>
Nov 15 04:17:59 user nova-compute[74805]:         <nova:user uuid="d0b6a8eff61f4d6ba2e83d7939143112">tempest-ServerActionsTestOtherA-1623992712-project-member</nova:user>
Nov 15 04:17:59 user nova-compute[74805]:         <nova:project uuid="6dcdb40f067540dab36661ea0586f1d5">tempest-ServerActionsTestOtherA-1623992712</nova:project>
Nov 15 04:17:59 user nova-compute[74805]:       </nova:owner>
Nov 15 04:17:59 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:17:59 user nova-compute[74805]:       <nova:ports>
Nov 15 04:17:59 user nova-compute[74805]:         <nova:port uuid="62730abb-e77d-4e27-8e57-929086b708e3">
Nov 15 04:17:59 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 04:17:59 user nova-compute[74805]:         </nova:port>
Nov 15 04:17:59 user nova-compute[74805]:       </nova:ports>
Nov 15 04:17:59 user nova-compute[74805]:     </nova:instance>
Nov 15 04:17:59 user nova-compute[74805]:   </metadata>
Nov 15 04:17:59 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:17:59 user nova-compute[74805]:     <system>
Nov 15 04:17:59 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:17:59 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:17:59 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:17:59 user nova-compute[74805]:       <entry name="serial">51e0a627-f95e-4347-92a7-4a218413e884</entry>
Nov 15 04:17:59 user nova-compute[74805]:       <entry name="uuid">51e0a627-f95e-4347-92a7-4a218413e884</entry>
Nov 15 04:17:59 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:17:59 user nova-compute[74805]:     </system>
Nov 15 04:17:59 user nova-compute[74805]:   </sysinfo>
Nov 15 04:17:59 user nova-compute[74805]:   <os>
Nov 15 04:17:59 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:17:59 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:17:59 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:17:59 user nova-compute[74805]:   </os>
Nov 15 04:17:59 user nova-compute[74805]:   <features>
Nov 15 04:17:59 user nova-compute[74805]:     <acpi/>
Nov 15 04:17:59 user nova-compute[74805]:     <apic/>
Nov 15 04:17:59 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:17:59 user nova-compute[74805]:   </features>
Nov 15 04:17:59 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:17:59 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:17:59 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:17:59 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:17:59 user nova-compute[74805]:   </clock>
Nov 15 04:17:59 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:17:59 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:17:59 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:17:59 user nova-compute[74805]:   </cpu>
Nov 15 04:17:59 user nova-compute[74805]:   <devices>
Nov 15 04:17:59 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:17:59 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:17:59 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk"/>
Nov 15 04:17:59 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:17:59 user nova-compute[74805]:     </disk>
Nov 15 04:17:59 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:17:59 user nova-compute[74805]:       <mac address="fa:16:3e:b0:20:4f"/>
Nov 15 04:17:59 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:17:59 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:17:59 user nova-compute[74805]:       <target dev="tap62730abb-e7"/>
Nov 15 04:17:59 user nova-compute[74805]:     </interface>
Nov 15 04:17:59 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:17:59 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/console.log" append="off"/>
Nov 15 04:17:59 user nova-compute[74805]:     </serial>
Nov 15 04:17:59 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:17:59 user nova-compute[74805]:     <video>
Nov 15 04:17:59 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:17:59 user nova-compute[74805]:     </video>
Nov 15 04:17:59 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:17:59 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:17:59 user nova-compute[74805]:     </rng>
Nov 15 04:17:59 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:17:59 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:17:59 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:17:59 user nova-compute[74805]:     </memballoon>
Nov 15 04:17:59 user nova-compute[74805]:   </devices>
Nov 15 04:17:59 user nova-compute[74805]: </domain>
Nov 15 04:17:59 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1880386667',display_name='tempest-tempest.common.compute-instance-1880386667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1880386667',id=16,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNL2QOXLXk1x9TsxLURUmSVRJaTx/RlWkfU3Js5N8CQyrY9MmbOAU4o8C49ofySnmFHbhPtn/D/NU/tAJtyE07dTKcQEk2x0+rT7NunvFZegFW77bWCq6V++KJvKeWIEWg==',key_name='tempest-keypair-86981041',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dcdb40f067540dab36661ea0586f1d5',ramdisk_id='',reservation_id='r-a6zdjf19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1623992712',owner_user_name='tempest-ServerActionsTestOtherA-1623992712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b6a8eff61f4d6ba2e83d7939143112',uuid=51e0a627-f95e-4347-92a7-4a218413e884,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62730abb-e77d-4e27-8e57-929086b708e3", "address": "fa:16:3e:b0:20:4f", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62730abb-e7", "ovs_interfaceid": "62730abb-e77d-4e27-8e57-929086b708e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converting VIF {"id": "62730abb-e77d-4e27-8e57-929086b708e3", "address": "fa:16:3e:b0:20:4f", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62730abb-e7", "ovs_interfaceid": "62730abb-e77d-4e27-8e57-929086b708e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:20:4f,bridge_name='br-int',has_traffic_filtering=True,id=62730abb-e77d-4e27-8e57-929086b708e3,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62730abb-e7') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG os_vif [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:20:4f,bridge_name='br-int',has_traffic_filtering=True,id=62730abb-e77d-4e27-8e57-929086b708e3,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62730abb-e7') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fff8e90c-2f3f-5f50-b024-55c87472e398', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62730abb-e7, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap62730abb-e7, col_values=(('qos', UUID('dfcc3e09-36ce-4553-964c-01b7ed9a711c')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap62730abb-e7, col_values=(('external_ids', {'iface-id': '62730abb-e77d-4e27-8e57-929086b708e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:20:4f', 'vm-uuid': '51e0a627-f95e-4347-92a7-4a218413e884'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:59 user nova-compute[74805]: INFO os_vif [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:20:4f,bridge_name='br-int',has_traffic_filtering=True,id=62730abb-e77d-4e27-8e57-929086b708e3,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62730abb-e7')
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] No VIF found with MAC fa:16:3e:b0:20:4f, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'biAZqcTu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:17:59 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:17:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:17:59 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:17:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:17:59 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JXcSZyxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:17:59 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:17:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff62fd1-7cb3-4569-aff7-3e93500ceb2d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:17:59 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[13526484-0a43-481c-910d-fbbeb97fd3f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4] added
Nov 15 04:17:59 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.network.neutron [req-c5b54edc-cbd8-4869-8d85-d50abe29050a req-f2110d19-4c49-48d7-8267-54641335b1c7 service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Updated VIF entry in instance network info cache for port 62730abb-e77d-4e27-8e57-929086b708e3. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG nova.network.neutron [req-c5b54edc-cbd8-4869-8d85-d50abe29050a req-f2110d19-4c49-48d7-8267-54641335b1c7 service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Updating instance_info_cache with network_info: [{"id": "62730abb-e77d-4e27-8e57-929086b708e3", "address": "fa:16:3e:b0:20:4f", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62730abb-e7", "ovs_interfaceid": "62730abb-e77d-4e27-8e57-929086b708e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce87d0b3-fbb1-40af-b482-401d5e22a539]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c5b54edc-cbd8-4869-8d85-d50abe29050a req-f2110d19-4c49-48d7-8267-54641335b1c7 service nova] Releasing lock "refresh_cache-51e0a627-f95e-4347-92a7-4a218413e884" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cb5ab2-ff48-4ed7-b1b3-24d77d5ef265]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v biAZqcTu {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v biAZqcTu" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[548e9842-3e70-4f0d-80a8-f12515470303]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'biAZqcTu'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c0b4f1-fecd-4a40-9647-ad88d6b32d62]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c77cd0f-aa33-45cc-b411-a75fa67ad6ef]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:17:59 user nova-compute[74805]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:17:59 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:17:59 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:17:59 user nova-compute[74805]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:17:59 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:17:59 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2435de-c300-4b57-a3b4-4bdc6f6f31cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:17:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4, portal: 172.16.0.220,3260]
Nov 15 04:17:59 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4, portal: 172.16.0.220,3260] successful.
Nov 15 04:17:59 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:18:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.184s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e379c7-398c-42ba-941c-cf41281802e6]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:18:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d49502-b918-44ba-8c3c-54b2a1cfbda1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:18:00 user nova-compute[74805]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:18:00 user nova-compute[74805]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:18:00 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:18:00 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:18:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:18:00 user nova-compute[74805]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:18:00 user nova-compute[74805]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:18:00 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:18:00 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:18:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.442s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:18:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:18:00 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:18:00 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:18:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[02afc387-651e-4c7c-aafa-a4e4e7c925e2]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:00 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:18:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'biAZqcTu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:18:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG nova.compute.manager [req-054769b7-d2f0-41e4-b9d8-ef86e1992774 req-6a1d77f9-9f11-42c0-908b-94eecbef4d4b service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Received event network-vif-plugged-62730abb-e77d-4e27-8e57-929086b708e3 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-054769b7-d2f0-41e4-b9d8-ef86e1992774 req-6a1d77f9-9f11-42c0-908b-94eecbef4d4b service nova] Acquiring lock "51e0a627-f95e-4347-92a7-4a218413e884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-054769b7-d2f0-41e4-b9d8-ef86e1992774 req-6a1d77f9-9f11-42c0-908b-94eecbef4d4b service nova] Lock "51e0a627-f95e-4347-92a7-4a218413e884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-054769b7-d2f0-41e4-b9d8-ef86e1992774 req-6a1d77f9-9f11-42c0-908b-94eecbef4d4b service nova] Lock "51e0a627-f95e-4347-92a7-4a218413e884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG nova.compute.manager [req-054769b7-d2f0-41e4-b9d8-ef86e1992774 req-6a1d77f9-9f11-42c0-908b-94eecbef4d4b service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] No waiting events found dispatching network-vif-plugged-62730abb-e77d-4e27-8e57-929086b708e3 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:18:01 user nova-compute[74805]: WARNING nova.compute.manager [req-054769b7-d2f0-41e4-b9d8-ef86e1992774 req-6a1d77f9-9f11-42c0-908b-94eecbef4d4b service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Received unexpected event network-vif-plugged-62730abb-e77d-4e27-8e57-929086b708e3 for instance with vm_state building and task_state spawning.
Nov 15 04:18:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.473s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] <== connect_volume: return (1476ms) {'type': 'block', 'scsi_wwn': '23634376332343034', 'path': '/dev/sdd'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634376332343034', 'path': '/dev/sdd'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.452s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:18:01 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:18:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:18:01 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG nova.objects.instance [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lazy-loading 'flavor' on Instance uuid 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[96222527-83c5-47f1-a0d8-85522aaf7d2a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:18:01 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:18:01 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:18:01 user nova-compute[74805]:   <source dev="/dev/sdd"/>
Nov 15 04:18:01 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:18:01 user nova-compute[74805]:   <serial>7f3112d5-dcc8-4e6d-9601-30bc0d3243c4</serial>
Nov 15 04:18:01 user nova-compute[74805]: </disk>
Nov 15 04:18:01 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad54eb3f-fd0f-4777-a838-048aa087edab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402] added
Nov 15 04:18:01 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5501beb-2440-47dd-954e-ed171a097d40]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[310d7b2b-0ee5-4fcf-8050-8cb4d18407f6]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JXcSZyxl {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JXcSZyxl" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0ec29b-6fcc-420b-a967-7544951a032c]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JXcSZyxl'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f1045f-e476-4210-8524-15b7dfebfd8d]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[429411e6-9bea-44e2-9645-cd4950c87f46]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:18:01 user nova-compute[74805]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:18:01 user nova-compute[74805]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:18:01 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:18:01 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:18:01 user nova-compute[74805]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:18:01 user nova-compute[74805]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:18:01 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:18:01 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8750720a-09f0-489d-8943-7b7e327bf9cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402, portal: 172.16.0.220,3260]
Nov 15 04:18:01 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402, portal: 172.16.0.220,3260] successful.
Nov 15 04:18:01 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e80ac2c-9108-402b-80b9-b199379a8293]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[de547d07-4e19-43c7-9046-e11016bd5903]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:18:01 user nova-compute[74805]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:18:01 user nova-compute[74805]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:18:01 user nova-compute[74805]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:18:01 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:18:01 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:18:01 user nova-compute[74805]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:18:01 user nova-compute[74805]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:18:01 user nova-compute[74805]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:18:01 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:18:01 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e23ec5-6e55-4881-9bcc-e7005ba8f907]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JXcSZyxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] No VIF found with MAC fa:16:3e:28:e7:d1, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:18:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-e5c249c3-d93b-46c2-8770-5ea2dd124b52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.695s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:02 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:18:02 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:18:02 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:02 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:02 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:02 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:18:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:18:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] <== connect_volume: return (2797ms) {'type': 'block', 'scsi_wwn': '26434643665383333', 'path': '/dev/sde'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:18:02 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434643665383333', 'path': '/dev/sde'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:18:02 user nova-compute[74805]: DEBUG nova.objects.instance [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lazy-loading 'flavor' on Instance uuid 0de78a8a-d66a-4703-a044-89c2f2006860 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:18:02 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:18:02 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:18:02 user nova-compute[74805]:   <source dev="/dev/sde"/>
Nov 15 04:18:02 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:18:02 user nova-compute[74805]:   <serial>e8b620f1-dd0d-423d-bcfe-927abccb9402</serial>
Nov 15 04:18:02 user nova-compute[74805]: </disk>
Nov 15 04:18:02 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:18:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:18:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:18:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] No VIF found with MAC fa:16:3e:74:98:ab, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:18:03 user nova-compute[74805]: DEBUG nova.compute.manager [req-b5af317f-44a9-45ed-8279-b8857edf5ed4 req-e5309830-570b-427b-ad16-99c20aca2f97 service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Received event network-vif-plugged-62730abb-e77d-4e27-8e57-929086b708e3 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:18:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5af317f-44a9-45ed-8279-b8857edf5ed4 req-e5309830-570b-427b-ad16-99c20aca2f97 service nova] Acquiring lock "51e0a627-f95e-4347-92a7-4a218413e884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5af317f-44a9-45ed-8279-b8857edf5ed4 req-e5309830-570b-427b-ad16-99c20aca2f97 service nova] Lock "51e0a627-f95e-4347-92a7-4a218413e884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5af317f-44a9-45ed-8279-b8857edf5ed4 req-e5309830-570b-427b-ad16-99c20aca2f97 service nova] Lock "51e0a627-f95e-4347-92a7-4a218413e884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:03 user nova-compute[74805]: DEBUG nova.compute.manager [req-b5af317f-44a9-45ed-8279-b8857edf5ed4 req-e5309830-570b-427b-ad16-99c20aca2f97 service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] No waiting events found dispatching network-vif-plugged-62730abb-e77d-4e27-8e57-929086b708e3 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:18:03 user nova-compute[74805]: WARNING nova.compute.manager [req-b5af317f-44a9-45ed-8279-b8857edf5ed4 req-e5309830-570b-427b-ad16-99c20aca2f97 service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Received unexpected event network-vif-plugged-62730abb-e77d-4e27-8e57-929086b708e3 for instance with vm_state building and task_state spawning.
Nov 15 04:18:03 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:18:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:18:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:03 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Instance spawned successfully.
Nov 15 04:18:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:18:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:18:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:18:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:18:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:18:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:18:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:18:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-03cd37eb-a6b3-4222-a615-8d10a85408e1 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "0de78a8a-d66a-4703-a044-89c2f2006860" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.861s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:03 user nova-compute[74805]: INFO nova.compute.manager [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Took 5.70 seconds to spawn the instance on the hypervisor.
Nov 15 04:18:03 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:18:03 user nova-compute[74805]: INFO nova.compute.manager [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Took 6.45 seconds to build instance.
Nov 15 04:18:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d1418a3d-af54-4174-ada5-eae2451f90f3 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "51e0a627-f95e-4347-92a7-4a218413e884" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.548s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:18:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:18:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:04 user nova-compute[74805]: DEBUG nova.compute.manager [req-0c9d5151-6b50-4cbe-8ef0-d8f6de0da9ce req-f04609b5-4deb-46b5-b525-af50b91af379 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Received event network-changed-092376b3-85d5-46b7-a921-cd57d838df06 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:18:04 user nova-compute[74805]: DEBUG nova.compute.manager [req-0c9d5151-6b50-4cbe-8ef0-d8f6de0da9ce req-f04609b5-4deb-46b5-b525-af50b91af379 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Refreshing instance network info cache due to event network-changed-092376b3-85d5-46b7-a921-cd57d838df06. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:18:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0c9d5151-6b50-4cbe-8ef0-d8f6de0da9ce req-f04609b5-4deb-46b5-b525-af50b91af379 service nova] Acquiring lock "refresh_cache-b682db81-a837-49e6-818c-394dd4f1e3f4" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:18:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0c9d5151-6b50-4cbe-8ef0-d8f6de0da9ce req-f04609b5-4deb-46b5-b525-af50b91af379 service nova] Acquired lock "refresh_cache-b682db81-a837-49e6-818c-394dd4f1e3f4" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:18:04 user nova-compute[74805]: DEBUG nova.network.neutron [req-0c9d5151-6b50-4cbe-8ef0-d8f6de0da9ce req-f04609b5-4deb-46b5-b525-af50b91af379 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Refreshing network info cache for port 092376b3-85d5-46b7-a921-cd57d838df06 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:18:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b682db81-a837-49e6-818c-394dd4f1e3f4/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b682db81-a837-49e6-818c-394dd4f1e3f4/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b682db81-a837-49e6-818c-394dd4f1e3f4/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:04 user nova-compute[74805]: INFO nova.compute.manager [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Rescuing
Nov 15 04:18:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Acquiring lock "refresh_cache-0de78a8a-d66a-4703-a044-89c2f2006860" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:18:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Acquired lock "refresh_cache-0de78a8a-d66a-4703-a044-89c2f2006860" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:18:04 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:18:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-08f5cbca-252d-4cc7-b05b-cb65483f3a23 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "b682db81-a837-49e6-818c-394dd4f1e3f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-08f5cbca-252d-4cc7-b05b-cb65483f3a23 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "b682db81-a837-49e6-818c-394dd4f1e3f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-08f5cbca-252d-4cc7-b05b-cb65483f3a23 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "b682db81-a837-49e6-818c-394dd4f1e3f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-08f5cbca-252d-4cc7-b05b-cb65483f3a23 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "b682db81-a837-49e6-818c-394dd4f1e3f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-08f5cbca-252d-4cc7-b05b-cb65483f3a23 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "b682db81-a837-49e6-818c-394dd4f1e3f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:04 user nova-compute[74805]: INFO nova.compute.manager [None req-08f5cbca-252d-4cc7-b05b-cb65483f3a23 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Terminating instance
Nov 15 04:18:04 user nova-compute[74805]: DEBUG nova.compute.manager [None req-08f5cbca-252d-4cc7-b05b-cb65483f3a23 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:18:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b682db81-a837-49e6-818c-394dd4f1e3f4/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG nova.compute.manager [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Stashing vm_state: active {{(pid=74805) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:18:05 user nova-compute[74805]: INFO nova.compute.claims [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Claim successful on node user
Nov 15 04:18:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG nova.network.neutron [req-0c9d5151-6b50-4cbe-8ef0-d8f6de0da9ce req-f04609b5-4deb-46b5-b525-af50b91af379 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Updated VIF entry in instance network info cache for port 092376b3-85d5-46b7-a921-cd57d838df06. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG nova.network.neutron [req-0c9d5151-6b50-4cbe-8ef0-d8f6de0da9ce req-f04609b5-4deb-46b5-b525-af50b91af379 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Updating instance_info_cache with network_info: [{"id": "092376b3-85d5-46b7-a921-cd57d838df06", "address": "fa:16:3e:6d:7b:7f", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap092376b3-85", "ovs_interfaceid": "092376b3-85d5-46b7-a921-cd57d838df06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:18:05 user nova-compute[74805]: INFO nova.compute.resource_tracker [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Updating resource usage from migration 8aa43d18-f607-4bdb-b5be-aa341e5558b3
Nov 15 04:18:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0c9d5151-6b50-4cbe-8ef0-d8f6de0da9ce req-f04609b5-4deb-46b5-b525-af50b91af379 service nova] Releasing lock "refresh_cache-b682db81-a837-49e6-818c-394dd4f1e3f4" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:05 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Instance destroyed successfully.
Nov 15 04:18:05 user nova-compute[74805]: DEBUG nova.objects.instance [None req-08f5cbca-252d-4cc7-b05b-cb65483f3a23 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lazy-loading 'resources' on Instance uuid b682db81-a837-49e6-818c-394dd4f1e3f4 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-08f5cbca-252d-4cc7-b05b-cb65483f3a23 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:16:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1967639214',display_name='tempest-AttachVolumeNegativeTest-server-1967639214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1967639214',id=14,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAD8inV+r3gVRXN0Cd8G70zLtk1kuB0Ipis027As9LiSuppqbSB+V23mt+roCDHCJKPgF7spqMJTvP5XRBBFhTNRias9ua/cLg5EDWnWh8/IBDxiGX3vsfO2mKHu4urFrA==',key_name='tempest-keypair-271604757',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:16:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8280c6302b2e42998c7c436522c47e79',ramdisk_id='',reservation_id='r-jt5ewwus',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-6184130',owner_user_name='tempest-AttachVolumeNegativeTest-6184130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:16:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba1bcf1e429045129d379293cc490bde',uuid=b682db81-a837-49e6-818c-394dd4f1e3f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "092376b3-85d5-46b7-a921-cd57d838df06", "address": "fa:16:3e:6d:7b:7f", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap092376b3-85", "ovs_interfaceid": "092376b3-85d5-46b7-a921-cd57d838df06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-08f5cbca-252d-4cc7-b05b-cb65483f3a23 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Converting VIF {"id": "092376b3-85d5-46b7-a921-cd57d838df06", "address": "fa:16:3e:6d:7b:7f", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap092376b3-85", "ovs_interfaceid": "092376b3-85d5-46b7-a921-cd57d838df06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-08f5cbca-252d-4cc7-b05b-cb65483f3a23 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:7b:7f,bridge_name='br-int',has_traffic_filtering=True,id=092376b3-85d5-46b7-a921-cd57d838df06,network=Network(3454b4d8-1ff9-4f3c-9a93-499645affcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap092376b3-85') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG os_vif [None req-08f5cbca-252d-4cc7-b05b-cb65483f3a23 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:7b:7f,bridge_name='br-int',has_traffic_filtering=True,id=092376b3-85d5-46b7-a921-cd57d838df06,network=Network(3454b4d8-1ff9-4f3c-9a93-499645affcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap092376b3-85') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap092376b3-85, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0c03c7f7-178a-420e-9eea-cc016a952e65) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:18:05 user nova-compute[74805]: INFO os_vif [None req-08f5cbca-252d-4cc7-b05b-cb65483f3a23 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:7b:7f,bridge_name='br-int',has_traffic_filtering=True,id=092376b3-85d5-46b7-a921-cd57d838df06,network=Network(3454b4d8-1ff9-4f3c-9a93-499645affcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap092376b3-85')
Nov 15 04:18:05 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-08f5cbca-252d-4cc7-b05b-cb65483f3a23 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Deleting instance files /opt/stack/data/nova/instances/b682db81-a837-49e6-818c-394dd4f1e3f4_del
Nov 15 04:18:05 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-08f5cbca-252d-4cc7-b05b-cb65483f3a23 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Deletion of /opt/stack/data/nova/instances/b682db81-a837-49e6-818c-394dd4f1e3f4_del complete
Nov 15 04:18:05 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Updating instance_info_cache with network_info: [{"id": "9f426f7d-ce70-41ba-affa-652a4f62a571", "address": "fa:16:3e:74:98:ab", "network": {"id": "e6f9095e-b477-4654-9fb7-7322e7bb3b9d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1108878484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc936c67de2046ff82115c5ebdb8c844", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f426f7d-ce", "ovs_interfaceid": "9f426f7d-ce70-41ba-affa-652a4f62a571", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Releasing lock "refresh_cache-0de78a8a-d66a-4703-a044-89c2f2006860" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:05 user nova-compute[74805]: INFO nova.compute.manager [None req-08f5cbca-252d-4cc7-b05b-cb65483f3a23 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 15 04:18:05 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-08f5cbca-252d-4cc7-b05b-cb65483f3a23 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:18:05 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.976s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:06 user nova-compute[74805]: INFO nova.compute.manager [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Migrating
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:18:06 user nova-compute[74805]: INFO nova.compute.rpcapi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquiring lock "refresh_cache-39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquired lock "refresh_cache-39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG nova.network.neutron [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG nova.compute.manager [req-25a6c4ce-cda1-4289-85fe-77d5a5fd6224 req-701d9a15-34fc-41da-abaf-a2d62a6bea84 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Received event network-vif-unplugged-9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-25a6c4ce-cda1-4289-85fe-77d5a5fd6224 req-701d9a15-34fc-41da-abaf-a2d62a6bea84 service nova] Acquiring lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-25a6c4ce-cda1-4289-85fe-77d5a5fd6224 req-701d9a15-34fc-41da-abaf-a2d62a6bea84 service nova] Lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-25a6c4ce-cda1-4289-85fe-77d5a5fd6224 req-701d9a15-34fc-41da-abaf-a2d62a6bea84 service nova] Lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG nova.compute.manager [req-25a6c4ce-cda1-4289-85fe-77d5a5fd6224 req-701d9a15-34fc-41da-abaf-a2d62a6bea84 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] No waiting events found dispatching network-vif-unplugged-9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:18:06 user nova-compute[74805]: WARNING nova.compute.manager [req-25a6c4ce-cda1-4289-85fe-77d5a5fd6224 req-701d9a15-34fc-41da-abaf-a2d62a6bea84 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Received unexpected event network-vif-unplugged-9f426f7d-ce70-41ba-affa-652a4f62a571 for instance with vm_state active and task_state rescuing.
Nov 15 04:18:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG nova.compute.manager [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Received event network-vif-unplugged-092376b3-85d5-46b7-a921-cd57d838df06 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] Acquiring lock "b682db81-a837-49e6-818c-394dd4f1e3f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] Lock "b682db81-a837-49e6-818c-394dd4f1e3f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] Lock "b682db81-a837-49e6-818c-394dd4f1e3f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG nova.compute.manager [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] No waiting events found dispatching network-vif-unplugged-092376b3-85d5-46b7-a921-cd57d838df06 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG nova.compute.manager [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Received event network-vif-unplugged-092376b3-85d5-46b7-a921-cd57d838df06 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG nova.compute.manager [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Received event network-vif-plugged-092376b3-85d5-46b7-a921-cd57d838df06 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] Acquiring lock "b682db81-a837-49e6-818c-394dd4f1e3f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] Lock "b682db81-a837-49e6-818c-394dd4f1e3f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] Lock "b682db81-a837-49e6-818c-394dd4f1e3f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG nova.compute.manager [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] No waiting events found dispatching network-vif-plugged-092376b3-85d5-46b7-a921-cd57d838df06 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:18:06 user nova-compute[74805]: WARNING nova.compute.manager [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Received unexpected event network-vif-plugged-092376b3-85d5-46b7-a921-cd57d838df06 for instance with vm_state active and task_state deleting.
Nov 15 04:18:06 user nova-compute[74805]: DEBUG nova.compute.manager [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Received event network-vif-plugged-092376b3-85d5-46b7-a921-cd57d838df06 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] Acquiring lock "b682db81-a837-49e6-818c-394dd4f1e3f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] Lock "b682db81-a837-49e6-818c-394dd4f1e3f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] Lock "b682db81-a837-49e6-818c-394dd4f1e3f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG nova.compute.manager [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] No waiting events found dispatching network-vif-plugged-092376b3-85d5-46b7-a921-cd57d838df06 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:18:06 user nova-compute[74805]: WARNING nova.compute.manager [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Received unexpected event network-vif-plugged-092376b3-85d5-46b7-a921-cd57d838df06 for instance with vm_state active and task_state deleting.
Nov 15 04:18:06 user nova-compute[74805]: DEBUG nova.compute.manager [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Received event network-vif-plugged-092376b3-85d5-46b7-a921-cd57d838df06 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] Acquiring lock "b682db81-a837-49e6-818c-394dd4f1e3f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] Lock "b682db81-a837-49e6-818c-394dd4f1e3f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] Lock "b682db81-a837-49e6-818c-394dd4f1e3f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG nova.compute.manager [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] No waiting events found dispatching network-vif-plugged-092376b3-85d5-46b7-a921-cd57d838df06 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:18:06 user nova-compute[74805]: WARNING nova.compute.manager [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Received unexpected event network-vif-plugged-092376b3-85d5-46b7-a921-cd57d838df06 for instance with vm_state active and task_state deleting.
Nov 15 04:18:06 user nova-compute[74805]: DEBUG nova.compute.manager [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Received event network-vif-unplugged-092376b3-85d5-46b7-a921-cd57d838df06 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] Acquiring lock "b682db81-a837-49e6-818c-394dd4f1e3f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] Lock "b682db81-a837-49e6-818c-394dd4f1e3f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] Lock "b682db81-a837-49e6-818c-394dd4f1e3f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG nova.compute.manager [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] No waiting events found dispatching network-vif-unplugged-092376b3-85d5-46b7-a921-cd57d838df06 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG nova.compute.manager [req-6aa9ed4e-b512-4a57-839d-d2b5649dd697 req-73e06b57-2f61-42ae-b7d5-0dad9fe69c63 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Received event network-vif-unplugged-092376b3-85d5-46b7-a921-cd57d838df06 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:06 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Instance destroyed successfully.
Nov 15 04:18:06 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Attempting a stable device rescue
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74805) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Instance directory exists: not creating {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 04:18:06 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Creating image(s)
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Acquiring lock "/opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "/opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "/opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG nova.objects.instance [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0de78a8a-d66a-4703-a044-89c2f2006860 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Acquiring lock "f041c4f3b6b7c2ea1e905263f0f77ea614dc02c8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "f041c4f3b6b7c2ea1e905263f0f77ea614dc02c8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f041c4f3b6b7c2ea1e905263f0f77ea614dc02c8.part --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:08 user nova-compute[74805]: DEBUG nova.network.neutron [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Updating instance_info_cache with network_info: [{"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:18:08 user nova-compute[74805]: DEBUG nova.compute.manager [req-a3ed11b3-aae5-46c9-b0c6-6df9428c087a req-8f8bfb26-4762-4f9d-9e1e-a3e8c5c9c109 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Received event network-vif-deleted-092376b3-85d5-46b7-a921-cd57d838df06 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:18:08 user nova-compute[74805]: INFO nova.compute.manager [req-a3ed11b3-aae5-46c9-b0c6-6df9428c087a req-8f8bfb26-4762-4f9d-9e1e-a3e8c5c9c109 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Neutron deleted interface 092376b3-85d5-46b7-a921-cd57d838df06; detaching it from the instance and deleting it from the info cache
Nov 15 04:18:08 user nova-compute[74805]: DEBUG nova.network.neutron [req-a3ed11b3-aae5-46c9-b0c6-6df9428c087a req-8f8bfb26-4762-4f9d-9e1e-a3e8c5c9c109 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:18:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json" returned: 0 in 1.301s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:08 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:18:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Releasing lock "refresh_cache-39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:18:08 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Took 2.24 seconds to deallocate network for instance.
Nov 15 04:18:08 user nova-compute[74805]: DEBUG nova.compute.manager [req-a3ed11b3-aae5-46c9-b0c6-6df9428c087a req-8f8bfb26-4762-4f9d-9e1e-a3e8c5c9c109 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Detach interface failed, port_id=092376b3-85d5-46b7-a921-cd57d838df06, reason: Instance b682db81-a837-49e6-818c-394dd4f1e3f4 could not be found. {{(pid=74805) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 04:18:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-08f5cbca-252d-4cc7-b05b-cb65483f3a23 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-08f5cbca-252d-4cc7-b05b-cb65483f3a23 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f041c4f3b6b7c2ea1e905263f0f77ea614dc02c8.part --force-share --output=json" returned: 0 in 0.199s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:08 user nova-compute[74805]: DEBUG nova.virt.images [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] 5399f8b1-a5bd-43ea-8343-dd472561ec94 was qcow2, converting to raw {{(pid=74805) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 04:18:08 user nova-compute[74805]: DEBUG nova.privsep.utils [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74805) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 04:18:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f041c4f3b6b7c2ea1e905263f0f77ea614dc02c8.part /opt/stack/data/nova/instances/_base/f041c4f3b6b7c2ea1e905263f0f77ea614dc02c8.converted {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:08 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:18:08 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Starting migrate_disk_and_power_off {{(pid=74805) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG nova.compute.manager [req-db3860f7-8998-4dc4-91b8-f942b109df8d req-b6c972db-3b12-41dc-9539-2fa41b80abe8 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Received event network-vif-plugged-9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-db3860f7-8998-4dc4-91b8-f942b109df8d req-b6c972db-3b12-41dc-9539-2fa41b80abe8 service nova] Acquiring lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-db3860f7-8998-4dc4-91b8-f942b109df8d req-b6c972db-3b12-41dc-9539-2fa41b80abe8 service nova] Lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-db3860f7-8998-4dc4-91b8-f942b109df8d req-b6c972db-3b12-41dc-9539-2fa41b80abe8 service nova] Lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG nova.compute.manager [req-db3860f7-8998-4dc4-91b8-f942b109df8d req-b6c972db-3b12-41dc-9539-2fa41b80abe8 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] No waiting events found dispatching network-vif-plugged-9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:18:09 user nova-compute[74805]: WARNING nova.compute.manager [req-db3860f7-8998-4dc4-91b8-f942b109df8d req-b6c972db-3b12-41dc-9539-2fa41b80abe8 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Received unexpected event network-vif-plugged-9f426f7d-ce70-41ba-affa-652a4f62a571 for instance with vm_state active and task_state rescuing.
Nov 15 04:18:09 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f041c4f3b6b7c2ea1e905263f0f77ea614dc02c8.part /opt/stack/data/nova/instances/_base/f041c4f3b6b7c2ea1e905263f0f77ea614dc02c8.converted" returned: 0 in 1.464s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG nova.compute.manager [req-cacab33c-71d0-49e9-9f32-212345846a04 req-016088f1-47cc-4e15-a71e-d2b73ed9adf7 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Received event network-vif-plugged-092376b3-85d5-46b7-a921-cd57d838df06 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-cacab33c-71d0-49e9-9f32-212345846a04 req-016088f1-47cc-4e15-a71e-d2b73ed9adf7 service nova] Acquiring lock "b682db81-a837-49e6-818c-394dd4f1e3f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-cacab33c-71d0-49e9-9f32-212345846a04 req-016088f1-47cc-4e15-a71e-d2b73ed9adf7 service nova] Lock "b682db81-a837-49e6-818c-394dd4f1e3f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-cacab33c-71d0-49e9-9f32-212345846a04 req-016088f1-47cc-4e15-a71e-d2b73ed9adf7 service nova] Lock "b682db81-a837-49e6-818c-394dd4f1e3f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG nova.compute.manager [req-cacab33c-71d0-49e9-9f32-212345846a04 req-016088f1-47cc-4e15-a71e-d2b73ed9adf7 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] No waiting events found dispatching network-vif-plugged-092376b3-85d5-46b7-a921-cd57d838df06 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:18:09 user nova-compute[74805]: WARNING nova.compute.manager [req-cacab33c-71d0-49e9-9f32-212345846a04 req-016088f1-47cc-4e15-a71e-d2b73ed9adf7 service nova] [instance: b682db81-a837-49e6-818c-394dd4f1e3f4] Received unexpected event network-vif-plugged-092376b3-85d5-46b7-a921-cd57d838df06 for instance with vm_state deleted and task_state None.
Nov 15 04:18:09 user nova-compute[74805]: DEBUG nova.compute.manager [req-aba43226-f409-4388-bd7f-5df8d31e54dd req-6cdde2bd-b767-4aa6-bee4-b54eea063a78 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Received event network-vif-unplugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-aba43226-f409-4388-bd7f-5df8d31e54dd req-6cdde2bd-b767-4aa6-bee4-b54eea063a78 service nova] Acquiring lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-aba43226-f409-4388-bd7f-5df8d31e54dd req-6cdde2bd-b767-4aa6-bee4-b54eea063a78 service nova] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-aba43226-f409-4388-bd7f-5df8d31e54dd req-6cdde2bd-b767-4aa6-bee4-b54eea063a78 service nova] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG nova.compute.manager [req-aba43226-f409-4388-bd7f-5df8d31e54dd req-6cdde2bd-b767-4aa6-bee4-b54eea063a78 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] No waiting events found dispatching network-vif-unplugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:18:09 user nova-compute[74805]: WARNING nova.compute.manager [req-aba43226-f409-4388-bd7f-5df8d31e54dd req-6cdde2bd-b767-4aa6-bee4-b54eea063a78 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Received unexpected event network-vif-unplugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 for instance with vm_state active and task_state resize_migrating.
Nov 15 04:18:09 user nova-compute[74805]: DEBUG nova.compute.manager [req-aba43226-f409-4388-bd7f-5df8d31e54dd req-6cdde2bd-b767-4aa6-bee4-b54eea063a78 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Received event network-vif-plugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-aba43226-f409-4388-bd7f-5df8d31e54dd req-6cdde2bd-b767-4aa6-bee4-b54eea063a78 service nova] Acquiring lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-aba43226-f409-4388-bd7f-5df8d31e54dd req-6cdde2bd-b767-4aa6-bee4-b54eea063a78 service nova] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-aba43226-f409-4388-bd7f-5df8d31e54dd req-6cdde2bd-b767-4aa6-bee4-b54eea063a78 service nova] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG nova.compute.manager [req-aba43226-f409-4388-bd7f-5df8d31e54dd req-6cdde2bd-b767-4aa6-bee4-b54eea063a78 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] No waiting events found dispatching network-vif-plugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:18:09 user nova-compute[74805]: WARNING nova.compute.manager [req-aba43226-f409-4388-bd7f-5df8d31e54dd req-6cdde2bd-b767-4aa6-bee4-b54eea063a78 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Received unexpected event network-vif-plugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 for instance with vm_state active and task_state resize_migrating.
Nov 15 04:18:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f041c4f3b6b7c2ea1e905263f0f77ea614dc02c8.converted --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:09 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:18:09 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:18:09 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=7533MB free_disk=25.442977905273438GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:09 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Instance destroyed successfully.
Nov 15 04:18:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2010307012',display_name='tempest-ServerActionsTestOtherB-server-2010307012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2010307012',id=3,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN2t8TNG6ZVHF/Uf5V+OtupNhI5/tplcqGEarq2oKWoGX9vvIofLCSj5BmzwvNfOMIgQ6qY6HA1c0ScmczPixk4TIDvFHJbrnEyQ0asmj0Ggpy7B5hD2wopJrs+94VPUA==',key_name='tempest-keypair-149654948',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:14:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6e12b863b6ed49f3a03f95c105881e5e',ramdisk_id='',reservation_id='r-zfce7v2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-997020636',owner_user_name='tempest-ServerActionsTestOtherB-997020636-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:18:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6253a7981e834ef4979d177a04e8eaf8',uuid=39ab9e2c-5856-4fe6-aa2c-42f9ac52632c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-954710649-network", "vif_mac": "fa:16:3e:28:e7:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Converting VIF {"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-954710649-network", "vif_mac": "fa:16:3e:28:e7:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:e7:d1,bridge_name='br-int',has_traffic_filtering=True,id=2bdff360-1f21-4ce8-9c04-a5115a3316b2,network=Network(90f83e19-1c70-437a-9f75-cbbca516eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdff360-1f') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG os_vif [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:e7:d1,bridge_name='br-int',has_traffic_filtering=True,id=2bdff360-1f21-4ce8-9c04-a5115a3316b2,network=Network(90f83e19-1c70-437a-9f75-cbbca516eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdff360-1f') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2bdff360-1f, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b4351d2-480d-47fd-bad9-d2a5f577370a) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:09 user nova-compute[74805]: INFO os_vif [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:e7:d1,bridge_name='br-int',has_traffic_filtering=True,id=2bdff360-1f21-4ce8-9c04-a5115a3316b2,network=Network(90f83e19-1c70-437a-9f75-cbbca516eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdff360-1f')
Nov 15 04:18:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'biAZqcTu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:18:09 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:18:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd65bdb-61c6-4070-9427-17841211a1fb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:18:09 user nova-compute[74805]: No targets found.
Nov 15 04:18:09 user nova-compute[74805]: iSNS:
Nov 15 04:18:09 user nova-compute[74805]: No targets found.
Nov 15 04:18:09 user nova-compute[74805]: STATIC:
Nov 15 04:18:09 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402
Nov 15 04:18:09 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:18:09 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:18:09 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4
Nov 15 04:18:09 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:18:09 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:18:09 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6
Nov 15 04:18:09 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:18:09 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:18:09 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d
Nov 15 04:18:09 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:18:09 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:18:09 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d
Nov 15 04:18:09 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:18:09 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:18:09 user nova-compute[74805]: FIRMWARE:
Nov 15 04:18:09 user nova-compute[74805]: No targets found.
Nov 15 04:18:09 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:18:09 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:18:09 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec618a7-53c9-4eb6-b1a0-99d06081a38c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f041c4f3b6b7c2ea1e905263f0f77ea614dc02c8.converted --force-share --output=json" returned: 0 in 0.203s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "f041c4f3b6b7c2ea1e905263f0f77ea614dc02c8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 3.050s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Acquiring lock "f041c4f3b6b7c2ea1e905263f0f77ea614dc02c8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "f041c4f3b6b7c2ea1e905263f0f77ea614dc02c8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f041c4f3b6b7c2ea1e905263f0f77ea614dc02c8 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62d802c-53fb-47e2-946b-56de038e9559]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:18:10 user nova-compute[74805]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:18:10 user nova-compute[74805]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:18:10 user nova-compute[74805]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:18:10 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:18:10 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:18:10 user nova-compute[74805]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:18:10 user nova-compute[74805]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:18:10 user nova-compute[74805]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:18:10 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:18:10 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c11acb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4'): ({'sdd'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Removing single pathed devices sdd {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac91189-65b0-4aac-be81-dcfb83f280ae]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8d710d-7338-4d3c-a56e-5e12bef9cca9]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Flushing IO for device /dev/sdd {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3d5495-a03a-4c33-a063-d79d76e56bb6]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-08f5cbca-252d-4cc7-b05b-cb65483f3a23 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-08f5cbca-252d-4cc7-b05b-cb65483f3a23 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7479bc86-17ec-4b82-ad13-3359534f5c69]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] SCSI volumes sdd have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f041c4f3b6b7c2ea1e905263f0f77ea614dc02c8 --force-share --output=json" returned: 0 in 0.193s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f041c4f3b6b7c2ea1e905263f0f77ea614dc02c8,backing_fmt=raw /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk.rescue {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9623df8-4094-4527-b8fa-ac3c599ef3cd]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-08f5cbca-252d-4cc7-b05b-cb65483f3a23 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.956s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.402s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f041c4f3b6b7c2ea1e905263f0f77ea614dc02c8,backing_fmt=raw /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk.rescue" returned: 0 in 0.061s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "f041c4f3b6b7c2ea1e905263f0f77ea614dc02c8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.objects.instance [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lazy-loading 'migration_context' on Instance uuid 0de78a8a-d66a-4703-a044-89c2f2006860 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.objects.base [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Object Instance<0de78a8a-d66a-4703-a044-89c2f2006860> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Start _get_guest_xml network_info=[{"id": "9f426f7d-ce70-41ba-affa-652a4f62a571", "address": "fa:16:3e:74:98:ab", "network": {"id": "e6f9095e-b477-4654-9fb7-7322e7bb3b9d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1108878484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1108878484-network", "vif_mac": "fa:16:3e:74:98:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc936c67de2046ff82115c5ebdb8c844", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f426f7d-ce", "ovs_interfaceid": "9f426f7d-ce70-41ba-affa-652a4f62a571", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5399f8b1-a5bd-43ea-8343-dd472561ec94', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JXcSZyxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '0de78a8a-d66a-4703-a044-89c2f2006860', 'attached_at': '', 'detached_at': '', 'volume_id': 'e8b620f1-dd0d-423d-bcfe-927abccb9402', 'serial': 'e8b620f1-dd0d-423d-bcfe-927abccb9402'}, 'delete_on_termination': False, 'attachment_id': '56e89167-1589-40c6-bbd3-3c2e1c19adf1', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.objects.instance [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lazy-loading 'resources' on Instance uuid 0de78a8a-d66a-4703-a044-89c2f2006860 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:18:10 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-08f5cbca-252d-4cc7-b05b-cb65483f3a23 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Deleted allocations for instance b682db81-a837-49e6-818c-394dd4f1e3f4
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.objects.base [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Object Instance<0de78a8a-d66a-4703-a044-89c2f2006860> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.objects.instance [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lazy-loading 'numa_topology' on Instance uuid 0de78a8a-d66a-4703-a044-89c2f2006860 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1373e56c-1a0f-46b0-85de-25503d6c96cd]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4, portal: 172.16.0.220,3260]
Nov 15 04:18:10 user nova-compute[74805]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4, portal: 172.16.0.220,3260] successful.
Nov 15 04:18:10 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.objects.base [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Object Instance<0de78a8a-d66a-4703-a044-89c2f2006860> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:18:10 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:18:10 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.objects.instance [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0de78a8a-d66a-4703-a044-89c2f2006860 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f6c6ef-b263-4cde-be90-34948c1287dd]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.452s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] <== disconnect_volume: return (453ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Applying migration context for instance 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c as it has an incoming, in-progress migration 8aa43d18-f607-4bdb-b5be-aa341e5558b3. Migration status is migrating {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 04:18:10 user nova-compute[74805]: INFO nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Updating resource usage from migration 8aa43d18-f607-4bdb-b5be-aa341e5558b3
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.objects.base [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Object Instance<0de78a8a-d66a-4703-a044-89c2f2006860> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JXcSZyxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:18:10 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:18:10 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:18:10 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 2b1e540c-6226-445a-bd45-5b7b8807e2b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 1eb9b315-77a9-40f7-8a43-8c40186a0dca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 0de78a8a-d66a-4703-a044-89c2f2006860 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance d63f3726-27df-455f-bda0-3ddca95b70d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance e91a656c-66d6-4a70-a115-8c03ed964f94 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance cad2eedf-c1ef-436c-b608-5b6dafa47451 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance e5004557-00fa-4824-9233-343c2261588d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 51e0a627-f95e-4347-92a7-4a218413e884 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Migration 8aa43d18-f607-4bdb-b5be-aa341e5558b3 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-08f5cbca-252d-4cc7-b05b-cb65483f3a23 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "b682db81-a837-49e6-818c-394dd4f1e3f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.690s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c3ee47-c5b2-4517-a42e-1aa1b365b430]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = JXcSZyxl\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 04:18:10 user nova-compute[74805]: node.name = iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402
Nov 15 04:18:10 user nova-compute[74805]: node.tpgt = -1
Nov 15 04:18:10 user nova-compute[74805]: node.startup = automatic
Nov 15 04:18:10 user nova-compute[74805]: node.leading_login = No
Nov 15 04:18:10 user nova-compute[74805]: iface.iscsi_ifacename = default
Nov 15 04:18:10 user nova-compute[74805]: iface.net_ifacename = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.ipaddress = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.prefix_len = 0
Nov 15 04:18:10 user nova-compute[74805]: iface.hwaddress = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.transport_name = tcp
Nov 15 04:18:10 user nova-compute[74805]: iface.initiatorname = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.state = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.vlan_id = 0
Nov 15 04:18:10 user nova-compute[74805]: iface.vlan_priority = 0
Nov 15 04:18:10 user nova-compute[74805]: iface.vlan_state = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.iface_num = 0
Nov 15 04:18:10 user nova-compute[74805]: iface.mtu = 0
Nov 15 04:18:10 user nova-compute[74805]: iface.port = 0
Nov 15 04:18:10 user nova-compute[74805]: iface.bootproto = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.subnet_mask = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.gateway = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.dhcp_alt_client_id = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.dhcp_dns = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.dhcp_learn_iqn = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.dhcp_vendor_id_state = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.dhcp_vendor_id = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.dhcp_slp_da = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.fragmentation = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.gratuitous_arp = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.incoming_forwarding = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.tos_state = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.tos = 0
Nov 15 04:18:10 user nova-compute[74805]: iface.ttl = 0
Nov 15 04:18:10 user nova-compute[74805]: iface.delayed_ack = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.tcp_nagle = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.tcp_wsf_state = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.tcp_wsf = 0
Nov 15 04:18:10 user nova-compute[74805]: iface.tcp_timer_scale = 0
Nov 15 04:18:10 user nova-compute[74805]: iface.tcp_timestamp = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.redirect = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.def_task_mgmt_timeout = 0
Nov 15 04:18:10 user nova-compute[74805]: iface.header_digest = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.data_digest = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.immediate_data = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.initial_r2t = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.data_seq_inorder = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.data_pdu_inorder = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.erl = 0
Nov 15 04:18:10 user nova-compute[74805]: iface.max_receive_data_len = 0
Nov 15 04:18:10 user nova-compute[74805]: iface.first_burst_len = 0
Nov 15 04:18:10 user nova-compute[74805]: iface.max_outstanding_r2t = 0
Nov 15 04:18:10 user nova-compute[74805]: iface.max_burst_len = 0
Nov 15 04:18:10 user nova-compute[74805]: iface.chap_auth = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.bidi_chap = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.strict_login_compliance = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.discovery_auth = <empty>
Nov 15 04:18:10 user nova-compute[74805]: iface.discovery_logout = <empty>
Nov 15 04:18:10 user nova-compute[74805]: node.discovery_address = <empty>
Nov 15 04:18:10 user nova-compute[74805]: node.discovery_port = 0
Nov 15 04:18:10 user nova-compute[74805]: node.discovery_type = static
Nov 15 04:18:10 user nova-compute[74805]: node.session.initial_cmdsn = 0
Nov 15 04:18:10 user nova-compute[74805]: node.session.initial_login_retry_max = 8
Nov 15 04:18:10 user nova-compute[74805]: node.session.xmit_thread_priority = -20
Nov 15 04:18:10 user nova-compute[74805]: node.session.cmds_max = 128
Nov 15 04:18:10 user nova-compute[74805]: node.session.queue_depth = 32
Nov 15 04:18:10 user nova-compute[74805]: node.session.nr_sessions = 1
Nov 15 04:18:10 user nova-compute[74805]: node.session.auth.authmethod = CHAP
Nov 15 04:18:10 user nova-compute[74805]: node.session.auth.username = JXcSZyxl
Nov 15 04:18:10 user nova-compute[74805]: node.session.auth.password = ***
Nov 15 04:18:10 user nova-compute[74805]: node.session.auth.username_in = <empty>
Nov 15 04:18:10 user nova-compute[74805]: node.session.auth.password_in = <empty>
Nov 15 04:18:10 user nova-compute[74805]: node.session.auth.chap_algs = MD5
Nov 15 04:18:10 user nova-compute[74805]: node.session.timeo.replacement_timeout = 120
Nov 15 04:18:10 user nova-compute[74805]: node.session.err_timeo.abort_timeout = 15
Nov 15 04:18:10 user nova-compute[74805]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 04:18:10 user nova-compute[74805]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 04:18:10 user nova-compute[74805]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 04:18:10 user nova-compute[74805]: node.session.iscsi.FastAbort = Yes
Nov 15 04:18:10 user nova-compute[74805]: node.session.iscsi.InitialR2T = No
Nov 15 04:18:10 user nova-compute[74805]: node.session.iscsi.ImmediateData = Yes
Nov 15 04:18:10 user nova-compute[74805]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 04:18:10 user nova-compute[74805]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 04:18:10 user nova-compute[74805]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 04:18:10 user nova-compute[74805]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 04:18:10 user nova-compute[74805]: node.session.iscsi.MaxConnections = 1
Nov 15 04:18:10 user nova-compute[74805]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 04:18:10 user nova-compute[74805]: node.session.iscsi.ERL = 0
Nov 15 04:18:10 user nova-compute[74805]: node.session.scan = manual
Nov 15 04:18:10 user nova-compute[74805]: node.session.reopen_max = 0
Nov 15 04:18:10 user nova-compute[74805]: node.conn[0].address = 172.16.0.220
Nov 15 04:18:10 user nova-compute[74805]: node.conn[0].port = 3260
Nov 15 04:18:10 user nova-compute[74805]: node.conn[0].startup = manual
Nov 15 04:18:10 user nova-compute[74805]: node.conn[0].tcp.window_size = 524288
Nov 15 04:18:10 user nova-compute[74805]: node.conn[0].tcp.type_of_service = 0
Nov 15 04:18:10 user nova-compute[74805]: node.conn[0].timeo.logout_timeout = 15
Nov 15 04:18:10 user nova-compute[74805]: node.conn[0].timeo.login_timeout = 15
Nov 15 04:18:10 user nova-compute[74805]: node.conn[0].timeo.auth_timeout = 45
Nov 15 04:18:10 user nova-compute[74805]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 04:18:10 user nova-compute[74805]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 04:18:10 user nova-compute[74805]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 04:18:10 user nova-compute[74805]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 04:18:10 user nova-compute[74805]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 04:18:10 user nova-compute[74805]: node.conn[0].iscsi.DataDigest = None
Nov 15 04:18:10 user nova-compute[74805]: node.conn[0].iscsi.IFMarker = No
Nov 15 04:18:10 user nova-compute[74805]: node.conn[0].iscsi.OFMarker = No
Nov 15 04:18:10 user nova-compute[74805]: # END RECORD
Nov 15 04:18:10 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7485c8b7-3192-4af5-bd99-5304455d8bf6]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d1005b-7526-48bb-819a-3904c81a78b1]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JXcSZyxl {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JXcSZyxl" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f2e8c2-2bd7-4552-84b8-99a30b91f136]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JXcSZyxl'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd79706-70d9-4c1d-9f82-1dbb992f0e47]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[978d2923-1693-4108-9cf1-7b9b62598a9d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:18:10 user nova-compute[74805]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:18:10 user nova-compute[74805]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:18:10 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:18:10 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:18:10 user nova-compute[74805]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:18:10 user nova-compute[74805]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:18:10 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:18:10 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.197s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] HCTL ('36', '0', '0', 0) found on session 18 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b80131c-99af-4b08-bca3-fc6c42fb567b]: (4, ('0 0 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Searching for a device in session 18 and hctl ('36', '0', '0', 0) yield: sde {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JXcSZyxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.267s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] <== connect_volume: return (269ms) {'type': 'block', 'scsi_wwn': '26434643665383333', 'path': '/dev/sde'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434643665383333', 'path': '/dev/sde'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-245989285',display_name='tempest-ServerStableDeviceRescueTest-server-245989285',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-245989285',id=5,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE2W8hpxsH+Gx6uZHNfH48qELq4dB6yQZcCESM+knrhVIpfQxBPyOS7IitFzr8Zvm+MZl66RxoPJJ44CmxBQaN/PxK9MK0YRtI4voa1XFvjw53ch4lAnIci9EzvGLMftA==',key_name='tempest-keypair-1768731695',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:14:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc936c67de2046ff82115c5ebdb8c844',ramdisk_id='',reservation_id='r-ztm7khyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1093147709',owner_user_name='tempest-ServerStableDeviceRescueTest-1093147709-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:16:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2cddbf10a1342f3a29972aecfb8f67d',uuid=0de78a8a-d66a-4703-a044-89c2f2006860,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f426f7d-ce70-41ba-affa-652a4f62a571", "address": "fa:16:3e:74:98:ab", "network": {"id": "e6f9095e-b477-4654-9fb7-7322e7bb3b9d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1108878484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1108878484-network", "vif_mac": "fa:16:3e:74:98:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc936c67de2046ff82115c5ebdb8c844", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f426f7d-ce", "ovs_interfaceid": "9f426f7d-ce70-41ba-affa-652a4f62a571", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Converting VIF {"id": "9f426f7d-ce70-41ba-affa-652a4f62a571", "address": "fa:16:3e:74:98:ab", "network": {"id": "e6f9095e-b477-4654-9fb7-7322e7bb3b9d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1108878484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1108878484-network", "vif_mac": "fa:16:3e:74:98:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc936c67de2046ff82115c5ebdb8c844", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f426f7d-ce", "ovs_interfaceid": "9f426f7d-ce70-41ba-affa-652a4f62a571", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:98:ab,bridge_name='br-int',has_traffic_filtering=True,id=9f426f7d-ce70-41ba-affa-652a4f62a571,network=Network(e6f9095e-b477-4654-9fb7-7322e7bb3b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f426f7d-ce') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.objects.instance [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lazy-loading 'pci_devices' on Instance uuid 0de78a8a-d66a-4703-a044-89c2f2006860 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.objects.base [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Object Instance<0de78a8a-d66a-4703-a044-89c2f2006860> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:18:10 user nova-compute[74805]:   <uuid>0de78a8a-d66a-4703-a044-89c2f2006860</uuid>
Nov 15 04:18:10 user nova-compute[74805]:   <name>instance-00000005</name>
Nov 15 04:18:10 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:18:10 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:18:10 user nova-compute[74805]:   <metadata>
Nov 15 04:18:10 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:18:10 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:18:10 user nova-compute[74805]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-245989285</nova:name>
Nov 15 04:18:10 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:18:10</nova:creationTime>
Nov 15 04:18:10 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:18:10 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:18:10 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:18:10 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:18:10 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:18:10 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:18:10 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:18:10 user nova-compute[74805]:       <nova:owner>
Nov 15 04:18:10 user nova-compute[74805]:         <nova:user uuid="b2cddbf10a1342f3a29972aecfb8f67d">tempest-ServerStableDeviceRescueTest-1093147709-project-member</nova:user>
Nov 15 04:18:10 user nova-compute[74805]:         <nova:project uuid="fc936c67de2046ff82115c5ebdb8c844">tempest-ServerStableDeviceRescueTest-1093147709</nova:project>
Nov 15 04:18:10 user nova-compute[74805]:       </nova:owner>
Nov 15 04:18:10 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:18:10 user nova-compute[74805]:       <nova:ports>
Nov 15 04:18:10 user nova-compute[74805]:         <nova:port uuid="9f426f7d-ce70-41ba-affa-652a4f62a571">
Nov 15 04:18:10 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 04:18:10 user nova-compute[74805]:         </nova:port>
Nov 15 04:18:10 user nova-compute[74805]:       </nova:ports>
Nov 15 04:18:10 user nova-compute[74805]:     </nova:instance>
Nov 15 04:18:10 user nova-compute[74805]:   </metadata>
Nov 15 04:18:10 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:18:10 user nova-compute[74805]:     <system>
Nov 15 04:18:10 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:18:10 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:18:10 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:18:10 user nova-compute[74805]:       <entry name="serial">0de78a8a-d66a-4703-a044-89c2f2006860</entry>
Nov 15 04:18:10 user nova-compute[74805]:       <entry name="uuid">0de78a8a-d66a-4703-a044-89c2f2006860</entry>
Nov 15 04:18:10 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:18:10 user nova-compute[74805]:     </system>
Nov 15 04:18:10 user nova-compute[74805]:   </sysinfo>
Nov 15 04:18:10 user nova-compute[74805]:   <os>
Nov 15 04:18:10 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:18:10 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:18:10 user nova-compute[74805]:   </os>
Nov 15 04:18:10 user nova-compute[74805]:   <features>
Nov 15 04:18:10 user nova-compute[74805]:     <acpi/>
Nov 15 04:18:10 user nova-compute[74805]:     <apic/>
Nov 15 04:18:10 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:18:10 user nova-compute[74805]:   </features>
Nov 15 04:18:10 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:18:10 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:18:10 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:18:10 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:18:10 user nova-compute[74805]:   </clock>
Nov 15 04:18:10 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:18:10 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:18:10 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:18:10 user nova-compute[74805]:   </cpu>
Nov 15 04:18:10 user nova-compute[74805]:   <devices>
Nov 15 04:18:10 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:18:10 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:18:10 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk"/>
Nov 15 04:18:10 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:18:10 user nova-compute[74805]:     </disk>
Nov 15 04:18:10 user nova-compute[74805]:     <disk type="block" device="disk">
Nov 15 04:18:10 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:18:10 user nova-compute[74805]:       <source dev="/dev/sde"/>
Nov 15 04:18:10 user nova-compute[74805]:       <target dev="vdb" bus="virtio"/>
Nov 15 04:18:10 user nova-compute[74805]:       <serial>e8b620f1-dd0d-423d-bcfe-927abccb9402</serial>
Nov 15 04:18:10 user nova-compute[74805]:     </disk>
Nov 15 04:18:10 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:18:10 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:18:10 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk.rescue"/>
Nov 15 04:18:10 user nova-compute[74805]:       <target dev="vdc" bus="virtio"/>
Nov 15 04:18:10 user nova-compute[74805]:       <boot order="1"/>
Nov 15 04:18:10 user nova-compute[74805]:     </disk>
Nov 15 04:18:10 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:18:10 user nova-compute[74805]:       <mac address="fa:16:3e:74:98:ab"/>
Nov 15 04:18:10 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:18:10 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:18:10 user nova-compute[74805]:       <target dev="tap9f426f7d-ce"/>
Nov 15 04:18:10 user nova-compute[74805]:     </interface>
Nov 15 04:18:10 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:18:10 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/console.log" append="off"/>
Nov 15 04:18:10 user nova-compute[74805]:     </serial>
Nov 15 04:18:10 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:18:10 user nova-compute[74805]:     <video>
Nov 15 04:18:10 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:18:10 user nova-compute[74805]:     </video>
Nov 15 04:18:10 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:18:10 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:18:10 user nova-compute[74805]:     </rng>
Nov 15 04:18:10 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:18:10 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:18:10 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:18:10 user nova-compute[74805]:     </memballoon>
Nov 15 04:18:10 user nova-compute[74805]:   </devices>
Nov 15 04:18:10 user nova-compute[74805]: </domain>
Nov 15 04:18:10 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:18:10 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Instance destroyed successfully.
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c_resize/disk /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.637s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:18:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] No VIF found with MAC fa:16:3e:74:98:ab, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:18:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] CMD "cp -r /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c_resize/disk /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk" returned: 0 in 0.574s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c_resize/disk.info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk.info {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] CMD "cp -r /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c_resize/disk.info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk.info" returned: 0 in 0.033s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:11 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:18:11 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:18:11 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:18:11 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:18:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-0de78a8a-d66a-4703-a044-89c2f2006860" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:18:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-0de78a8a-d66a-4703-a044-89c2f2006860" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:18:11 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:18:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:12 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Updating instance_info_cache with network_info: [{"id": "9f426f7d-ce70-41ba-affa-652a4f62a571", "address": "fa:16:3e:74:98:ab", "network": {"id": "e6f9095e-b477-4654-9fb7-7322e7bb3b9d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1108878484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc936c67de2046ff82115c5ebdb8c844", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f426f7d-ce", "ovs_interfaceid": "9f426f7d-ce70-41ba-affa-652a4f62a571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:18:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-0de78a8a-d66a-4703-a044-89c2f2006860" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:18:12 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:18:12 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:18:12 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:18:12 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:18:12 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:18:12 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:18:12 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:18:12 user nova-compute[74805]: DEBUG nova.network.neutron [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Port 2bdff360-1f21-4ce8-9c04-a5115a3316b2 binding to destination host user is already ACTIVE {{(pid=74805) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 04:18:12 user nova-compute[74805]: DEBUG nova.compute.manager [req-9b70d251-310a-4b4d-8159-3d1c4b3d7358 req-82892d51-d558-4b65-987e-03f2e5680f7a service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Received event network-vif-plugged-9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:18:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9b70d251-310a-4b4d-8159-3d1c4b3d7358 req-82892d51-d558-4b65-987e-03f2e5680f7a service nova] Acquiring lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9b70d251-310a-4b4d-8159-3d1c4b3d7358 req-82892d51-d558-4b65-987e-03f2e5680f7a service nova] Lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9b70d251-310a-4b4d-8159-3d1c4b3d7358 req-82892d51-d558-4b65-987e-03f2e5680f7a service nova] Lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:12 user nova-compute[74805]: DEBUG nova.compute.manager [req-9b70d251-310a-4b4d-8159-3d1c4b3d7358 req-82892d51-d558-4b65-987e-03f2e5680f7a service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] No waiting events found dispatching network-vif-plugged-9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:18:12 user nova-compute[74805]: WARNING nova.compute.manager [req-9b70d251-310a-4b4d-8159-3d1c4b3d7358 req-82892d51-d558-4b65-987e-03f2e5680f7a service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Received unexpected event network-vif-plugged-9f426f7d-ce70-41ba-affa-652a4f62a571 for instance with vm_state active and task_state rescuing.
Nov 15 04:18:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquiring lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquiring lock "refresh_cache-39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:18:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquired lock "refresh_cache-39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:18:12 user nova-compute[74805]: DEBUG nova.network.neutron [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Acquiring lock "e91a656c-66d6-4a70-a115-8c03ed964f94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "e91a656c-66d6-4a70-a115-8c03ed964f94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Acquiring lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:13 user nova-compute[74805]: INFO nova.compute.manager [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Terminating instance
Nov 15 04:18:13 user nova-compute[74805]: DEBUG nova.compute.manager [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG nova.network.neutron [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Updating instance_info_cache with network_info: [{"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Releasing lock "refresh_cache-39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG os_brick.utils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd2141c-a797-490d-a785-9a1a621ddd21]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f28bdf6-f47f-43c7-bc00-46845ed27f0c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2273d097-51f8-46a0-a13f-b2ddf4e259a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13a71a3-d855-46aa-aef7-69bcc865c3d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG nova.compute.manager [req-2d7a12a8-6d94-4323-a6ed-49839cfe54db req-057640ed-1350-4658-860f-11b48eb1f27c service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Received event network-vif-unplugged-78ef9969-b62c-4730-8bbf-e5a8d2c75010 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2d7a12a8-6d94-4323-a6ed-49839cfe54db req-057640ed-1350-4658-860f-11b48eb1f27c service nova] Acquiring lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2d7a12a8-6d94-4323-a6ed-49839cfe54db req-057640ed-1350-4658-860f-11b48eb1f27c service nova] Lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2d7a12a8-6d94-4323-a6ed-49839cfe54db req-057640ed-1350-4658-860f-11b48eb1f27c service nova] Lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG nova.compute.manager [req-2d7a12a8-6d94-4323-a6ed-49839cfe54db req-057640ed-1350-4658-860f-11b48eb1f27c service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] No waiting events found dispatching network-vif-unplugged-78ef9969-b62c-4730-8bbf-e5a8d2c75010 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG nova.compute.manager [req-2d7a12a8-6d94-4323-a6ed-49839cfe54db req-057640ed-1350-4658-860f-11b48eb1f27c service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Received event network-vif-unplugged-78ef9969-b62c-4730-8bbf-e5a8d2c75010 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:18:13 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:18:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b2a671-5a56-4f6e-9de9-98ddb84df6bf]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG os_brick.utils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:14 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Instance destroyed successfully.
Nov 15 04:18:14 user nova-compute[74805]: DEBUG nova.objects.instance [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lazy-loading 'resources' on Instance uuid e91a656c-66d6-4a70-a115-8c03ed964f94 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T04:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-641306839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1742924084',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlMPSTIiQVE0Cg8/bE0RixmymMVDkL6CLvmQNksg244N0w4rCZu1JDjdz8UBU0xRiR4zxHQg+y5pVbvwhdP+A3FI8Akdh2Dzal25VcHo1J+LBfq6srezgKC8edvUX0D8Q==',key_name='tempest-keypair-430392767',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:16:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b22eb863a050454fb1998acbaae47f23',ramdisk_id='',reservation_id='r-uvt06p7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1378822471',owner_user_name='tempest-ServerActionsV293TestJSON-1378822471-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7ec9f2afcee4c23883d572235bfa437',uuid=e91a656c-66d6-4a70-a115-8c03ed964f94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "address": "fa:16:3e:d0:6e:1b", "network": {"id": "b3051571-47ed-471a-9d88-051306ee18e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-707580808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b22eb863a050454fb1998acbaae47f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ef9969-b6", "ovs_interfaceid": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Converting VIF {"id": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "address": "fa:16:3e:d0:6e:1b", "network": {"id": "b3051571-47ed-471a-9d88-051306ee18e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-707580808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b22eb863a050454fb1998acbaae47f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ef9969-b6", "ovs_interfaceid": "78ef9969-b62c-4730-8bbf-e5a8d2c75010", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:6e:1b,bridge_name='br-int',has_traffic_filtering=True,id=78ef9969-b62c-4730-8bbf-e5a8d2c75010,network=Network(b3051571-47ed-471a-9d88-051306ee18e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ef9969-b6') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG os_vif [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:6e:1b,bridge_name='br-int',has_traffic_filtering=True,id=78ef9969-b62c-4730-8bbf-e5a8d2c75010,network=Network(b3051571-47ed-471a-9d88-051306ee18e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ef9969-b6') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78ef9969-b6, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e781c81e-285d-4ff5-98ec-f100623f8358) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:18:14 user nova-compute[74805]: INFO os_vif [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:6e:1b,bridge_name='br-int',has_traffic_filtering=True,id=78ef9969-b62c-4730-8bbf-e5a8d2c75010,network=Network(b3051571-47ed-471a-9d88-051306ee18e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ef9969-b6')
Nov 15 04:18:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQvEqwlU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:18:14 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:18:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1cd80c-9ebf-4183-9600-031ef2e0b810]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:18:14 user nova-compute[74805]: No targets found.
Nov 15 04:18:14 user nova-compute[74805]: iSNS:
Nov 15 04:18:14 user nova-compute[74805]: No targets found.
Nov 15 04:18:14 user nova-compute[74805]: STATIC:
Nov 15 04:18:14 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402
Nov 15 04:18:14 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:18:14 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:18:14 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6
Nov 15 04:18:14 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:18:14 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:18:14 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d
Nov 15 04:18:14 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:18:14 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:18:14 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d
Nov 15 04:18:14 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:18:14 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:18:14 user nova-compute[74805]: FIRMWARE:
Nov 15 04:18:14 user nova-compute[74805]: No targets found.
Nov 15 04:18:14 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:18:14 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:18:14 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[17081955-19b3-4d86-9a2d-236563d4a52b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fc3d8e-ff06-400e-9802-2f24116794b9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:18:14 user nova-compute[74805]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:18:14 user nova-compute[74805]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:18:14 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:18:14 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d (non-flash)
Nov 15 04:18:14 user nova-compute[74805]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:18:14 user nova-compute[74805]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:18:14 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:18:14 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c256440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d'): ({'sdb'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Removing single pathed devices sdb {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf65643-2601-4330-a118-09df516638f5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7e5cdf-8004-442c-a550-0223fa803b8b]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Flushing IO for device /dev/sdb {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f92addf-45c7-4fa4-b70b-b8a47fab4d4a]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0961fd1-5c02-4839-a610-395db7cade9b]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f6133e-242e-42ef-aaaa-032a59ace5dd]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf830264-ecdc-4f41-ae7c-79078e482267]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d, portal: 172.16.0.220,3260]
Nov 15 04:18:14 user nova-compute[74805]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d, portal: 172.16.0.220,3260] successful.
Nov 15 04:18:14 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b384dac9-f81c-4c7a-bfc7-93966c62f43d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cc971b-9d45-47bb-8f92-76c1fcf4b901]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] <== disconnect_volume: return (340ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:18:14 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Deleting instance files /opt/stack/data/nova/instances/e91a656c-66d6-4a70-a115-8c03ed964f94_del
Nov 15 04:18:14 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Deletion of /opt/stack/data/nova/instances/e91a656c-66d6-4a70-a115-8c03ed964f94_del complete
Nov 15 04:18:14 user nova-compute[74805]: INFO nova.compute.manager [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Took 1.39 seconds to destroy the instance on the hypervisor.
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d17f0180-c100-4baa-859c-9200805d0ca8 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG nova.compute.manager [req-aa2e85cc-0ca1-44f4-9b27-11adb7c5bd3c req-dbc96c6a-ee65-4ac4-bffe-5c09980f1389 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Received event network-vif-plugged-9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-aa2e85cc-0ca1-44f4-9b27-11adb7c5bd3c req-dbc96c6a-ee65-4ac4-bffe-5c09980f1389 service nova] Acquiring lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-aa2e85cc-0ca1-44f4-9b27-11adb7c5bd3c req-dbc96c6a-ee65-4ac4-bffe-5c09980f1389 service nova] Lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-aa2e85cc-0ca1-44f4-9b27-11adb7c5bd3c req-dbc96c6a-ee65-4ac4-bffe-5c09980f1389 service nova] Lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG nova.compute.manager [req-aa2e85cc-0ca1-44f4-9b27-11adb7c5bd3c req-dbc96c6a-ee65-4ac4-bffe-5c09980f1389 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] No waiting events found dispatching network-vif-plugged-9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:18:14 user nova-compute[74805]: WARNING nova.compute.manager [req-aa2e85cc-0ca1-44f4-9b27-11adb7c5bd3c req-dbc96c6a-ee65-4ac4-bffe-5c09980f1389 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Received unexpected event network-vif-plugged-9f426f7d-ce70-41ba-affa-652a4f62a571 for instance with vm_state active and task_state rescuing.
Nov 15 04:18:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:15 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:18:15 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Took 0.79 seconds to deallocate network for instance.
Nov 15 04:18:15 user nova-compute[74805]: DEBUG nova.compute.manager [req-c7b17651-ea9b-4cbd-9ae6-d0cb1dd24e42 req-c86a9e28-2b40-4280-a46f-64d5e81641c4 service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Received event network-vif-deleted-78ef9969-b62c-4730-8bbf-e5a8d2c75010 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:18:15 user nova-compute[74805]: DEBUG nova.compute.manager [req-dfb41f98-b5e4-4e80-9e23-e343d3a04e51 req-72ec20e4-0fe1-4ab6-9000-960a385fada8 service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Received event network-vif-plugged-78ef9969-b62c-4730-8bbf-e5a8d2c75010 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:18:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-dfb41f98-b5e4-4e80-9e23-e343d3a04e51 req-72ec20e4-0fe1-4ab6-9000-960a385fada8 service nova] Acquiring lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-dfb41f98-b5e4-4e80-9e23-e343d3a04e51 req-72ec20e4-0fe1-4ab6-9000-960a385fada8 service nova] Lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-dfb41f98-b5e4-4e80-9e23-e343d3a04e51 req-72ec20e4-0fe1-4ab6-9000-960a385fada8 service nova] Lock "e91a656c-66d6-4a70-a115-8c03ed964f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:15 user nova-compute[74805]: DEBUG nova.compute.manager [req-dfb41f98-b5e4-4e80-9e23-e343d3a04e51 req-72ec20e4-0fe1-4ab6-9000-960a385fada8 service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] No waiting events found dispatching network-vif-plugged-78ef9969-b62c-4730-8bbf-e5a8d2c75010 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:18:15 user nova-compute[74805]: WARNING nova.compute.manager [req-dfb41f98-b5e4-4e80-9e23-e343d3a04e51 req-72ec20e4-0fe1-4ab6-9000-960a385fada8 service nova] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Received unexpected event network-vif-plugged-78ef9969-b62c-4730-8bbf-e5a8d2c75010 for instance with vm_state active and task_state deleting.
Nov 15 04:18:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:16 user nova-compute[74805]: INFO nova.compute.manager [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Took 0.85 seconds to detach 1 volumes for instance.
Nov 15 04:18:16 user nova-compute[74805]: DEBUG nova.compute.manager [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] [instance: e91a656c-66d6-4a70-a115-8c03ed964f94] Deleting volume: b384dac9-f81c-4c7a-bfc7-93966c62f43d {{(pid=74805) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 04:18:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:16 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:18:16 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:18:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:16 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Deleted allocations for instance e91a656c-66d6-4a70-a115-8c03ed964f94
Nov 15 04:18:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-00c46606-24f5-403e-acdc-da972f2e9fc4 tempest-ServerActionsV293TestJSON-1378822471 tempest-ServerActionsV293TestJSON-1378822471-project-member] Lock "e91a656c-66d6-4a70-a115-8c03ed964f94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.815s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Starting finish_migration {{(pid=74805) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Instance directory exists: not creating {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 04:18:19 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Creating image(s)
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Checking if we can resize image /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk. size=21474836480 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk 21474836480 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk 21474836480" returned: 0 in 0.114s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Did not create local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Ensure instance console log exists: /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Start _get_guest_xml network_info=[{"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-954710649-network", "vif_mac": "fa:16:3e:28:e7:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'biAZqcTu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '39ab9e2c-5856-4fe6-aa2c-42f9ac52632c', 'attached_at': '2023-11-15T04:18:19.000000', 'detached_at': '', 'volume_id': '7f3112d5-dcc8-4e6d-9601-30bc0d3243c4', 'serial': '7f3112d5-dcc8-4e6d-9601-30bc0d3243c4'}, 'delete_on_termination': False, 'attachment_id': '5a82c191-7abc-44cc-9ba8-0bcbc127c3ad', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:18:19 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:18:19 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:18:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:17Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'biAZqcTu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:18:19 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:18:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:18:19 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:18:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:18:19 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:18:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f385e9-e799-4fac-988a-296ebcc7a879]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:18:19 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[920c1f9f-1634-4e9a-8250-50f93254384d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4] added
Nov 15 04:18:19 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85c5cdb-5171-43a1-9f85-a645e1a25b61]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a0c689-52f4-49b6-aaa2-615540910c1c]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v biAZqcTu {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v biAZqcTu" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0b9be6-38b3-48f7-bd82-699404c54f2f]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'biAZqcTu'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[450db040-4093-4033-8b10-1e517d307254]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ce6a35-a9af-4c41-94e9-33c98c65ae1f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:18:19 user nova-compute[74805]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:18:19 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:18:19 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:18:19 user nova-compute[74805]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:18:19 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:18:19 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:18:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:20 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d445cf9-0185-48b0-9835-f1f4f1ba7927]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:20 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4, portal: 172.16.0.220,3260]
Nov 15 04:18:20 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4, portal: 172.16.0.220,3260] successful.
Nov 15 04:18:20 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:18:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:20 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ee4791-82ff-493a-af36-d633d031958b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:20 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:18:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:20 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa339f1b-8f60-4b96-ab24-84c1c29b3dca]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:20 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:18:20 user nova-compute[74805]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:18:20 user nova-compute[74805]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:18:20 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:18:20 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:18:20 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:18:20 user nova-compute[74805]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:18:20 user nova-compute[74805]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:18:20 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:18:20 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:18:20 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:18:20 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:18:20 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:18:20 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:18:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:20 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ccbc9f-6593-4598-a543-54783572365b]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:18:20 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: None {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'biAZqcTu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23634376332343034', 'path': '/dev/sdb'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634376332343034', 'path': '/dev/sdb'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2010307012',display_name='tempest-ServerActionsTestOtherB-server-2010307012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2010307012',id=3,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN2t8TNG6ZVHF/Uf5V+OtupNhI5/tplcqGEarq2oKWoGX9vvIofLCSj5BmzwvNfOMIgQ6qY6HA1c0ScmczPixk4TIDvFHJbrnEyQ0asmj0Ggpy7B5hD2wopJrs+94VPUA==',key_name='tempest-keypair-149654948',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:14:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6e12b863b6ed49f3a03f95c105881e5e',ramdisk_id='',reservation_id='r-zfce7v2x',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-997020636',owner_user_name='tempest-ServerActionsTestOtherB-997020636-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6253a7981e834ef4979d177a04e8eaf8',uuid=39ab9e2c-5856-4fe6-aa2c-42f9ac52632c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-954710649-network", "vif_mac": "fa:16:3e:28:e7:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Converting VIF {"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-954710649-network", "vif_mac": "fa:16:3e:28:e7:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:e7:d1,bridge_name='br-int',has_traffic_filtering=True,id=2bdff360-1f21-4ce8-9c04-a5115a3316b2,network=Network(90f83e19-1c70-437a-9f75-cbbca516eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdff360-1f') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:18:21 user nova-compute[74805]:   <uuid>39ab9e2c-5856-4fe6-aa2c-42f9ac52632c</uuid>
Nov 15 04:18:21 user nova-compute[74805]:   <name>instance-00000003</name>
Nov 15 04:18:21 user nova-compute[74805]:   <memory>2097152</memory>
Nov 15 04:18:21 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:18:21 user nova-compute[74805]:   <metadata>
Nov 15 04:18:21 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:18:21 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:18:21 user nova-compute[74805]:       <nova:name>tempest-ServerActionsTestOtherB-server-2010307012</nova:name>
Nov 15 04:18:21 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:18:19</nova:creationTime>
Nov 15 04:18:21 user nova-compute[74805]:       <nova:flavor name="m1.small">
Nov 15 04:18:21 user nova-compute[74805]:         <nova:memory>2048</nova:memory>
Nov 15 04:18:21 user nova-compute[74805]:         <nova:disk>20</nova:disk>
Nov 15 04:18:21 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:18:21 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:18:21 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:18:21 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:18:21 user nova-compute[74805]:       <nova:owner>
Nov 15 04:18:21 user nova-compute[74805]:         <nova:user uuid="6253a7981e834ef4979d177a04e8eaf8">tempest-ServerActionsTestOtherB-997020636-project-member</nova:user>
Nov 15 04:18:21 user nova-compute[74805]:         <nova:project uuid="6e12b863b6ed49f3a03f95c105881e5e">tempest-ServerActionsTestOtherB-997020636</nova:project>
Nov 15 04:18:21 user nova-compute[74805]:       </nova:owner>
Nov 15 04:18:21 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:18:21 user nova-compute[74805]:       <nova:ports>
Nov 15 04:18:21 user nova-compute[74805]:         <nova:port uuid="2bdff360-1f21-4ce8-9c04-a5115a3316b2">
Nov 15 04:18:21 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 04:18:21 user nova-compute[74805]:         </nova:port>
Nov 15 04:18:21 user nova-compute[74805]:       </nova:ports>
Nov 15 04:18:21 user nova-compute[74805]:     </nova:instance>
Nov 15 04:18:21 user nova-compute[74805]:   </metadata>
Nov 15 04:18:21 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:18:21 user nova-compute[74805]:     <system>
Nov 15 04:18:21 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:18:21 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:18:21 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:18:21 user nova-compute[74805]:       <entry name="serial">39ab9e2c-5856-4fe6-aa2c-42f9ac52632c</entry>
Nov 15 04:18:21 user nova-compute[74805]:       <entry name="uuid">39ab9e2c-5856-4fe6-aa2c-42f9ac52632c</entry>
Nov 15 04:18:21 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:18:21 user nova-compute[74805]:     </system>
Nov 15 04:18:21 user nova-compute[74805]:   </sysinfo>
Nov 15 04:18:21 user nova-compute[74805]:   <os>
Nov 15 04:18:21 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:18:21 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:18:21 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:18:21 user nova-compute[74805]:   </os>
Nov 15 04:18:21 user nova-compute[74805]:   <features>
Nov 15 04:18:21 user nova-compute[74805]:     <acpi/>
Nov 15 04:18:21 user nova-compute[74805]:     <apic/>
Nov 15 04:18:21 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:18:21 user nova-compute[74805]:   </features>
Nov 15 04:18:21 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:18:21 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:18:21 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:18:21 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:18:21 user nova-compute[74805]:   </clock>
Nov 15 04:18:21 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:18:21 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:18:21 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:18:21 user nova-compute[74805]:   </cpu>
Nov 15 04:18:21 user nova-compute[74805]:   <devices>
Nov 15 04:18:21 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:18:21 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:18:21 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk"/>
Nov 15 04:18:21 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:18:21 user nova-compute[74805]:     </disk>
Nov 15 04:18:21 user nova-compute[74805]:     <disk type="block" device="disk">
Nov 15 04:18:21 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:18:21 user nova-compute[74805]:       <source dev="/dev/sdb"/>
Nov 15 04:18:21 user nova-compute[74805]:       <target dev="vdb" bus="virtio"/>
Nov 15 04:18:21 user nova-compute[74805]:       <serial>7f3112d5-dcc8-4e6d-9601-30bc0d3243c4</serial>
Nov 15 04:18:21 user nova-compute[74805]:     </disk>
Nov 15 04:18:21 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:18:21 user nova-compute[74805]:       <mac address="fa:16:3e:28:e7:d1"/>
Nov 15 04:18:21 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:18:21 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:18:21 user nova-compute[74805]:       <target dev="tap2bdff360-1f"/>
Nov 15 04:18:21 user nova-compute[74805]:     </interface>
Nov 15 04:18:21 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:18:21 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/console.log" append="off"/>
Nov 15 04:18:21 user nova-compute[74805]:     </serial>
Nov 15 04:18:21 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:18:21 user nova-compute[74805]:     <video>
Nov 15 04:18:21 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:18:21 user nova-compute[74805]:     </video>
Nov 15 04:18:21 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:18:21 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:18:21 user nova-compute[74805]:     </rng>
Nov 15 04:18:21 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:18:21 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:18:21 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:18:21 user nova-compute[74805]:     </memballoon>
Nov 15 04:18:21 user nova-compute[74805]:   </devices>
Nov 15 04:18:21 user nova-compute[74805]: </domain>
Nov 15 04:18:21 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2010307012',display_name='tempest-ServerActionsTestOtherB-server-2010307012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2010307012',id=3,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN2t8TNG6ZVHF/Uf5V+OtupNhI5/tplcqGEarq2oKWoGX9vvIofLCSj5BmzwvNfOMIgQ6qY6HA1c0ScmczPixk4TIDvFHJbrnEyQ0asmj0Ggpy7B5hD2wopJrs+94VPUA==',key_name='tempest-keypair-149654948',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:14:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6e12b863b6ed49f3a03f95c105881e5e',ramdisk_id='',reservation_id='r-zfce7v2x',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-997020636',owner_user_name='tempest-ServerActionsTestOtherB-997020636-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6253a7981e834ef4979d177a04e8eaf8',uuid=39ab9e2c-5856-4fe6-aa2c-42f9ac52632c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-954710649-network", "vif_mac": "fa:16:3e:28:e7:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Converting VIF {"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-954710649-network", "vif_mac": "fa:16:3e:28:e7:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:e7:d1,bridge_name='br-int',has_traffic_filtering=True,id=2bdff360-1f21-4ce8-9c04-a5115a3316b2,network=Network(90f83e19-1c70-437a-9f75-cbbca516eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdff360-1f') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG os_vif [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:e7:d1,bridge_name='br-int',has_traffic_filtering=True,id=2bdff360-1f21-4ce8-9c04-a5115a3316b2,network=Network(90f83e19-1c70-437a-9f75-cbbca516eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdff360-1f') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8997d5c-65a8-5884-85c0-fee7e124b924', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2bdff360-1f, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2bdff360-1f, col_values=(('qos', UUID('dab379b1-8ad1-4e91-8613-ef733aaf217e')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2bdff360-1f, col_values=(('external_ids', {'iface-id': '2bdff360-1f21-4ce8-9c04-a5115a3316b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:e7:d1', 'vm-uuid': '39ab9e2c-5856-4fe6-aa2c-42f9ac52632c'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:21 user nova-compute[74805]: INFO os_vif [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:e7:d1,bridge_name='br-int',has_traffic_filtering=True,id=2bdff360-1f21-4ce8-9c04-a5115a3316b2,network=Network(90f83e19-1c70-437a-9f75-cbbca516eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdff360-1f')
Nov 15 04:18:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] No VIF found with MAC fa:16:3e:28:e7:d1, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Acquiring lock "ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG nova.compute.manager [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:21 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:18:21 user nova-compute[74805]: INFO nova.compute.claims [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Claim successful on node user
Nov 15 04:18:22 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:18:22 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:18:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:22 user nova-compute[74805]: DEBUG nova.compute.manager [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:18:22 user nova-compute[74805]: DEBUG nova.compute.manager [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:18:22 user nova-compute[74805]: DEBUG nova.network.neutron [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:18:22 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:18:22 user nova-compute[74805]: DEBUG nova.compute.manager [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:18:22 user nova-compute[74805]: DEBUG nova.policy [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd93268af3cc4492bbdc20d26ad09cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c33c44f366409bbb2007dc83cc520a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:18:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:22 user nova-compute[74805]: DEBUG nova.compute.manager [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:18:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:18:22 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Creating image(s)
Nov 15 04:18:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "/opt/stack/data/nova/instances/ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "/opt/stack/data/nova/instances/ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.027s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.165s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.191s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:23 user nova-compute[74805]: DEBUG nova.compute.manager [req-849a6ad1-1804-42c9-ba7e-403a90e2569a req-5a599cf3-afde-4c9e-b348-d0b3bfeebbc0 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Received event network-vif-plugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:18:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-849a6ad1-1804-42c9-ba7e-403a90e2569a req-5a599cf3-afde-4c9e-b348-d0b3bfeebbc0 service nova] Acquiring lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-849a6ad1-1804-42c9-ba7e-403a90e2569a req-5a599cf3-afde-4c9e-b348-d0b3bfeebbc0 service nova] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-849a6ad1-1804-42c9-ba7e-403a90e2569a req-5a599cf3-afde-4c9e-b348-d0b3bfeebbc0 service nova] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:23 user nova-compute[74805]: DEBUG nova.compute.manager [req-849a6ad1-1804-42c9-ba7e-403a90e2569a req-5a599cf3-afde-4c9e-b348-d0b3bfeebbc0 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] No waiting events found dispatching network-vif-plugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:18:23 user nova-compute[74805]: WARNING nova.compute.manager [req-849a6ad1-1804-42c9-ba7e-403a90e2569a req-5a599cf3-afde-4c9e-b348-d0b3bfeebbc0 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Received unexpected event network-vif-plugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 for instance with vm_state active and task_state resize_finish.
Nov 15 04:18:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13/disk 1073741824" returned: 0 in 0.067s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.188s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:23 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:18:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:23 user nova-compute[74805]: DEBUG nova.network.neutron [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Successfully created port: cb8b1e16-20b0-41b4-8d63-b1a46083e0ba {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:18:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:23 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Cannot resize image /opt/stack/data/nova/instances/ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:18:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:18:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Ensure instance console log exists: /opt/stack/data/nova/instances/ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:18:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:23 user nova-compute[74805]: DEBUG nova.network.neutron [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Successfully updated port: cb8b1e16-20b0-41b4-8d63-b1a46083e0ba {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:18:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Acquiring lock "refresh_cache-ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:18:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Acquired lock "refresh_cache-ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:18:23 user nova-compute[74805]: DEBUG nova.network.neutron [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.network.neutron [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.network.neutron [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Updating instance_info_cache with network_info: [{"id": "cb8b1e16-20b0-41b4-8d63-b1a46083e0ba", "address": "fa:16:3e:0d:2a:a4", "network": {"id": "9094d1cf-3e56-409a-9fec-dfc97741820d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1184254201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c33c44f366409bbb2007dc83cc520a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb8b1e16-20", "ovs_interfaceid": "cb8b1e16-20b0-41b4-8d63-b1a46083e0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Releasing lock "refresh_cache-ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.compute.manager [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Instance network_info: |[{"id": "cb8b1e16-20b0-41b4-8d63-b1a46083e0ba", "address": "fa:16:3e:0d:2a:a4", "network": {"id": "9094d1cf-3e56-409a-9fec-dfc97741820d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1184254201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c33c44f366409bbb2007dc83cc520a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb8b1e16-20", "ovs_interfaceid": "cb8b1e16-20b0-41b4-8d63-b1a46083e0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Start _get_guest_xml network_info=[{"id": "cb8b1e16-20b0-41b4-8d63-b1a46083e0ba", "address": "fa:16:3e:0d:2a:a4", "network": {"id": "9094d1cf-3e56-409a-9fec-dfc97741820d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1184254201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c33c44f366409bbb2007dc83cc520a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb8b1e16-20", "ovs_interfaceid": "cb8b1e16-20b0-41b4-8d63-b1a46083e0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:18:24 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:18:24 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:18:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-781460415',display_name='tempest-VolumesActionsTest-instance-781460415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-781460415',id=17,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87c33c44f366409bbb2007dc83cc520a',ramdisk_id='',reservation_id='r-b6v6fg05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1048271835',owner_user_name='tempest-VolumesActionsTest-1048271835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:18:22Z,user_data=None,user_id='d93268af3cc4492bbdc20d26ad09cacc',uuid=ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb8b1e16-20b0-41b4-8d63-b1a46083e0ba", "address": "fa:16:3e:0d:2a:a4", "network": {"id": "9094d1cf-3e56-409a-9fec-dfc97741820d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1184254201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c33c44f366409bbb2007dc83cc520a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb8b1e16-20", "ovs_interfaceid": "cb8b1e16-20b0-41b4-8d63-b1a46083e0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Converting VIF {"id": "cb8b1e16-20b0-41b4-8d63-b1a46083e0ba", "address": "fa:16:3e:0d:2a:a4", "network": {"id": "9094d1cf-3e56-409a-9fec-dfc97741820d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1184254201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c33c44f366409bbb2007dc83cc520a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb8b1e16-20", "ovs_interfaceid": "cb8b1e16-20b0-41b4-8d63-b1a46083e0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:2a:a4,bridge_name='br-int',has_traffic_filtering=True,id=cb8b1e16-20b0-41b4-8d63-b1a46083e0ba,network=Network(9094d1cf-3e56-409a-9fec-dfc97741820d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb8b1e16-20') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.objects.instance [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lazy-loading 'pci_devices' on Instance uuid ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:18:24 user nova-compute[74805]:   <uuid>ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13</uuid>
Nov 15 04:18:24 user nova-compute[74805]:   <name>instance-00000011</name>
Nov 15 04:18:24 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:18:24 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:18:24 user nova-compute[74805]:   <metadata>
Nov 15 04:18:24 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:18:24 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:18:24 user nova-compute[74805]:       <nova:name>tempest-VolumesActionsTest-instance-781460415</nova:name>
Nov 15 04:18:24 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:18:24</nova:creationTime>
Nov 15 04:18:24 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:18:24 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:18:24 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:18:24 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:18:24 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:18:24 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:18:24 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:18:24 user nova-compute[74805]:       <nova:owner>
Nov 15 04:18:24 user nova-compute[74805]:         <nova:user uuid="d93268af3cc4492bbdc20d26ad09cacc">tempest-VolumesActionsTest-1048271835-project-member</nova:user>
Nov 15 04:18:24 user nova-compute[74805]:         <nova:project uuid="87c33c44f366409bbb2007dc83cc520a">tempest-VolumesActionsTest-1048271835</nova:project>
Nov 15 04:18:24 user nova-compute[74805]:       </nova:owner>
Nov 15 04:18:24 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:18:24 user nova-compute[74805]:       <nova:ports>
Nov 15 04:18:24 user nova-compute[74805]:         <nova:port uuid="cb8b1e16-20b0-41b4-8d63-b1a46083e0ba">
Nov 15 04:18:24 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 04:18:24 user nova-compute[74805]:         </nova:port>
Nov 15 04:18:24 user nova-compute[74805]:       </nova:ports>
Nov 15 04:18:24 user nova-compute[74805]:     </nova:instance>
Nov 15 04:18:24 user nova-compute[74805]:   </metadata>
Nov 15 04:18:24 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:18:24 user nova-compute[74805]:     <system>
Nov 15 04:18:24 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:18:24 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:18:24 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:18:24 user nova-compute[74805]:       <entry name="serial">ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13</entry>
Nov 15 04:18:24 user nova-compute[74805]:       <entry name="uuid">ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13</entry>
Nov 15 04:18:24 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:18:24 user nova-compute[74805]:     </system>
Nov 15 04:18:24 user nova-compute[74805]:   </sysinfo>
Nov 15 04:18:24 user nova-compute[74805]:   <os>
Nov 15 04:18:24 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:18:24 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:18:24 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:18:24 user nova-compute[74805]:   </os>
Nov 15 04:18:24 user nova-compute[74805]:   <features>
Nov 15 04:18:24 user nova-compute[74805]:     <acpi/>
Nov 15 04:18:24 user nova-compute[74805]:     <apic/>
Nov 15 04:18:24 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:18:24 user nova-compute[74805]:   </features>
Nov 15 04:18:24 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:18:24 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:18:24 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:18:24 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:18:24 user nova-compute[74805]:   </clock>
Nov 15 04:18:24 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:18:24 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:18:24 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:18:24 user nova-compute[74805]:   </cpu>
Nov 15 04:18:24 user nova-compute[74805]:   <devices>
Nov 15 04:18:24 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:18:24 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:18:24 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13/disk"/>
Nov 15 04:18:24 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:18:24 user nova-compute[74805]:     </disk>
Nov 15 04:18:24 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:18:24 user nova-compute[74805]:       <mac address="fa:16:3e:0d:2a:a4"/>
Nov 15 04:18:24 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:18:24 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:18:24 user nova-compute[74805]:       <target dev="tapcb8b1e16-20"/>
Nov 15 04:18:24 user nova-compute[74805]:     </interface>
Nov 15 04:18:24 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:18:24 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13/console.log" append="off"/>
Nov 15 04:18:24 user nova-compute[74805]:     </serial>
Nov 15 04:18:24 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:18:24 user nova-compute[74805]:     <video>
Nov 15 04:18:24 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:18:24 user nova-compute[74805]:     </video>
Nov 15 04:18:24 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:18:24 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:18:24 user nova-compute[74805]:     </rng>
Nov 15 04:18:24 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:18:24 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:18:24 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:18:24 user nova-compute[74805]:     </memballoon>
Nov 15 04:18:24 user nova-compute[74805]:   </devices>
Nov 15 04:18:24 user nova-compute[74805]: </domain>
Nov 15 04:18:24 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:18:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-781460415',display_name='tempest-VolumesActionsTest-instance-781460415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-781460415',id=17,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87c33c44f366409bbb2007dc83cc520a',ramdisk_id='',reservation_id='r-b6v6fg05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1048271835',owner_user_name='tempest-VolumesActionsTest-1048271835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:18:22Z,user_data=None,user_id='d93268af3cc4492bbdc20d26ad09cacc',uuid=ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb8b1e16-20b0-41b4-8d63-b1a46083e0ba", "address": "fa:16:3e:0d:2a:a4", "network": {"id": "9094d1cf-3e56-409a-9fec-dfc97741820d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1184254201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c33c44f366409bbb2007dc83cc520a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb8b1e16-20", "ovs_interfaceid": "cb8b1e16-20b0-41b4-8d63-b1a46083e0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Converting VIF {"id": "cb8b1e16-20b0-41b4-8d63-b1a46083e0ba", "address": "fa:16:3e:0d:2a:a4", "network": {"id": "9094d1cf-3e56-409a-9fec-dfc97741820d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1184254201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c33c44f366409bbb2007dc83cc520a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb8b1e16-20", "ovs_interfaceid": "cb8b1e16-20b0-41b4-8d63-b1a46083e0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:2a:a4,bridge_name='br-int',has_traffic_filtering=True,id=cb8b1e16-20b0-41b4-8d63-b1a46083e0ba,network=Network(9094d1cf-3e56-409a-9fec-dfc97741820d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb8b1e16-20') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG os_vif [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:2a:a4,bridge_name='br-int',has_traffic_filtering=True,id=cb8b1e16-20b0-41b4-8d63-b1a46083e0ba,network=Network(9094d1cf-3e56-409a-9fec-dfc97741820d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb8b1e16-20') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '878938ab-0741-54d0-b705-e761f46e6827', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb8b1e16-20, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb8b1e16-20, col_values=(('qos', UUID('0dbf24b6-739f-47fa-93f2-67b63880374b')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb8b1e16-20, col_values=(('external_ids', {'iface-id': 'cb8b1e16-20b0-41b4-8d63-b1a46083e0ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:2a:a4', 'vm-uuid': 'ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:24 user nova-compute[74805]: INFO os_vif [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:2a:a4,bridge_name='br-int',has_traffic_filtering=True,id=cb8b1e16-20b0-41b4-8d63-b1a46083e0ba,network=Network(9094d1cf-3e56-409a-9fec-dfc97741820d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb8b1e16-20')
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] No VIF found with MAC fa:16:3e:0d:2a:a4, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:24 user nova-compute[74805]: DEBUG nova.compute.manager [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:18:24 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Instance running successfully.
Nov 15 04:18:25 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Failed to set time: agent not configured {{(pid=74805) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 15 04:18:25 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1fd472f3-8990-426f-aa48-9cf8775b1e52 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] finish_migration finished successfully. {{(pid=74805) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 15 04:18:25 user nova-compute[74805]: DEBUG nova.compute.manager [req-b7399652-5b4b-412b-a420-bfbae40ddd4e req-374ae27f-eee3-467a-b853-63dc93ae0d46 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Received event network-vif-plugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:18:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b7399652-5b4b-412b-a420-bfbae40ddd4e req-374ae27f-eee3-467a-b853-63dc93ae0d46 service nova] Acquiring lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b7399652-5b4b-412b-a420-bfbae40ddd4e req-374ae27f-eee3-467a-b853-63dc93ae0d46 service nova] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b7399652-5b4b-412b-a420-bfbae40ddd4e req-374ae27f-eee3-467a-b853-63dc93ae0d46 service nova] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:25 user nova-compute[74805]: DEBUG nova.compute.manager [req-b7399652-5b4b-412b-a420-bfbae40ddd4e req-374ae27f-eee3-467a-b853-63dc93ae0d46 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] No waiting events found dispatching network-vif-plugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:18:25 user nova-compute[74805]: WARNING nova.compute.manager [req-b7399652-5b4b-412b-a420-bfbae40ddd4e req-374ae27f-eee3-467a-b853-63dc93ae0d46 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Received unexpected event network-vif-plugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 for instance with vm_state active and task_state resize_finish.
Nov 15 04:18:25 user nova-compute[74805]: DEBUG nova.compute.manager [req-b7399652-5b4b-412b-a420-bfbae40ddd4e req-374ae27f-eee3-467a-b853-63dc93ae0d46 service nova] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Received event network-changed-cb8b1e16-20b0-41b4-8d63-b1a46083e0ba {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:18:25 user nova-compute[74805]: DEBUG nova.compute.manager [req-b7399652-5b4b-412b-a420-bfbae40ddd4e req-374ae27f-eee3-467a-b853-63dc93ae0d46 service nova] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Refreshing instance network info cache due to event network-changed-cb8b1e16-20b0-41b4-8d63-b1a46083e0ba. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:18:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b7399652-5b4b-412b-a420-bfbae40ddd4e req-374ae27f-eee3-467a-b853-63dc93ae0d46 service nova] Acquiring lock "refresh_cache-ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:18:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b7399652-5b4b-412b-a420-bfbae40ddd4e req-374ae27f-eee3-467a-b853-63dc93ae0d46 service nova] Acquired lock "refresh_cache-ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:18:25 user nova-compute[74805]: DEBUG nova.network.neutron [req-b7399652-5b4b-412b-a420-bfbae40ddd4e req-374ae27f-eee3-467a-b853-63dc93ae0d46 service nova] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Refreshing network info cache for port cb8b1e16-20b0-41b4-8d63-b1a46083e0ba {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:18:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:25 user nova-compute[74805]: DEBUG nova.network.neutron [req-b7399652-5b4b-412b-a420-bfbae40ddd4e req-374ae27f-eee3-467a-b853-63dc93ae0d46 service nova] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Updated VIF entry in instance network info cache for port cb8b1e16-20b0-41b4-8d63-b1a46083e0ba. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:18:25 user nova-compute[74805]: DEBUG nova.network.neutron [req-b7399652-5b4b-412b-a420-bfbae40ddd4e req-374ae27f-eee3-467a-b853-63dc93ae0d46 service nova] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Updating instance_info_cache with network_info: [{"id": "cb8b1e16-20b0-41b4-8d63-b1a46083e0ba", "address": "fa:16:3e:0d:2a:a4", "network": {"id": "9094d1cf-3e56-409a-9fec-dfc97741820d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1184254201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c33c44f366409bbb2007dc83cc520a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb8b1e16-20", "ovs_interfaceid": "cb8b1e16-20b0-41b4-8d63-b1a46083e0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:18:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b7399652-5b4b-412b-a420-bfbae40ddd4e req-374ae27f-eee3-467a-b853-63dc93ae0d46 service nova] Releasing lock "refresh_cache-ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:18:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-6928d810-35d7-4614-82e9-4149e2bf1db2 req-7c759f06-0333-4fbe-ae92-11fd7b7cb608 service nova] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Received event network-vif-plugged-cb8b1e16-20b0-41b4-8d63-b1a46083e0ba {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:18:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6928d810-35d7-4614-82e9-4149e2bf1db2 req-7c759f06-0333-4fbe-ae92-11fd7b7cb608 service nova] Acquiring lock "ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6928d810-35d7-4614-82e9-4149e2bf1db2 req-7c759f06-0333-4fbe-ae92-11fd7b7cb608 service nova] Lock "ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6928d810-35d7-4614-82e9-4149e2bf1db2 req-7c759f06-0333-4fbe-ae92-11fd7b7cb608 service nova] Lock "ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-6928d810-35d7-4614-82e9-4149e2bf1db2 req-7c759f06-0333-4fbe-ae92-11fd7b7cb608 service nova] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] No waiting events found dispatching network-vif-plugged-cb8b1e16-20b0-41b4-8d63-b1a46083e0ba {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:18:26 user nova-compute[74805]: WARNING nova.compute.manager [req-6928d810-35d7-4614-82e9-4149e2bf1db2 req-7c759f06-0333-4fbe-ae92-11fd7b7cb608 service nova] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Received unexpected event network-vif-plugged-cb8b1e16-20b0-41b4-8d63-b1a46083e0ba for instance with vm_state building and task_state spawning.
Nov 15 04:18:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:28 user nova-compute[74805]: DEBUG nova.compute.manager [req-b0885107-8429-4804-ab5c-7dd6bb02a685 req-dabdf5bc-e30d-4bb0-b573-b001f412c015 service nova] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Received event network-vif-plugged-cb8b1e16-20b0-41b4-8d63-b1a46083e0ba {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:18:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b0885107-8429-4804-ab5c-7dd6bb02a685 req-dabdf5bc-e30d-4bb0-b573-b001f412c015 service nova] Acquiring lock "ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b0885107-8429-4804-ab5c-7dd6bb02a685 req-dabdf5bc-e30d-4bb0-b573-b001f412c015 service nova] Lock "ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b0885107-8429-4804-ab5c-7dd6bb02a685 req-dabdf5bc-e30d-4bb0-b573-b001f412c015 service nova] Lock "ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:28 user nova-compute[74805]: DEBUG nova.compute.manager [req-b0885107-8429-4804-ab5c-7dd6bb02a685 req-dabdf5bc-e30d-4bb0-b573-b001f412c015 service nova] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] No waiting events found dispatching network-vif-plugged-cb8b1e16-20b0-41b4-8d63-b1a46083e0ba {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:18:28 user nova-compute[74805]: WARNING nova.compute.manager [req-b0885107-8429-4804-ab5c-7dd6bb02a685 req-dabdf5bc-e30d-4bb0-b573-b001f412c015 service nova] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Received unexpected event network-vif-plugged-cb8b1e16-20b0-41b4-8d63-b1a46083e0ba for instance with vm_state building and task_state spawning.
Nov 15 04:18:28 user nova-compute[74805]: DEBUG nova.compute.manager [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:18:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:18:28 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Instance spawned successfully.
Nov 15 04:18:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:18:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:18:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:18:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:18:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:18:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:18:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:18:28 user nova-compute[74805]: INFO nova.compute.manager [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Took 5.87 seconds to spawn the instance on the hypervisor.
Nov 15 04:18:28 user nova-compute[74805]: DEBUG nova.compute.manager [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:18:28 user nova-compute[74805]: INFO nova.compute.manager [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Took 6.73 seconds to build instance.
Nov 15 04:18:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dd21e368-ff4b-4602-96a8-139d31a0e8d0 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.841s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Acquiring lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:53 user nova-compute[74805]: DEBUG nova.compute.manager [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:18:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:53 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:18:53 user nova-compute[74805]: INFO nova.compute.claims [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Claim successful on node user
Nov 15 04:18:54 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:18:54 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:18:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.621s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:54 user nova-compute[74805]: DEBUG nova.compute.manager [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:18:54 user nova-compute[74805]: DEBUG nova.compute.manager [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:18:54 user nova-compute[74805]: DEBUG nova.network.neutron [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:18:54 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 15 04:18:54 user nova-compute[74805]: DEBUG nova.compute.manager [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:18:54 user nova-compute[74805]: DEBUG nova.policy [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55561d62cd3e48b9823d0aa9f6f84510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4585c1a0b4141ff943c8f470c2487fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:18:54 user nova-compute[74805]: DEBUG nova.compute.manager [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:18:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:18:54 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Creating image(s)
Nov 15 04:18:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "/opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "/opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Acquiring lock "e78e4c1006976523ab94049dbe67510dce4016b2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "e78e4c1006976523ab94049dbe67510dce4016b2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:54 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e78e4c1006976523ab94049dbe67510dce4016b2.part --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:54 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e78e4c1006976523ab94049dbe67510dce4016b2.part --force-share --output=json" returned: 0 in 0.171s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:54 user nova-compute[74805]: DEBUG nova.virt.images [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] 195bcb67-cd88-4ded-b158-0e24352e08be was qcow2, converting to raw {{(pid=74805) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 04:18:55 user nova-compute[74805]: DEBUG nova.privsep.utils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74805) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 04:18:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e78e4c1006976523ab94049dbe67510dce4016b2.part /opt/stack/data/nova/instances/_base/e78e4c1006976523ab94049dbe67510dce4016b2.converted {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e78e4c1006976523ab94049dbe67510dce4016b2.part /opt/stack/data/nova/instances/_base/e78e4c1006976523ab94049dbe67510dce4016b2.converted" returned: 0 in 0.207s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e78e4c1006976523ab94049dbe67510dce4016b2.converted --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e78e4c1006976523ab94049dbe67510dce4016b2.converted --force-share --output=json" returned: 0 in 0.199s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "e78e4c1006976523ab94049dbe67510dce4016b2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.080s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e78e4c1006976523ab94049dbe67510dce4016b2 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:55 user nova-compute[74805]: DEBUG nova.network.neutron [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Successfully created port: 111f5423-0048-423b-8c88-c90bee78aca7 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:18:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e78e4c1006976523ab94049dbe67510dce4016b2 --force-share --output=json" returned: 0 in 0.186s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Acquiring lock "e78e4c1006976523ab94049dbe67510dce4016b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "e78e4c1006976523ab94049dbe67510dce4016b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e78e4c1006976523ab94049dbe67510dce4016b2 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e78e4c1006976523ab94049dbe67510dce4016b2 --force-share --output=json" returned: 0 in 0.187s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e78e4c1006976523ab94049dbe67510dce4016b2,backing_fmt=raw /opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e78e4c1006976523ab94049dbe67510dce4016b2,backing_fmt=raw /opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7/disk 1073741824" returned: 0 in 0.053s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "e78e4c1006976523ab94049dbe67510dce4016b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e78e4c1006976523ab94049dbe67510dce4016b2 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e78e4c1006976523ab94049dbe67510dce4016b2 --force-share --output=json" returned: 0 in 0.190s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:56 user nova-compute[74805]: INFO nova.compute.manager [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Detaching volume b93c3226-0ddd-46ac-bfbe-bae1d26366c6
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.network.neutron [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Successfully updated port: 111f5423-0048-423b-8c88-c90bee78aca7 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Acquiring lock "refresh_cache-e9d8b785-83eb-4e78-9ce5-c2da589ee4f7" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Acquired lock "refresh_cache-e9d8b785-83eb-4e78-9ce5-c2da589ee4f7" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.network.neutron [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Cannot resize image /opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Ensure instance console log exists: /opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.compute.manager [req-70109b69-2ed7-45ae-bb97-3e5fb57171f1 req-4d47a8f3-f5a0-43c5-bbf2-7bebffdde0c8 service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Received event network-changed-111f5423-0048-423b-8c88-c90bee78aca7 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.compute.manager [req-70109b69-2ed7-45ae-bb97-3e5fb57171f1 req-4d47a8f3-f5a0-43c5-bbf2-7bebffdde0c8 service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Refreshing instance network info cache due to event network-changed-111f5423-0048-423b-8c88-c90bee78aca7. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-70109b69-2ed7-45ae-bb97-3e5fb57171f1 req-4d47a8f3-f5a0-43c5-bbf2-7bebffdde0c8 service nova] Acquiring lock "refresh_cache-e9d8b785-83eb-4e78-9ce5-c2da589ee4f7" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:18:56 user nova-compute[74805]: INFO nova.virt.block_device [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Attempting to driver detach volume b93c3226-0ddd-46ac-bfbe-bae1d26366c6 from mountpoint /dev/vdb
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Attempting to detach device vdb from instance 1eb9b315-77a9-40f7-8a43-8c40186a0dca from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:18:56 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:18:56 user nova-compute[74805]:   <source dev="/dev/sdg"/>
Nov 15 04:18:56 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:18:56 user nova-compute[74805]:   <serial>b93c3226-0ddd-46ac-bfbe-bae1d26366c6</serial>
Nov 15 04:18:56 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:18:56 user nova-compute[74805]: </disk>
Nov 15 04:18:56 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:18:56 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Successfully detached device vdb from instance 1eb9b315-77a9-40f7-8a43-8c40186a0dca from the persistent domain config.
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1eb9b315-77a9-40f7-8a43-8c40186a0dca from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:18:56 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:18:56 user nova-compute[74805]:   <source dev="/dev/sdg"/>
Nov 15 04:18:56 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:18:56 user nova-compute[74805]:   <serial>b93c3226-0ddd-46ac-bfbe-bae1d26366c6</serial>
Nov 15 04:18:56 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:18:56 user nova-compute[74805]: </disk>
Nov 15 04:18:56 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.network.neutron [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1eb9b315-77a9-40f7-8a43-8c40186a0dca {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.network.neutron [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Updating instance_info_cache with network_info: [{"id": "111f5423-0048-423b-8c88-c90bee78aca7", "address": "fa:16:3e:3b:a8:eb", "network": {"id": "0e964c0c-5222-4076-add0-1a305e30ab63", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1931209247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4585c1a0b4141ff943c8f470c2487fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f5423-00", "ovs_interfaceid": "111f5423-0048-423b-8c88-c90bee78aca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Releasing lock "refresh_cache-e9d8b785-83eb-4e78-9ce5-c2da589ee4f7" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.compute.manager [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Instance network_info: |[{"id": "111f5423-0048-423b-8c88-c90bee78aca7", "address": "fa:16:3e:3b:a8:eb", "network": {"id": "0e964c0c-5222-4076-add0-1a305e30ab63", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1931209247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4585c1a0b4141ff943c8f470c2487fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f5423-00", "ovs_interfaceid": "111f5423-0048-423b-8c88-c90bee78aca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-70109b69-2ed7-45ae-bb97-3e5fb57171f1 req-4d47a8f3-f5a0-43c5-bbf2-7bebffdde0c8 service nova] Acquired lock "refresh_cache-e9d8b785-83eb-4e78-9ce5-c2da589ee4f7" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.network.neutron [req-70109b69-2ed7-45ae-bb97-3e5fb57171f1 req-4d47a8f3-f5a0-43c5-bbf2-7bebffdde0c8 service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Refreshing network info cache for port 111f5423-0048-423b-8c88-c90bee78aca7 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Start _get_guest_xml network_info=[{"id": "111f5423-0048-423b-8c88-c90bee78aca7", "address": "fa:16:3e:3b:a8:eb", "network": {"id": "0e964c0c-5222-4076-add0-1a305e30ab63", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1931209247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4585c1a0b4141ff943c8f470c2487fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f5423-00", "ovs_interfaceid": "111f5423-0048-423b-8c88-c90bee78aca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:18:48Z,direct_url=<?>,disk_format='qcow2',id=195bcb67-cd88-4ded-b158-0e24352e08be,min_disk=0,min_ram=0,name='',owner='165b89a2d7fa401084cc5f7674b8ccd7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:18:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'scsi', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': '195bcb67-cd88-4ded-b158-0e24352e08be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:18:56 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:18:56 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:18:48Z,direct_url=<?>,disk_format='qcow2',id=195bcb67-cd88-4ded-b158-0e24352e08be,min_disk=0,min_ram=0,name='',owner='165b89a2d7fa401084cc5f7674b8ccd7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:18:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:18:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-915287280',display_name='tempest-AttachSCSIVolumeTestJSON-server-915287280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-915287280',id=18,image_ref='195bcb67-cd88-4ded-b158-0e24352e08be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFD5i1i1yveyxpiaX8PksNVlp91pZygn4IabGoQOLFVbvXlvKg0XH9949bTmFOt0dsZkp9KGSaMX4JrbOizNjyGxIBonv523/tF/YdN4ZBU306UTnfJNCa4fbAUBiQb3fg==',key_name='tempest-keypair-242428025',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4585c1a0b4141ff943c8f470c2487fb',ramdisk_id='',reservation_id='r-sax65km6',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='195bcb67-cd88-4ded-b158-0e24352e08be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1335683627',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1335683627-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:18:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55561d62cd3e48b9823d0aa9f6f84510',uuid=e9d8b785-83eb-4e78-9ce5-c2da589ee4f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "111f5423-0048-423b-8c88-c90bee78aca7", "address": "fa:16:3e:3b:a8:eb", "network": {"id": "0e964c0c-5222-4076-add0-1a305e30ab63", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1931209247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4585c1a0b4141ff943c8f470c2487fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f5423-00", "ovs_interfaceid": "111f5423-0048-423b-8c88-c90bee78aca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Converting VIF {"id": "111f5423-0048-423b-8c88-c90bee78aca7", "address": "fa:16:3e:3b:a8:eb", "network": {"id": "0e964c0c-5222-4076-add0-1a305e30ab63", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1931209247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4585c1a0b4141ff943c8f470c2487fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f5423-00", "ovs_interfaceid": "111f5423-0048-423b-8c88-c90bee78aca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:a8:eb,bridge_name='br-int',has_traffic_filtering=True,id=111f5423-0048-423b-8c88-c90bee78aca7,network=Network(0e964c0c-5222-4076-add0-1a305e30ab63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap111f5423-00') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.objects.instance [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lazy-loading 'pci_devices' on Instance uuid e9d8b785-83eb-4e78-9ce5-c2da589ee4f7 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:18:56 user nova-compute[74805]:   <uuid>e9d8b785-83eb-4e78-9ce5-c2da589ee4f7</uuid>
Nov 15 04:18:56 user nova-compute[74805]:   <name>instance-00000012</name>
Nov 15 04:18:56 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:18:56 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:18:56 user nova-compute[74805]:   <metadata>
Nov 15 04:18:56 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:18:56 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:18:56 user nova-compute[74805]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-915287280</nova:name>
Nov 15 04:18:56 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:18:56</nova:creationTime>
Nov 15 04:18:56 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:18:56 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:18:56 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:18:56 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:18:56 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:18:56 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:18:56 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:18:56 user nova-compute[74805]:       <nova:owner>
Nov 15 04:18:56 user nova-compute[74805]:         <nova:user uuid="55561d62cd3e48b9823d0aa9f6f84510">tempest-AttachSCSIVolumeTestJSON-1335683627-project-member</nova:user>
Nov 15 04:18:56 user nova-compute[74805]:         <nova:project uuid="d4585c1a0b4141ff943c8f470c2487fb">tempest-AttachSCSIVolumeTestJSON-1335683627</nova:project>
Nov 15 04:18:56 user nova-compute[74805]:       </nova:owner>
Nov 15 04:18:56 user nova-compute[74805]:       <nova:root type="image" uuid="195bcb67-cd88-4ded-b158-0e24352e08be"/>
Nov 15 04:18:56 user nova-compute[74805]:       <nova:ports>
Nov 15 04:18:56 user nova-compute[74805]:         <nova:port uuid="111f5423-0048-423b-8c88-c90bee78aca7">
Nov 15 04:18:56 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 04:18:56 user nova-compute[74805]:         </nova:port>
Nov 15 04:18:56 user nova-compute[74805]:       </nova:ports>
Nov 15 04:18:56 user nova-compute[74805]:     </nova:instance>
Nov 15 04:18:56 user nova-compute[74805]:   </metadata>
Nov 15 04:18:56 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:18:56 user nova-compute[74805]:     <system>
Nov 15 04:18:56 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:18:56 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:18:56 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:18:56 user nova-compute[74805]:       <entry name="serial">e9d8b785-83eb-4e78-9ce5-c2da589ee4f7</entry>
Nov 15 04:18:56 user nova-compute[74805]:       <entry name="uuid">e9d8b785-83eb-4e78-9ce5-c2da589ee4f7</entry>
Nov 15 04:18:56 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:18:56 user nova-compute[74805]:     </system>
Nov 15 04:18:56 user nova-compute[74805]:   </sysinfo>
Nov 15 04:18:56 user nova-compute[74805]:   <os>
Nov 15 04:18:56 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:18:56 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:18:56 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:18:56 user nova-compute[74805]:   </os>
Nov 15 04:18:56 user nova-compute[74805]:   <features>
Nov 15 04:18:56 user nova-compute[74805]:     <acpi/>
Nov 15 04:18:56 user nova-compute[74805]:     <apic/>
Nov 15 04:18:56 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:18:56 user nova-compute[74805]:   </features>
Nov 15 04:18:56 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:18:56 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:18:56 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:18:56 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:18:56 user nova-compute[74805]:   </clock>
Nov 15 04:18:56 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:18:56 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:18:56 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:18:56 user nova-compute[74805]:   </cpu>
Nov 15 04:18:56 user nova-compute[74805]:   <devices>
Nov 15 04:18:56 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:18:56 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:18:56 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7/disk"/>
Nov 15 04:18:56 user nova-compute[74805]:       <target dev="sda" bus="scsi"/>
Nov 15 04:18:56 user nova-compute[74805]:       <address type="drive" controller="0" unit="0"/>
Nov 15 04:18:56 user nova-compute[74805]:     </disk>
Nov 15 04:18:56 user nova-compute[74805]:     <disk type="file" device="cdrom">
Nov 15 04:18:56 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 04:18:56 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7/disk.config"/>
Nov 15 04:18:56 user nova-compute[74805]:       <target dev="sdb" bus="scsi"/>
Nov 15 04:18:56 user nova-compute[74805]:       <address type="drive" controller="0" unit="1"/>
Nov 15 04:18:56 user nova-compute[74805]:     </disk>
Nov 15 04:18:56 user nova-compute[74805]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 15 04:18:56 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:18:56 user nova-compute[74805]:       <mac address="fa:16:3e:3b:a8:eb"/>
Nov 15 04:18:56 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:18:56 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:18:56 user nova-compute[74805]:       <target dev="tap111f5423-00"/>
Nov 15 04:18:56 user nova-compute[74805]:     </interface>
Nov 15 04:18:56 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:18:56 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7/console.log" append="off"/>
Nov 15 04:18:56 user nova-compute[74805]:     </serial>
Nov 15 04:18:56 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:18:56 user nova-compute[74805]:     <video>
Nov 15 04:18:56 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:18:56 user nova-compute[74805]:     </video>
Nov 15 04:18:56 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:18:56 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:18:56 user nova-compute[74805]:     </rng>
Nov 15 04:18:56 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:18:56 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:18:56 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:18:56 user nova-compute[74805]:     </memballoon>
Nov 15 04:18:56 user nova-compute[74805]:   </devices>
Nov 15 04:18:56 user nova-compute[74805]: </domain>
Nov 15 04:18:56 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:18:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-915287280',display_name='tempest-AttachSCSIVolumeTestJSON-server-915287280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-915287280',id=18,image_ref='195bcb67-cd88-4ded-b158-0e24352e08be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFD5i1i1yveyxpiaX8PksNVlp91pZygn4IabGoQOLFVbvXlvKg0XH9949bTmFOt0dsZkp9KGSaMX4JrbOizNjyGxIBonv523/tF/YdN4ZBU306UTnfJNCa4fbAUBiQb3fg==',key_name='tempest-keypair-242428025',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4585c1a0b4141ff943c8f470c2487fb',ramdisk_id='',reservation_id='r-sax65km6',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='195bcb67-cd88-4ded-b158-0e24352e08be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1335683627',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1335683627-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:18:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55561d62cd3e48b9823d0aa9f6f84510',uuid=e9d8b785-83eb-4e78-9ce5-c2da589ee4f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "111f5423-0048-423b-8c88-c90bee78aca7", "address": "fa:16:3e:3b:a8:eb", "network": {"id": "0e964c0c-5222-4076-add0-1a305e30ab63", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1931209247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4585c1a0b4141ff943c8f470c2487fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f5423-00", "ovs_interfaceid": "111f5423-0048-423b-8c88-c90bee78aca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Converting VIF {"id": "111f5423-0048-423b-8c88-c90bee78aca7", "address": "fa:16:3e:3b:a8:eb", "network": {"id": "0e964c0c-5222-4076-add0-1a305e30ab63", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1931209247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4585c1a0b4141ff943c8f470c2487fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f5423-00", "ovs_interfaceid": "111f5423-0048-423b-8c88-c90bee78aca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:a8:eb,bridge_name='br-int',has_traffic_filtering=True,id=111f5423-0048-423b-8c88-c90bee78aca7,network=Network(0e964c0c-5222-4076-add0-1a305e30ab63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap111f5423-00') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG os_vif [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:a8:eb,bridge_name='br-int',has_traffic_filtering=True,id=111f5423-0048-423b-8c88-c90bee78aca7,network=Network(0e964c0c-5222-4076-add0-1a305e30ab63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap111f5423-00') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '63150df8-d9bc-5099-a3d9-b47b332cd8f9', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap111f5423-00, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap111f5423-00, col_values=(('qos', UUID('c86deab2-ebbf-4ecd-85e6-182dc80b3f1a')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap111f5423-00, col_values=(('external_ids', {'iface-id': '111f5423-0048-423b-8c88-c90bee78aca7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:a8:eb', 'vm-uuid': 'e9d8b785-83eb-4e78-9ce5-c2da589ee4f7'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:18:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:56 user nova-compute[74805]: INFO os_vif [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:a8:eb,bridge_name='br-int',has_traffic_filtering=True,id=111f5423-0048-423b-8c88-c90bee78aca7,network=Network(0e964c0c-5222-4076-add0-1a305e30ab63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap111f5423-00')
Nov 15 04:18:57 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] No BDM found with device name sda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:18:57 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:18:57 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] No VIF found with MAC fa:16:3e:3b:a8:eb, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:18:57 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Using config drive
Nov 15 04:18:57 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Creating config drive at /opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7/disk.config
Nov 15 04:18:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnouzj0zq {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:18:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnouzj0zq" returned: 0 in 0.056s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:18:57 user nova-compute[74805]: DEBUG nova.network.neutron [req-70109b69-2ed7-45ae-bb97-3e5fb57171f1 req-4d47a8f3-f5a0-43c5-bbf2-7bebffdde0c8 service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Updated VIF entry in instance network info cache for port 111f5423-0048-423b-8c88-c90bee78aca7. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:18:57 user nova-compute[74805]: DEBUG nova.network.neutron [req-70109b69-2ed7-45ae-bb97-3e5fb57171f1 req-4d47a8f3-f5a0-43c5-bbf2-7bebffdde0c8 service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Updating instance_info_cache with network_info: [{"id": "111f5423-0048-423b-8c88-c90bee78aca7", "address": "fa:16:3e:3b:a8:eb", "network": {"id": "0e964c0c-5222-4076-add0-1a305e30ab63", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1931209247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4585c1a0b4141ff943c8f470c2487fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f5423-00", "ovs_interfaceid": "111f5423-0048-423b-8c88-c90bee78aca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:18:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-70109b69-2ed7-45ae-bb97-3e5fb57171f1 req-4d47a8f3-f5a0-43c5-bbf2-7bebffdde0c8 service nova] Releasing lock "refresh_cache-e9d8b785-83eb-4e78-9ce5-c2da589ee4f7" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:18:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:59 user nova-compute[74805]: DEBUG nova.compute.manager [req-64b49306-7e8b-4815-9959-7cf7be976632 req-bc2333e8-0783-47a5-bf66-d5ee4c7472b4 service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Received event network-vif-plugged-111f5423-0048-423b-8c88-c90bee78aca7 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:18:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-64b49306-7e8b-4815-9959-7cf7be976632 req-bc2333e8-0783-47a5-bf66-d5ee4c7472b4 service nova] Acquiring lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:18:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-64b49306-7e8b-4815-9959-7cf7be976632 req-bc2333e8-0783-47a5-bf66-d5ee4c7472b4 service nova] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:18:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-64b49306-7e8b-4815-9959-7cf7be976632 req-bc2333e8-0783-47a5-bf66-d5ee4c7472b4 service nova] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:18:59 user nova-compute[74805]: DEBUG nova.compute.manager [req-64b49306-7e8b-4815-9959-7cf7be976632 req-bc2333e8-0783-47a5-bf66-d5ee4c7472b4 service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] No waiting events found dispatching network-vif-plugged-111f5423-0048-423b-8c88-c90bee78aca7 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:18:59 user nova-compute[74805]: WARNING nova.compute.manager [req-64b49306-7e8b-4815-9959-7cf7be976632 req-bc2333e8-0783-47a5-bf66-d5ee4c7472b4 service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Received unexpected event network-vif-plugged-111f5423-0048-423b-8c88-c90bee78aca7 for instance with vm_state building and task_state spawning.
Nov 15 04:18:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:18:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:00 user nova-compute[74805]: DEBUG nova.compute.manager [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:19:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:19:00 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Instance spawned successfully.
Nov 15 04:19:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:19:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:19:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:19:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:19:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:19:00 user nova-compute[74805]: INFO nova.compute.manager [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Took 6.61 seconds to spawn the instance on the hypervisor.
Nov 15 04:19:00 user nova-compute[74805]: DEBUG nova.compute.manager [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:19:01 user nova-compute[74805]: INFO nova.compute.manager [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Took 7.59 seconds to build instance.
Nov 15 04:19:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-580f4f8b-a29c-49dc-ad0d-39d9e153f4d1 tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.695s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:01 user nova-compute[74805]: DEBUG nova.compute.manager [req-c75ad40d-e681-49d3-a220-b1fcb44c73d5 req-60443ebf-4dd1-44bf-8d5d-fc673fd9f450 service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Received event network-vif-plugged-111f5423-0048-423b-8c88-c90bee78aca7 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:19:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c75ad40d-e681-49d3-a220-b1fcb44c73d5 req-60443ebf-4dd1-44bf-8d5d-fc673fd9f450 service nova] Acquiring lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c75ad40d-e681-49d3-a220-b1fcb44c73d5 req-60443ebf-4dd1-44bf-8d5d-fc673fd9f450 service nova] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c75ad40d-e681-49d3-a220-b1fcb44c73d5 req-60443ebf-4dd1-44bf-8d5d-fc673fd9f450 service nova] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:01 user nova-compute[74805]: DEBUG nova.compute.manager [req-c75ad40d-e681-49d3-a220-b1fcb44c73d5 req-60443ebf-4dd1-44bf-8d5d-fc673fd9f450 service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] No waiting events found dispatching network-vif-plugged-111f5423-0048-423b-8c88-c90bee78aca7 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:19:01 user nova-compute[74805]: WARNING nova.compute.manager [req-c75ad40d-e681-49d3-a220-b1fcb44c73d5 req-60443ebf-4dd1-44bf-8d5d-fc673fd9f450 service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Received unexpected event network-vif-plugged-111f5423-0048-423b-8c88-c90bee78aca7 for instance with vm_state active and task_state None.
Nov 15 04:19:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:02 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:19:04 user nova-compute[74805]: DEBUG nova.compute.manager [req-91088e31-feb1-4e69-be70-4663f2462dcf req-4761cbaf-d6e2-4afb-b6b4-8ecaf1bd9eb8 service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Received event network-changed-96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:19:04 user nova-compute[74805]: DEBUG nova.compute.manager [req-91088e31-feb1-4e69-be70-4663f2462dcf req-4761cbaf-d6e2-4afb-b6b4-8ecaf1bd9eb8 service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Refreshing instance network info cache due to event network-changed-96104fe5-a8a5-445d-9c2a-6631a15e4349. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:19:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-91088e31-feb1-4e69-be70-4663f2462dcf req-4761cbaf-d6e2-4afb-b6b4-8ecaf1bd9eb8 service nova] Acquiring lock "refresh_cache-e5004557-00fa-4824-9233-343c2261588d" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:19:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-91088e31-feb1-4e69-be70-4663f2462dcf req-4761cbaf-d6e2-4afb-b6b4-8ecaf1bd9eb8 service nova] Acquired lock "refresh_cache-e5004557-00fa-4824-9233-343c2261588d" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:19:04 user nova-compute[74805]: DEBUG nova.network.neutron [req-91088e31-feb1-4e69-be70-4663f2462dcf req-4761cbaf-d6e2-4afb-b6b4-8ecaf1bd9eb8 service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Refreshing network info cache for port 96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:19:04 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:19:04 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:19:04 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:19:04 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:19:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:04 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:19:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk --force-share --output=json" returned: 0 in 0.367s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:04 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:19:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:05 user nova-compute[74805]: DEBUG nova.network.neutron [req-91088e31-feb1-4e69-be70-4663f2462dcf req-4761cbaf-d6e2-4afb-b6b4-8ecaf1bd9eb8 service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Updated VIF entry in instance network info cache for port 96104fe5-a8a5-445d-9c2a-6631a15e4349. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:19:05 user nova-compute[74805]: DEBUG nova.network.neutron [req-91088e31-feb1-4e69-be70-4663f2462dcf req-4761cbaf-d6e2-4afb-b6b4-8ecaf1bd9eb8 service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Updating instance_info_cache with network_info: [{"id": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "address": "fa:16:3e:c8:0f:b4", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96104fe5-a8", "ovs_interfaceid": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:19:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-91088e31-feb1-4e69-be70-4663f2462dcf req-4761cbaf-d6e2-4afb-b6b4-8ecaf1bd9eb8 service nova] Releasing lock "refresh_cache-e5004557-00fa-4824-9233-343c2261588d" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:19:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "e5004557-00fa-4824-9233-343c2261588d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "e5004557-00fa-4824-9233-343c2261588d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:07 user nova-compute[74805]: DEBUG nova.objects.instance [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'flavor' on Instance uuid e5004557-00fa-4824-9233-343c2261588d {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:19:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "e5004557-00fa-4824-9233-343c2261588d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "e5004557-00fa-4824-9233-343c2261588d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "e5004557-00fa-4824-9233-343c2261588d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:08 user nova-compute[74805]: INFO nova.compute.manager [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Attaching volume 944e52fb-ec1c-4673-a146-945688c4c4d7 to /dev/vdb
Nov 15 04:19:08 user nova-compute[74805]: DEBUG os_brick.utils [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[602272a1-f111-4e34-b377-2fcb5402cd97]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[52deeb27-d389-437d-9ebe-e6c5cda46552]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[113b2d4a-d7c9-476c-bf6f-8ed72ad88d84]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf6447c-57cb-46e1-bae2-528a85822c29]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:19:08 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:19:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[642c8ca5-55bc-4dee-ae08-13cd95a3165e]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG os_brick.utils [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Updating existing volume attachment record: 8262b6ee-ad31-4974-899c-3461d3b1c872 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:19:09 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:09 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:19:09 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:19:09 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=7310MB free_disk=25.204254150390625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:19:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:09 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Applying migration context for instance 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c as it has an incoming, in-progress migration 8aa43d18-f607-4bdb-b5be-aa341e5558b3. Migration status is finished {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 04:19:09 user nova-compute[74805]: INFO nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Updating resource usage from migration 8aa43d18-f607-4bdb-b5be-aa341e5558b3
Nov 15 04:19:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 2b1e540c-6226-445a-bd45-5b7b8807e2b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:19:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 1eb9b315-77a9-40f7-8a43-8c40186a0dca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:19:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 0de78a8a-d66a-4703-a044-89c2f2006860 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:19:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance d63f3726-27df-455f-bda0-3ddca95b70d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:19:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance cad2eedf-c1ef-436c-b608-5b6dafa47451 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:19:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance e5004557-00fa-4824-9233-343c2261588d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:19:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 51e0a627-f95e-4347-92a7-4a218413e884 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:19:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Migration 8aa43d18-f607-4bdb-b5be-aa341e5558b3 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 04:19:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:19:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:19:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance e9d8b785-83eb-4e78-9ce5-c2da589ee4f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:19:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:19:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:19:10 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:19:10 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:19:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:19:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.739s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:11 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:19:11 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:19:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-d63f3726-27df-455f-bda0-3ddca95b70d9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:19:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-d63f3726-27df-455f-bda0-3ddca95b70d9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:19:11 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:19:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:12 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Updating instance_info_cache with network_info: [{"id": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "address": "fa:16:3e:b1:3d:ff", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d0a11b6-25", "ovs_interfaceid": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:19:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-d63f3726-27df-455f-bda0-3ddca95b70d9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:19:12 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:19:12 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:19:12 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:19:12 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:19:12 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHMBdyZI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:19:13 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:19:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:19:13 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:19:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:19:13 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91b2963-d53a-46fa-b703-602b60d2721d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:19:13 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df9a6d1-9645-408f-b786-d1fbb51ecfcc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7] added
Nov 15 04:19:13 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b596ab5f-951c-4fcb-aa6d-0bdaa1d877dc]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd66c5d-987d-4545-a601-708ed7fbe172]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XHMBdyZI {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XHMBdyZI" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfb7875-00a7-4891-a5b5-a1b305255626]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XHMBdyZI'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf83e0c-c216-4cbf-a407-2bb93e5c109f]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc8402b-b1a0-429e-a934-6a508f742dd9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:19:13 user nova-compute[74805]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:19:13 user nova-compute[74805]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:19:13 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:19:13 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:19:13 user nova-compute[74805]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:19:13 user nova-compute[74805]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:19:13 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:19:13 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5643a9-fd33-4a80-b3c4-e6397bef9516]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7, portal: 172.16.0.220,3260]
Nov 15 04:19:13 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7, portal: 172.16.0.220,3260] successful.
Nov 15 04:19:13 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[375b1cdf-f181-413e-8356-7996920d48e0]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcda53a4-b85f-4c41-8d71-2e297eb985e0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:19:13 user nova-compute[74805]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:19:13 user nova-compute[74805]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:19:13 user nova-compute[74805]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:19:13 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:19:13 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:19:13 user nova-compute[74805]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:19:13 user nova-compute[74805]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:19:13 user nova-compute[74805]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:19:13 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:19:13 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be8bb36-9342-4604-b814-8f59f2ef495f]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:19:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHMBdyZI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:19:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:19:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23831623665326531', 'path': '/dev/sdd'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:19:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831623665326531', 'path': '/dev/sdd'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:19:14 user nova-compute[74805]: DEBUG nova.objects.instance [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'flavor' on Instance uuid e5004557-00fa-4824-9233-343c2261588d {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:19:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:19:14 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:19:14 user nova-compute[74805]:   <source dev="/dev/sdd"/>
Nov 15 04:19:14 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:19:14 user nova-compute[74805]:   <serial>944e52fb-ec1c-4673-a146-945688c4c4d7</serial>
Nov 15 04:19:14 user nova-compute[74805]: </disk>
Nov 15 04:19:14 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:19:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:19:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:19:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] No VIF found with MAC fa:16:3e:c8:0f:b4, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:19:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-aeddf8ed-a803-424b-b374-b7bb54ac7b44 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "e5004557-00fa-4824-9233-343c2261588d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.394s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9c6d9be9-b9e0-4867-97bb-4be605eb6cd0 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "e5004557-00fa-4824-9233-343c2261588d" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9c6d9be9-b9e0-4867-97bb-4be605eb6cd0 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "e5004557-00fa-4824-9233-343c2261588d" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:15 user nova-compute[74805]: DEBUG nova.compute.manager [None req-9c6d9be9-b9e0-4867-97bb-4be605eb6cd0 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:19:15 user nova-compute[74805]: DEBUG nova.compute.manager [None req-9c6d9be9-b9e0-4867-97bb-4be605eb6cd0 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74805) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 15 04:19:15 user nova-compute[74805]: DEBUG nova.objects.instance [None req-9c6d9be9-b9e0-4867-97bb-4be605eb6cd0 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'flavor' on Instance uuid e5004557-00fa-4824-9233-343c2261588d {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG nova.compute.manager [req-e89c5269-2ce0-4084-9155-81073c6e99f6 req-d9ea231e-6cd9-4d0d-8c49-740e3571047d service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Received event network-vif-unplugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e89c5269-2ce0-4084-9155-81073c6e99f6 req-d9ea231e-6cd9-4d0d-8c49-740e3571047d service nova] Acquiring lock "e5004557-00fa-4824-9233-343c2261588d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e89c5269-2ce0-4084-9155-81073c6e99f6 req-d9ea231e-6cd9-4d0d-8c49-740e3571047d service nova] Lock "e5004557-00fa-4824-9233-343c2261588d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e89c5269-2ce0-4084-9155-81073c6e99f6 req-d9ea231e-6cd9-4d0d-8c49-740e3571047d service nova] Lock "e5004557-00fa-4824-9233-343c2261588d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG nova.compute.manager [req-e89c5269-2ce0-4084-9155-81073c6e99f6 req-d9ea231e-6cd9-4d0d-8c49-740e3571047d service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] No waiting events found dispatching network-vif-unplugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:19:16 user nova-compute[74805]: WARNING nova.compute.manager [req-e89c5269-2ce0-4084-9155-81073c6e99f6 req-d9ea231e-6cd9-4d0d-8c49-740e3571047d service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Received unexpected event network-vif-unplugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 for instance with vm_state active and task_state powering-off.
Nov 15 04:19:16 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: e5004557-00fa-4824-9233-343c2261588d] Instance destroyed successfully.
Nov 15 04:19:16 user nova-compute[74805]: DEBUG nova.compute.manager [None req-9c6d9be9-b9e0-4867-97bb-4be605eb6cd0 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9c6d9be9-b9e0-4867-97bb-4be605eb6cd0 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "e5004557-00fa-4824-9233-343c2261588d" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.909s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:16 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1eb9b315-77a9-40f7-8a43-8c40186a0dca is timed out.
Nov 15 04:19:16 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Successfully detached device vdb from instance 1eb9b315-77a9-40f7-8a43-8c40186a0dca from the live domain config.
Nov 15 04:19:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PmCURVfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:19:16 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:19:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5484a56d-a75e-4600-afdc-f5f9682cbf43]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:19:16 user nova-compute[74805]: No targets found.
Nov 15 04:19:16 user nova-compute[74805]: iSNS:
Nov 15 04:19:16 user nova-compute[74805]: No targets found.
Nov 15 04:19:16 user nova-compute[74805]: STATIC:
Nov 15 04:19:16 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402
Nov 15 04:19:16 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:19:16 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:19:16 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4
Nov 15 04:19:16 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:19:16 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:19:16 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6
Nov 15 04:19:16 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:19:16 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:19:16 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7
Nov 15 04:19:16 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:19:16 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:19:16 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d
Nov 15 04:19:16 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:19:16 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:19:16 user nova-compute[74805]: FIRMWARE:
Nov 15 04:19:16 user nova-compute[74805]: No targets found.
Nov 15 04:19:16 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:19:16 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:19:16 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0eaa506-ecaf-4557-bcd5-3acf22dec643]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4359ffbf-e14c-4901-ad5b-cafc8274e727]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:19:16 user nova-compute[74805]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:19:16 user nova-compute[74805]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:19:16 user nova-compute[74805]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:19:16 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:19:16 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:19:16 user nova-compute[74805]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:19:16 user nova-compute[74805]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:19:16 user nova-compute[74805]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:19:16 user nova-compute[74805]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 (non-flash)
Nov 15 04:19:16 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c132440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6'): ({'sdg'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Removing single pathed devices sdg {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96c9a85-9fed-41ad-9e88-b06a74a67758]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[85672c8f-a7b0-420d-898f-4ea7a1935c22]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Flushing IO for device /dev/sdg {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b84946-9d20-467b-ba8e-a39e9cac5012]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:19:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:17 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[464c11a4-e3bf-4fb2-b45f-d1dff9b2168b]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:17 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:19:17 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] SCSI volumes sdg have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:19:17 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:19:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:17 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8686bda-13f3-4880-b88d-a9a3e83fa8c8]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:17 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:19:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:17 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4d48f0-8ad8-429c-bd36-8ffc83ca0af2]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:17 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6, portal: 172.16.0.220,3260]
Nov 15 04:19:17 user nova-compute[74805]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6, portal: 172.16.0.220,3260] successful.
Nov 15 04:19:17 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:19:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b93c3226-0ddd-46ac-bfbe-bae1d26366c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:17 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddedddec-6803-45bf-b7ae-225fc14bbe33]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:17 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:19:17 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:19:17 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] <== disconnect_volume: return (350ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:19:17 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:19:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Acquiring lock "45c66453-2f83-476b-a03b-6bdbb01d1849" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "45c66453-2f83-476b-a03b-6bdbb01d1849" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:17 user nova-compute[74805]: DEBUG nova.compute.manager [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:19:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:17 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:19:17 user nova-compute[74805]: INFO nova.compute.claims [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Claim successful on node user
Nov 15 04:19:17 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:19:17 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:19:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:18 user nova-compute[74805]: DEBUG nova.compute.manager [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:19:18 user nova-compute[74805]: DEBUG nova.objects.instance [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lazy-loading 'flavor' on Instance uuid 1eb9b315-77a9-40f7-8a43-8c40186a0dca {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:19:18 user nova-compute[74805]: DEBUG nova.compute.manager [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:19:18 user nova-compute[74805]: DEBUG nova.network.neutron [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:19:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-dd742f8e-63bd-47ce-b003-ebdfaa696aef tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.883s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:18 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:19:18 user nova-compute[74805]: DEBUG nova.compute.manager [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:19:18 user nova-compute[74805]: DEBUG nova.policy [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e816730fe634ef08d520fd01186b10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13324230e774496aa688ef50d872cb1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:19:18 user nova-compute[74805]: DEBUG nova.compute.manager [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:19:18 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:19:18 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Creating image(s)
Nov 15 04:19:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Acquiring lock "/opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "/opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "/opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:18 user nova-compute[74805]: DEBUG nova.compute.manager [req-e9ebef19-99f2-4bb7-8e7a-76a1491bbcbe req-50645749-87fc-4e0e-8207-9cbfc0be296c service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Received event network-vif-plugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:19:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e9ebef19-99f2-4bb7-8e7a-76a1491bbcbe req-50645749-87fc-4e0e-8207-9cbfc0be296c service nova] Acquiring lock "e5004557-00fa-4824-9233-343c2261588d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e9ebef19-99f2-4bb7-8e7a-76a1491bbcbe req-50645749-87fc-4e0e-8207-9cbfc0be296c service nova] Lock "e5004557-00fa-4824-9233-343c2261588d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e9ebef19-99f2-4bb7-8e7a-76a1491bbcbe req-50645749-87fc-4e0e-8207-9cbfc0be296c service nova] Lock "e5004557-00fa-4824-9233-343c2261588d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:18 user nova-compute[74805]: DEBUG nova.compute.manager [req-e9ebef19-99f2-4bb7-8e7a-76a1491bbcbe req-50645749-87fc-4e0e-8207-9cbfc0be296c service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] No waiting events found dispatching network-vif-plugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:19:18 user nova-compute[74805]: WARNING nova.compute.manager [req-e9ebef19-99f2-4bb7-8e7a-76a1491bbcbe req-50645749-87fc-4e0e-8207-9cbfc0be296c service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Received unexpected event network-vif-plugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 for instance with vm_state stopped and task_state None.
Nov 15 04:19:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.171s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk 1073741824" returned: 0 in 0.047s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.190s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:18 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Checking if we can resize image /opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:19:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:18 user nova-compute[74805]: DEBUG nova.network.neutron [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Successfully created port: 28a2a15e-d316-4502-a5d8-c7877fc85311 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:19:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:19 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Cannot resize image /opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:19:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:19:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Ensure instance console log exists: /opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:19:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:19 user nova-compute[74805]: DEBUG nova.network.neutron [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Successfully updated port: 28a2a15e-d316-4502-a5d8-c7877fc85311 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:19:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Acquiring lock "refresh_cache-45c66453-2f83-476b-a03b-6bdbb01d1849" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:19:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Acquired lock "refresh_cache-45c66453-2f83-476b-a03b-6bdbb01d1849" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:19:19 user nova-compute[74805]: DEBUG nova.network.neutron [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:19:19 user nova-compute[74805]: DEBUG nova.network.neutron [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:19:19 user nova-compute[74805]: DEBUG nova.compute.manager [req-1111ad3b-bd30-48f4-bf32-a9c0d2a1bbe2 req-436b59cc-29da-49fd-9fd3-1e779465d6f8 service nova] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Received event network-changed-28a2a15e-d316-4502-a5d8-c7877fc85311 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:19:19 user nova-compute[74805]: DEBUG nova.compute.manager [req-1111ad3b-bd30-48f4-bf32-a9c0d2a1bbe2 req-436b59cc-29da-49fd-9fd3-1e779465d6f8 service nova] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Refreshing instance network info cache due to event network-changed-28a2a15e-d316-4502-a5d8-c7877fc85311. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:19:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1111ad3b-bd30-48f4-bf32-a9c0d2a1bbe2 req-436b59cc-29da-49fd-9fd3-1e779465d6f8 service nova] Acquiring lock "refresh_cache-45c66453-2f83-476b-a03b-6bdbb01d1849" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:19:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.network.neutron [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Updating instance_info_cache with network_info: [{"id": "28a2a15e-d316-4502-a5d8-c7877fc85311", "address": "fa:16:3e:9c:8d:32", "network": {"id": "8a59b0de-c0e7-442f-90fa-ccb85294d3f7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640403300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13324230e774496aa688ef50d872cb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28a2a15e-d3", "ovs_interfaceid": "28a2a15e-d316-4502-a5d8-c7877fc85311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Releasing lock "refresh_cache-45c66453-2f83-476b-a03b-6bdbb01d1849" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.compute.manager [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Instance network_info: |[{"id": "28a2a15e-d316-4502-a5d8-c7877fc85311", "address": "fa:16:3e:9c:8d:32", "network": {"id": "8a59b0de-c0e7-442f-90fa-ccb85294d3f7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640403300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13324230e774496aa688ef50d872cb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28a2a15e-d3", "ovs_interfaceid": "28a2a15e-d316-4502-a5d8-c7877fc85311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1111ad3b-bd30-48f4-bf32-a9c0d2a1bbe2 req-436b59cc-29da-49fd-9fd3-1e779465d6f8 service nova] Acquired lock "refresh_cache-45c66453-2f83-476b-a03b-6bdbb01d1849" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.network.neutron [req-1111ad3b-bd30-48f4-bf32-a9c0d2a1bbe2 req-436b59cc-29da-49fd-9fd3-1e779465d6f8 service nova] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Refreshing network info cache for port 28a2a15e-d316-4502-a5d8-c7877fc85311 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Start _get_guest_xml network_info=[{"id": "28a2a15e-d316-4502-a5d8-c7877fc85311", "address": "fa:16:3e:9c:8d:32", "network": {"id": "8a59b0de-c0e7-442f-90fa-ccb85294d3f7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640403300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13324230e774496aa688ef50d872cb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28a2a15e-d3", "ovs_interfaceid": "28a2a15e-d316-4502-a5d8-c7877fc85311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:19:20 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:19:20 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:19:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1669253906',display_name='tempest-VolumesAdminNegativeTest-server-1669253906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1669253906',id=19,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9P/2ttgkTeylZi0Y8xDg0L+cg2tc7VdCgMr0ARwRUnkFgbNKuywjoonMcD9nlQN59zBslJOvp0CnVj+gz+S481YJBNjPeXBNm2wFKgMaxMD1pwEc4eCF73FaUDrzzYjg==',key_name='tempest-keypair-1068167141',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13324230e774496aa688ef50d872cb1f',ramdisk_id='',reservation_id='r-o3lism3h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-77980530',owner_user_name='tempest-VolumesAdminNegativeTest-77980530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:19:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e816730fe634ef08d520fd01186b10e',uuid=45c66453-2f83-476b-a03b-6bdbb01d1849,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28a2a15e-d316-4502-a5d8-c7877fc85311", "address": "fa:16:3e:9c:8d:32", "network": {"id": "8a59b0de-c0e7-442f-90fa-ccb85294d3f7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640403300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13324230e774496aa688ef50d872cb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28a2a15e-d3", "ovs_interfaceid": "28a2a15e-d316-4502-a5d8-c7877fc85311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Converting VIF {"id": "28a2a15e-d316-4502-a5d8-c7877fc85311", "address": "fa:16:3e:9c:8d:32", "network": {"id": "8a59b0de-c0e7-442f-90fa-ccb85294d3f7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640403300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13324230e774496aa688ef50d872cb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28a2a15e-d3", "ovs_interfaceid": "28a2a15e-d316-4502-a5d8-c7877fc85311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:8d:32,bridge_name='br-int',has_traffic_filtering=True,id=28a2a15e-d316-4502-a5d8-c7877fc85311,network=Network(8a59b0de-c0e7-442f-90fa-ccb85294d3f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28a2a15e-d3') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.objects.instance [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lazy-loading 'pci_devices' on Instance uuid 45c66453-2f83-476b-a03b-6bdbb01d1849 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:19:20 user nova-compute[74805]:   <uuid>45c66453-2f83-476b-a03b-6bdbb01d1849</uuid>
Nov 15 04:19:20 user nova-compute[74805]:   <name>instance-00000013</name>
Nov 15 04:19:20 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:19:20 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:19:20 user nova-compute[74805]:   <metadata>
Nov 15 04:19:20 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:19:20 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:19:20 user nova-compute[74805]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1669253906</nova:name>
Nov 15 04:19:20 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:19:20</nova:creationTime>
Nov 15 04:19:20 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:19:20 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:19:20 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:19:20 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:19:20 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:19:20 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:19:20 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:19:20 user nova-compute[74805]:       <nova:owner>
Nov 15 04:19:20 user nova-compute[74805]:         <nova:user uuid="3e816730fe634ef08d520fd01186b10e">tempest-VolumesAdminNegativeTest-77980530-project-member</nova:user>
Nov 15 04:19:20 user nova-compute[74805]:         <nova:project uuid="13324230e774496aa688ef50d872cb1f">tempest-VolumesAdminNegativeTest-77980530</nova:project>
Nov 15 04:19:20 user nova-compute[74805]:       </nova:owner>
Nov 15 04:19:20 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:19:20 user nova-compute[74805]:       <nova:ports>
Nov 15 04:19:20 user nova-compute[74805]:         <nova:port uuid="28a2a15e-d316-4502-a5d8-c7877fc85311">
Nov 15 04:19:20 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 04:19:20 user nova-compute[74805]:         </nova:port>
Nov 15 04:19:20 user nova-compute[74805]:       </nova:ports>
Nov 15 04:19:20 user nova-compute[74805]:     </nova:instance>
Nov 15 04:19:20 user nova-compute[74805]:   </metadata>
Nov 15 04:19:20 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:19:20 user nova-compute[74805]:     <system>
Nov 15 04:19:20 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:19:20 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:19:20 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:19:20 user nova-compute[74805]:       <entry name="serial">45c66453-2f83-476b-a03b-6bdbb01d1849</entry>
Nov 15 04:19:20 user nova-compute[74805]:       <entry name="uuid">45c66453-2f83-476b-a03b-6bdbb01d1849</entry>
Nov 15 04:19:20 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:19:20 user nova-compute[74805]:     </system>
Nov 15 04:19:20 user nova-compute[74805]:   </sysinfo>
Nov 15 04:19:20 user nova-compute[74805]:   <os>
Nov 15 04:19:20 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:19:20 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:19:20 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:19:20 user nova-compute[74805]:   </os>
Nov 15 04:19:20 user nova-compute[74805]:   <features>
Nov 15 04:19:20 user nova-compute[74805]:     <acpi/>
Nov 15 04:19:20 user nova-compute[74805]:     <apic/>
Nov 15 04:19:20 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:19:20 user nova-compute[74805]:   </features>
Nov 15 04:19:20 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:19:20 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:19:20 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:19:20 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:19:20 user nova-compute[74805]:   </clock>
Nov 15 04:19:20 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:19:20 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:19:20 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:19:20 user nova-compute[74805]:   </cpu>
Nov 15 04:19:20 user nova-compute[74805]:   <devices>
Nov 15 04:19:20 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:19:20 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:19:20 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk"/>
Nov 15 04:19:20 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:19:20 user nova-compute[74805]:     </disk>
Nov 15 04:19:20 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:19:20 user nova-compute[74805]:       <mac address="fa:16:3e:9c:8d:32"/>
Nov 15 04:19:20 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:19:20 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:19:20 user nova-compute[74805]:       <target dev="tap28a2a15e-d3"/>
Nov 15 04:19:20 user nova-compute[74805]:     </interface>
Nov 15 04:19:20 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:19:20 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/console.log" append="off"/>
Nov 15 04:19:20 user nova-compute[74805]:     </serial>
Nov 15 04:19:20 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:19:20 user nova-compute[74805]:     <video>
Nov 15 04:19:20 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:19:20 user nova-compute[74805]:     </video>
Nov 15 04:19:20 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:19:20 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:19:20 user nova-compute[74805]:     </rng>
Nov 15 04:19:20 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:19:20 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:19:20 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:19:20 user nova-compute[74805]:     </memballoon>
Nov 15 04:19:20 user nova-compute[74805]:   </devices>
Nov 15 04:19:20 user nova-compute[74805]: </domain>
Nov 15 04:19:20 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:19:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1669253906',display_name='tempest-VolumesAdminNegativeTest-server-1669253906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1669253906',id=19,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9P/2ttgkTeylZi0Y8xDg0L+cg2tc7VdCgMr0ARwRUnkFgbNKuywjoonMcD9nlQN59zBslJOvp0CnVj+gz+S481YJBNjPeXBNm2wFKgMaxMD1pwEc4eCF73FaUDrzzYjg==',key_name='tempest-keypair-1068167141',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13324230e774496aa688ef50d872cb1f',ramdisk_id='',reservation_id='r-o3lism3h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-77980530',owner_user_name='tempest-VolumesAdminNegativeTest-77980530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:19:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e816730fe634ef08d520fd01186b10e',uuid=45c66453-2f83-476b-a03b-6bdbb01d1849,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28a2a15e-d316-4502-a5d8-c7877fc85311", "address": "fa:16:3e:9c:8d:32", "network": {"id": "8a59b0de-c0e7-442f-90fa-ccb85294d3f7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640403300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13324230e774496aa688ef50d872cb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28a2a15e-d3", "ovs_interfaceid": "28a2a15e-d316-4502-a5d8-c7877fc85311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Converting VIF {"id": "28a2a15e-d316-4502-a5d8-c7877fc85311", "address": "fa:16:3e:9c:8d:32", "network": {"id": "8a59b0de-c0e7-442f-90fa-ccb85294d3f7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640403300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13324230e774496aa688ef50d872cb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28a2a15e-d3", "ovs_interfaceid": "28a2a15e-d316-4502-a5d8-c7877fc85311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:8d:32,bridge_name='br-int',has_traffic_filtering=True,id=28a2a15e-d316-4502-a5d8-c7877fc85311,network=Network(8a59b0de-c0e7-442f-90fa-ccb85294d3f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28a2a15e-d3') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG os_vif [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:8d:32,bridge_name='br-int',has_traffic_filtering=True,id=28a2a15e-d316-4502-a5d8-c7877fc85311,network=Network(8a59b0de-c0e7-442f-90fa-ccb85294d3f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28a2a15e-d3') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9f6dad6-cf74-5ca3-aff7-a947172c497c', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28a2a15e-d3, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28a2a15e-d3, col_values=(('qos', UUID('abf41899-bb7a-4e2f-b8c1-3a636ef48ed3')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28a2a15e-d3, col_values=(('external_ids', {'iface-id': '28a2a15e-d316-4502-a5d8-c7877fc85311', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:8d:32', 'vm-uuid': '45c66453-2f83-476b-a03b-6bdbb01d1849'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:20 user nova-compute[74805]: INFO os_vif [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:8d:32,bridge_name='br-int',has_traffic_filtering=True,id=28a2a15e-d316-4502-a5d8-c7877fc85311,network=Network(8a59b0de-c0e7-442f-90fa-ccb85294d3f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28a2a15e-d3')
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] No VIF found with MAC fa:16:3e:9c:8d:32, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.network.neutron [req-1111ad3b-bd30-48f4-bf32-a9c0d2a1bbe2 req-436b59cc-29da-49fd-9fd3-1e779465d6f8 service nova] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Updated VIF entry in instance network info cache for port 28a2a15e-d316-4502-a5d8-c7877fc85311. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG nova.network.neutron [req-1111ad3b-bd30-48f4-bf32-a9c0d2a1bbe2 req-436b59cc-29da-49fd-9fd3-1e779465d6f8 service nova] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Updating instance_info_cache with network_info: [{"id": "28a2a15e-d316-4502-a5d8-c7877fc85311", "address": "fa:16:3e:9c:8d:32", "network": {"id": "8a59b0de-c0e7-442f-90fa-ccb85294d3f7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640403300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13324230e774496aa688ef50d872cb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28a2a15e-d3", "ovs_interfaceid": "28a2a15e-d316-4502-a5d8-c7877fc85311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:19:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1111ad3b-bd30-48f4-bf32-a9c0d2a1bbe2 req-436b59cc-29da-49fd-9fd3-1e779465d6f8 service nova] Releasing lock "refresh_cache-45c66453-2f83-476b-a03b-6bdbb01d1849" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:19:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-51463bf8-18e2-4229-84f0-794bed2e0de5 req-d439a381-5014-40b2-8a90-7ff7235c2a54 service nova] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Received event network-vif-plugged-28a2a15e-d316-4502-a5d8-c7877fc85311 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:19:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-51463bf8-18e2-4229-84f0-794bed2e0de5 req-d439a381-5014-40b2-8a90-7ff7235c2a54 service nova] Acquiring lock "45c66453-2f83-476b-a03b-6bdbb01d1849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-51463bf8-18e2-4229-84f0-794bed2e0de5 req-d439a381-5014-40b2-8a90-7ff7235c2a54 service nova] Lock "45c66453-2f83-476b-a03b-6bdbb01d1849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-51463bf8-18e2-4229-84f0-794bed2e0de5 req-d439a381-5014-40b2-8a90-7ff7235c2a54 service nova] Lock "45c66453-2f83-476b-a03b-6bdbb01d1849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-51463bf8-18e2-4229-84f0-794bed2e0de5 req-d439a381-5014-40b2-8a90-7ff7235c2a54 service nova] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] No waiting events found dispatching network-vif-plugged-28a2a15e-d316-4502-a5d8-c7877fc85311 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:19:22 user nova-compute[74805]: WARNING nova.compute.manager [req-51463bf8-18e2-4229-84f0-794bed2e0de5 req-d439a381-5014-40b2-8a90-7ff7235c2a54 service nova] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Received unexpected event network-vif-plugged-28a2a15e-d316-4502-a5d8-c7877fc85311 for instance with vm_state building and task_state spawning.
Nov 15 04:19:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:24 user nova-compute[74805]: DEBUG nova.compute.manager [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:19:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:19:24 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Instance spawned successfully.
Nov 15 04:19:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:19:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:19:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:19:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:19:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:19:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:19:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:19:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-2184f228-1e0a-4b82-a7f1-2d6826d2b3d5 req-e5d44b22-1171-4db1-b54b-790bc6a1ba79 service nova] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Received event network-vif-plugged-28a2a15e-d316-4502-a5d8-c7877fc85311 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:19:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2184f228-1e0a-4b82-a7f1-2d6826d2b3d5 req-e5d44b22-1171-4db1-b54b-790bc6a1ba79 service nova] Acquiring lock "45c66453-2f83-476b-a03b-6bdbb01d1849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2184f228-1e0a-4b82-a7f1-2d6826d2b3d5 req-e5d44b22-1171-4db1-b54b-790bc6a1ba79 service nova] Lock "45c66453-2f83-476b-a03b-6bdbb01d1849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2184f228-1e0a-4b82-a7f1-2d6826d2b3d5 req-e5d44b22-1171-4db1-b54b-790bc6a1ba79 service nova] Lock "45c66453-2f83-476b-a03b-6bdbb01d1849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-2184f228-1e0a-4b82-a7f1-2d6826d2b3d5 req-e5d44b22-1171-4db1-b54b-790bc6a1ba79 service nova] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] No waiting events found dispatching network-vif-plugged-28a2a15e-d316-4502-a5d8-c7877fc85311 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:19:24 user nova-compute[74805]: WARNING nova.compute.manager [req-2184f228-1e0a-4b82-a7f1-2d6826d2b3d5 req-e5d44b22-1171-4db1-b54b-790bc6a1ba79 service nova] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Received unexpected event network-vif-plugged-28a2a15e-d316-4502-a5d8-c7877fc85311 for instance with vm_state building and task_state spawning.
Nov 15 04:19:24 user nova-compute[74805]: INFO nova.compute.manager [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Took 5.90 seconds to spawn the instance on the hypervisor.
Nov 15 04:19:24 user nova-compute[74805]: DEBUG nova.compute.manager [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:19:24 user nova-compute[74805]: INFO nova.compute.manager [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Took 6.75 seconds to build instance.
Nov 15 04:19:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2df18bd7-ee75-434d-8e49-aed3cc6ca3ce tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "45c66453-2f83-476b-a03b-6bdbb01d1849" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.849s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:27 user nova-compute[74805]: DEBUG nova.compute.manager [req-53835a72-e76e-499e-ae73-31829762f0fd req-0f45c997-00d3-4b5d-8216-a1d02d62a1ff service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Received event network-changed-333d7ad3-7a5b-49e8-a657-a712443ad922 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:19:27 user nova-compute[74805]: DEBUG nova.compute.manager [req-53835a72-e76e-499e-ae73-31829762f0fd req-0f45c997-00d3-4b5d-8216-a1d02d62a1ff service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Refreshing instance network info cache due to event network-changed-333d7ad3-7a5b-49e8-a657-a712443ad922. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:19:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-53835a72-e76e-499e-ae73-31829762f0fd req-0f45c997-00d3-4b5d-8216-a1d02d62a1ff service nova] Acquiring lock "refresh_cache-cad2eedf-c1ef-436c-b608-5b6dafa47451" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:19:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-53835a72-e76e-499e-ae73-31829762f0fd req-0f45c997-00d3-4b5d-8216-a1d02d62a1ff service nova] Acquired lock "refresh_cache-cad2eedf-c1ef-436c-b608-5b6dafa47451" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:19:27 user nova-compute[74805]: DEBUG nova.network.neutron [req-53835a72-e76e-499e-ae73-31829762f0fd req-0f45c997-00d3-4b5d-8216-a1d02d62a1ff service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Refreshing network info cache for port 333d7ad3-7a5b-49e8-a657-a712443ad922 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:19:27 user nova-compute[74805]: DEBUG nova.network.neutron [req-53835a72-e76e-499e-ae73-31829762f0fd req-0f45c997-00d3-4b5d-8216-a1d02d62a1ff service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Updated VIF entry in instance network info cache for port 333d7ad3-7a5b-49e8-a657-a712443ad922. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:19:27 user nova-compute[74805]: DEBUG nova.network.neutron [req-53835a72-e76e-499e-ae73-31829762f0fd req-0f45c997-00d3-4b5d-8216-a1d02d62a1ff service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Updating instance_info_cache with network_info: [{"id": "333d7ad3-7a5b-49e8-a657-a712443ad922", "address": "fa:16:3e:ff:8a:9e", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333d7ad3-7a", "ovs_interfaceid": "333d7ad3-7a5b-49e8-a657-a712443ad922", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:19:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-53835a72-e76e-499e-ae73-31829762f0fd req-0f45c997-00d3-4b5d-8216-a1d02d62a1ff service nova] Releasing lock "refresh_cache-cad2eedf-c1ef-436c-b608-5b6dafa47451" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:19:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "cad2eedf-c1ef-436c-b608-5b6dafa47451" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:28 user nova-compute[74805]: INFO nova.compute.manager [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Detaching volume 96273922-6a78-407c-81c9-059c9e65020d
Nov 15 04:19:28 user nova-compute[74805]: INFO nova.virt.block_device [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Attempting to driver detach volume 96273922-6a78-407c-81c9-059c9e65020d from mountpoint /dev/vdb
Nov 15 04:19:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Attempting to detach device vdb from instance cad2eedf-c1ef-436c-b608-5b6dafa47451 from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:19:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:19:28 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:19:28 user nova-compute[74805]:   <source dev="/dev/sdc"/>
Nov 15 04:19:28 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:19:28 user nova-compute[74805]:   <serial>96273922-6a78-407c-81c9-059c9e65020d</serial>
Nov 15 04:19:28 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 04:19:28 user nova-compute[74805]: </disk>
Nov 15 04:19:28 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:19:28 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Successfully detached device vdb from instance cad2eedf-c1ef-436c-b608-5b6dafa47451 from the persistent domain config.
Nov 15 04:19:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cad2eedf-c1ef-436c-b608-5b6dafa47451 from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:19:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:19:28 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:19:28 user nova-compute[74805]:   <source dev="/dev/sdc"/>
Nov 15 04:19:28 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:19:28 user nova-compute[74805]:   <serial>96273922-6a78-407c-81c9-059c9e65020d</serial>
Nov 15 04:19:28 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 04:19:28 user nova-compute[74805]: </disk>
Nov 15 04:19:28 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:19:29 user nova-compute[74805]: DEBUG nova.compute.manager [req-bc4d3efb-88df-40a7-b28c-fcebd15de48d req-1dea9f56-c6e9-40e1-9644-313e46793bf0 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Received event network-changed-333d7ad3-7a5b-49e8-a657-a712443ad922 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:19:29 user nova-compute[74805]: DEBUG nova.compute.manager [req-bc4d3efb-88df-40a7-b28c-fcebd15de48d req-1dea9f56-c6e9-40e1-9644-313e46793bf0 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Refreshing instance network info cache due to event network-changed-333d7ad3-7a5b-49e8-a657-a712443ad922. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:19:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bc4d3efb-88df-40a7-b28c-fcebd15de48d req-1dea9f56-c6e9-40e1-9644-313e46793bf0 service nova] Acquiring lock "refresh_cache-cad2eedf-c1ef-436c-b608-5b6dafa47451" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:19:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bc4d3efb-88df-40a7-b28c-fcebd15de48d req-1dea9f56-c6e9-40e1-9644-313e46793bf0 service nova] Acquired lock "refresh_cache-cad2eedf-c1ef-436c-b608-5b6dafa47451" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:19:29 user nova-compute[74805]: DEBUG nova.network.neutron [req-bc4d3efb-88df-40a7-b28c-fcebd15de48d req-1dea9f56-c6e9-40e1-9644-313e46793bf0 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Refreshing network info cache for port 333d7ad3-7a5b-49e8-a657-a712443ad922 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:19:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cad2eedf-c1ef-436c-b608-5b6dafa47451 {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:19:29 user nova-compute[74805]: DEBUG nova.network.neutron [req-bc4d3efb-88df-40a7-b28c-fcebd15de48d req-1dea9f56-c6e9-40e1-9644-313e46793bf0 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Updated VIF entry in instance network info cache for port 333d7ad3-7a5b-49e8-a657-a712443ad922. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:19:29 user nova-compute[74805]: DEBUG nova.network.neutron [req-bc4d3efb-88df-40a7-b28c-fcebd15de48d req-1dea9f56-c6e9-40e1-9644-313e46793bf0 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Updating instance_info_cache with network_info: [{"id": "333d7ad3-7a5b-49e8-a657-a712443ad922", "address": "fa:16:3e:ff:8a:9e", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333d7ad3-7a", "ovs_interfaceid": "333d7ad3-7a5b-49e8-a657-a712443ad922", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:19:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bc4d3efb-88df-40a7-b28c-fcebd15de48d req-1dea9f56-c6e9-40e1-9644-313e46793bf0 service nova] Releasing lock "refresh_cache-cad2eedf-c1ef-436c-b608-5b6dafa47451" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:19:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Acquiring lock "4fc66c41-efcf-4014-bedb-3955aed09eba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Lock "4fc66c41-efcf-4014-bedb-3955aed09eba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:45 user nova-compute[74805]: DEBUG nova.compute.manager [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:19:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:45 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:19:45 user nova-compute[74805]: INFO nova.compute.claims [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Claim successful on node user
Nov 15 04:19:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:45 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:19:45 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:19:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:45 user nova-compute[74805]: DEBUG nova.compute.manager [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:19:45 user nova-compute[74805]: DEBUG nova.compute.manager [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:19:45 user nova-compute[74805]: DEBUG nova.network.neutron [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:19:45 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:19:45 user nova-compute[74805]: DEBUG nova.compute.manager [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:19:45 user nova-compute[74805]: DEBUG nova.policy [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30932c0fbe064cfb8e58632a94a0df5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6b46f53769498ba5dc7974fa5557d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG nova.compute.manager [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:19:46 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Creating image(s)
Nov 15 04:19:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Acquiring lock "/opt/stack/data/nova/instances/4fc66c41-efcf-4014-bedb-3955aed09eba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Lock "/opt/stack/data/nova/instances/4fc66c41-efcf-4014-bedb-3955aed09eba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Lock "/opt/stack/data/nova/instances/4fc66c41-efcf-4014-bedb-3955aed09eba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.209s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.212s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/4fc66c41-efcf-4014-bedb-3955aed09eba/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG nova.network.neutron [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Successfully created port: 1484f8c9-4a63-494a-8710-6c6aa1ac355b {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/4fc66c41-efcf-4014-bedb-3955aed09eba/disk 1073741824" returned: 0 in 0.064s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ec1a18af-74f5-41e1-8a6f-a34a3dc028e8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ec1a18af-74f5-41e1-8a6f-a34a3dc028e8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ec1a18af-74f5-41e1-8a6f-a34a3dc028e8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ec1a18af-74f5-41e1-8a6f-a34a3dc028e8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ec1a18af-74f5-41e1-8a6f-a34a3dc028e8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:46 user nova-compute[74805]: INFO nova.compute.manager [None req-ec1a18af-74f5-41e1-8a6f-a34a3dc028e8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Terminating instance
Nov 15 04:19:46 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ec1a18af-74f5-41e1-8a6f-a34a3dc028e8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.206s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4fc66c41-efcf-4014-bedb-3955aed09eba/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fc66c41-efcf-4014-bedb-3955aed09eba/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fc66c41-efcf-4014-bedb-3955aed09eba/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Cannot resize image /opt/stack/data/nova/instances/4fc66c41-efcf-4014-bedb-3955aed09eba/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Ensure instance console log exists: /opt/stack/data/nova/instances/4fc66c41-efcf-4014-bedb-3955aed09eba/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG nova.compute.manager [req-e9e878ab-d020-4239-857c-2597c479cd26 req-fe44c6f1-cb6e-4db8-96cf-287776a45a6a service nova] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Received event network-vif-unplugged-94bbd0d6-bf79-45aa-b274-8a9b44dd26ab {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e9e878ab-d020-4239-857c-2597c479cd26 req-fe44c6f1-cb6e-4db8-96cf-287776a45a6a service nova] Acquiring lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e9e878ab-d020-4239-857c-2597c479cd26 req-fe44c6f1-cb6e-4db8-96cf-287776a45a6a service nova] Lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.351s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e9e878ab-d020-4239-857c-2597c479cd26 req-fe44c6f1-cb6e-4db8-96cf-287776a45a6a service nova] Lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG nova.compute.manager [req-e9e878ab-d020-4239-857c-2597c479cd26 req-fe44c6f1-cb6e-4db8-96cf-287776a45a6a service nova] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] No waiting events found dispatching network-vif-unplugged-94bbd0d6-bf79-45aa-b274-8a9b44dd26ab {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG nova.compute.manager [req-e9e878ab-d020-4239-857c-2597c479cd26 req-fe44c6f1-cb6e-4db8-96cf-287776a45a6a service nova] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Received event network-vif-unplugged-94bbd0d6-bf79-45aa-b274-8a9b44dd26ab for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG nova.network.neutron [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Successfully updated port: 1484f8c9-4a63-494a-8710-6c6aa1ac355b {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG nova.compute.manager [req-a0c7d02c-5df0-437b-abf3-30b676800983 req-12cee3ab-b93b-42ab-becd-c19e8e21d888 service nova] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Received event network-changed-1484f8c9-4a63-494a-8710-6c6aa1ac355b {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG nova.compute.manager [req-a0c7d02c-5df0-437b-abf3-30b676800983 req-12cee3ab-b93b-42ab-becd-c19e8e21d888 service nova] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Refreshing instance network info cache due to event network-changed-1484f8c9-4a63-494a-8710-6c6aa1ac355b. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-a0c7d02c-5df0-437b-abf3-30b676800983 req-12cee3ab-b93b-42ab-becd-c19e8e21d888 service nova] Acquiring lock "refresh_cache-4fc66c41-efcf-4014-bedb-3955aed09eba" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-a0c7d02c-5df0-437b-abf3-30b676800983 req-12cee3ab-b93b-42ab-becd-c19e8e21d888 service nova] Acquired lock "refresh_cache-4fc66c41-efcf-4014-bedb-3955aed09eba" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG nova.network.neutron [req-a0c7d02c-5df0-437b-abf3-30b676800983 req-12cee3ab-b93b-42ab-becd-c19e8e21d888 service nova] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Refreshing network info cache for port 1484f8c9-4a63-494a-8710-6c6aa1ac355b {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Acquiring lock "refresh_cache-4fc66c41-efcf-4014-bedb-3955aed09eba" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:19:47 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Instance destroyed successfully.
Nov 15 04:19:47 user nova-compute[74805]: DEBUG nova.objects.instance [None req-ec1a18af-74f5-41e1-8a6f-a34a3dc028e8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lazy-loading 'resources' on Instance uuid 1eb9b315-77a9-40f7-8a43-8c40186a0dca {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-ec1a18af-74f5-41e1-8a6f-a34a3dc028e8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-182608907',display_name='tempest-AttachVolumeNegativeTest-server-182608907',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-182608907',id=4,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUB6ZnABifX60Rx7aCctgxR0goJQCmaMO1REZVKR3evnyv0kCHcFwrrK+URZjiYPRnnqsZ27OpGG6l7q+iF9UuxPqWjfT46yC7PEfUNo4XSgR1dPGrG1THwQSF3ONDPuQ==',key_name='tempest-keypair-1757814916',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:14:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8280c6302b2e42998c7c436522c47e79',ramdisk_id='',reservation_id='r-be0d6xkj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-6184130',owner_user_name='tempest-AttachVolumeNegativeTest-6184130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:14:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba1bcf1e429045129d379293cc490bde',uuid=1eb9b315-77a9-40f7-8a43-8c40186a0dca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94bbd0d6-bf79-45aa-b274-8a9b44dd26ab", "address": "fa:16:3e:80:32:cf", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94bbd0d6-bf", "ovs_interfaceid": "94bbd0d6-bf79-45aa-b274-8a9b44dd26ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ec1a18af-74f5-41e1-8a6f-a34a3dc028e8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Converting VIF {"id": "94bbd0d6-bf79-45aa-b274-8a9b44dd26ab", "address": "fa:16:3e:80:32:cf", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94bbd0d6-bf", "ovs_interfaceid": "94bbd0d6-bf79-45aa-b274-8a9b44dd26ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ec1a18af-74f5-41e1-8a6f-a34a3dc028e8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:32:cf,bridge_name='br-int',has_traffic_filtering=True,id=94bbd0d6-bf79-45aa-b274-8a9b44dd26ab,network=Network(3454b4d8-1ff9-4f3c-9a93-499645affcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94bbd0d6-bf') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG os_vif [None req-ec1a18af-74f5-41e1-8a6f-a34a3dc028e8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:32:cf,bridge_name='br-int',has_traffic_filtering=True,id=94bbd0d6-bf79-45aa-b274-8a9b44dd26ab,network=Network(3454b4d8-1ff9-4f3c-9a93-499645affcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94bbd0d6-bf') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94bbd0d6-bf, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=deb5d9f2-1b83-4f91-81e6-749673a4b8a1) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:47 user nova-compute[74805]: INFO os_vif [None req-ec1a18af-74f5-41e1-8a6f-a34a3dc028e8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:32:cf,bridge_name='br-int',has_traffic_filtering=True,id=94bbd0d6-bf79-45aa-b274-8a9b44dd26ab,network=Network(3454b4d8-1ff9-4f3c-9a93-499645affcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94bbd0d6-bf')
Nov 15 04:19:47 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-ec1a18af-74f5-41e1-8a6f-a34a3dc028e8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Deleting instance files /opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca_del
Nov 15 04:19:47 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-ec1a18af-74f5-41e1-8a6f-a34a3dc028e8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Deletion of /opt/stack/data/nova/instances/1eb9b315-77a9-40f7-8a43-8c40186a0dca_del complete
Nov 15 04:19:47 user nova-compute[74805]: DEBUG nova.network.neutron [req-a0c7d02c-5df0-437b-abf3-30b676800983 req-12cee3ab-b93b-42ab-becd-c19e8e21d888 service nova] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:19:47 user nova-compute[74805]: INFO nova.compute.manager [None req-ec1a18af-74f5-41e1-8a6f-a34a3dc028e8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 15 04:19:47 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-ec1a18af-74f5-41e1-8a6f-a34a3dc028e8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG nova.network.neutron [req-a0c7d02c-5df0-437b-abf3-30b676800983 req-12cee3ab-b93b-42ab-becd-c19e8e21d888 service nova] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-a0c7d02c-5df0-437b-abf3-30b676800983 req-12cee3ab-b93b-42ab-becd-c19e8e21d888 service nova] Releasing lock "refresh_cache-4fc66c41-efcf-4014-bedb-3955aed09eba" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Acquired lock "refresh_cache-4fc66c41-efcf-4014-bedb-3955aed09eba" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG nova.network.neutron [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:19:47 user nova-compute[74805]: DEBUG nova.network.neutron [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.compute.manager [req-af37147f-000f-41b6-95ee-3924542f91d7 req-3531e811-69f9-434f-a8ed-64388d08b3b9 service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Received event network-changed-62730abb-e77d-4e27-8e57-929086b708e3 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.compute.manager [req-af37147f-000f-41b6-95ee-3924542f91d7 req-3531e811-69f9-434f-a8ed-64388d08b3b9 service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Refreshing instance network info cache due to event network-changed-62730abb-e77d-4e27-8e57-929086b708e3. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-af37147f-000f-41b6-95ee-3924542f91d7 req-3531e811-69f9-434f-a8ed-64388d08b3b9 service nova] Acquiring lock "refresh_cache-51e0a627-f95e-4347-92a7-4a218413e884" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-af37147f-000f-41b6-95ee-3924542f91d7 req-3531e811-69f9-434f-a8ed-64388d08b3b9 service nova] Acquired lock "refresh_cache-51e0a627-f95e-4347-92a7-4a218413e884" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.network.neutron [req-af37147f-000f-41b6-95ee-3924542f91d7 req-3531e811-69f9-434f-a8ed-64388d08b3b9 service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Refreshing network info cache for port 62730abb-e77d-4e27-8e57-929086b708e3 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.network.neutron [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Updating instance_info_cache with network_info: [{"id": "1484f8c9-4a63-494a-8710-6c6aa1ac355b", "address": "fa:16:3e:77:a9:2a", "network": {"id": "2137d20f-a0a2-4592-97ad-b12decfc2226", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1742182403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf6b46f53769498ba5dc7974fa5557d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1484f8c9-4a", "ovs_interfaceid": "1484f8c9-4a63-494a-8710-6c6aa1ac355b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Releasing lock "refresh_cache-4fc66c41-efcf-4014-bedb-3955aed09eba" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.compute.manager [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Instance network_info: |[{"id": "1484f8c9-4a63-494a-8710-6c6aa1ac355b", "address": "fa:16:3e:77:a9:2a", "network": {"id": "2137d20f-a0a2-4592-97ad-b12decfc2226", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1742182403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf6b46f53769498ba5dc7974fa5557d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1484f8c9-4a", "ovs_interfaceid": "1484f8c9-4a63-494a-8710-6c6aa1ac355b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Start _get_guest_xml network_info=[{"id": "1484f8c9-4a63-494a-8710-6c6aa1ac355b", "address": "fa:16:3e:77:a9:2a", "network": {"id": "2137d20f-a0a2-4592-97ad-b12decfc2226", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1742182403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf6b46f53769498ba5dc7974fa5557d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1484f8c9-4a", "ovs_interfaceid": "1484f8c9-4a63-494a-8710-6c6aa1ac355b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:19:48 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:19:48 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:19:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1826505767',display_name='tempest-VolumesActionsTest-instance-1826505767',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1826505767',id=20,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf6b46f53769498ba5dc7974fa5557d9',ramdisk_id='',reservation_id='r-rrp1l4s4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1935850684',owner_user_name='tempest-VolumesActionsTest-1935850684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:19:46Z,user_data=None,user_id='30932c0fbe064cfb8e58632a94a0df5c',uuid=4fc66c41-efcf-4014-bedb-3955aed09eba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1484f8c9-4a63-494a-8710-6c6aa1ac355b", "address": "fa:16:3e:77:a9:2a", "network": {"id": "2137d20f-a0a2-4592-97ad-b12decfc2226", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1742182403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf6b46f53769498ba5dc7974fa5557d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1484f8c9-4a", "ovs_interfaceid": "1484f8c9-4a63-494a-8710-6c6aa1ac355b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Converting VIF {"id": "1484f8c9-4a63-494a-8710-6c6aa1ac355b", "address": "fa:16:3e:77:a9:2a", "network": {"id": "2137d20f-a0a2-4592-97ad-b12decfc2226", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1742182403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf6b46f53769498ba5dc7974fa5557d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1484f8c9-4a", "ovs_interfaceid": "1484f8c9-4a63-494a-8710-6c6aa1ac355b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:a9:2a,bridge_name='br-int',has_traffic_filtering=True,id=1484f8c9-4a63-494a-8710-6c6aa1ac355b,network=Network(2137d20f-a0a2-4592-97ad-b12decfc2226),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1484f8c9-4a') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.objects.instance [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fc66c41-efcf-4014-bedb-3955aed09eba {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:19:48 user nova-compute[74805]:   <uuid>4fc66c41-efcf-4014-bedb-3955aed09eba</uuid>
Nov 15 04:19:48 user nova-compute[74805]:   <name>instance-00000014</name>
Nov 15 04:19:48 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:19:48 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:19:48 user nova-compute[74805]:   <metadata>
Nov 15 04:19:48 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:19:48 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:19:48 user nova-compute[74805]:       <nova:name>tempest-VolumesActionsTest-instance-1826505767</nova:name>
Nov 15 04:19:48 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:19:48</nova:creationTime>
Nov 15 04:19:48 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:19:48 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:19:48 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:19:48 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:19:48 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:19:48 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:19:48 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:19:48 user nova-compute[74805]:       <nova:owner>
Nov 15 04:19:48 user nova-compute[74805]:         <nova:user uuid="30932c0fbe064cfb8e58632a94a0df5c">tempest-VolumesActionsTest-1935850684-project-member</nova:user>
Nov 15 04:19:48 user nova-compute[74805]:         <nova:project uuid="bf6b46f53769498ba5dc7974fa5557d9">tempest-VolumesActionsTest-1935850684</nova:project>
Nov 15 04:19:48 user nova-compute[74805]:       </nova:owner>
Nov 15 04:19:48 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:19:48 user nova-compute[74805]:       <nova:ports>
Nov 15 04:19:48 user nova-compute[74805]:         <nova:port uuid="1484f8c9-4a63-494a-8710-6c6aa1ac355b">
Nov 15 04:19:48 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 04:19:48 user nova-compute[74805]:         </nova:port>
Nov 15 04:19:48 user nova-compute[74805]:       </nova:ports>
Nov 15 04:19:48 user nova-compute[74805]:     </nova:instance>
Nov 15 04:19:48 user nova-compute[74805]:   </metadata>
Nov 15 04:19:48 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:19:48 user nova-compute[74805]:     <system>
Nov 15 04:19:48 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:19:48 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:19:48 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:19:48 user nova-compute[74805]:       <entry name="serial">4fc66c41-efcf-4014-bedb-3955aed09eba</entry>
Nov 15 04:19:48 user nova-compute[74805]:       <entry name="uuid">4fc66c41-efcf-4014-bedb-3955aed09eba</entry>
Nov 15 04:19:48 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:19:48 user nova-compute[74805]:     </system>
Nov 15 04:19:48 user nova-compute[74805]:   </sysinfo>
Nov 15 04:19:48 user nova-compute[74805]:   <os>
Nov 15 04:19:48 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:19:48 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:19:48 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:19:48 user nova-compute[74805]:   </os>
Nov 15 04:19:48 user nova-compute[74805]:   <features>
Nov 15 04:19:48 user nova-compute[74805]:     <acpi/>
Nov 15 04:19:48 user nova-compute[74805]:     <apic/>
Nov 15 04:19:48 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:19:48 user nova-compute[74805]:   </features>
Nov 15 04:19:48 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:19:48 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:19:48 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:19:48 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:19:48 user nova-compute[74805]:   </clock>
Nov 15 04:19:48 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:19:48 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:19:48 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:19:48 user nova-compute[74805]:   </cpu>
Nov 15 04:19:48 user nova-compute[74805]:   <devices>
Nov 15 04:19:48 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:19:48 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:19:48 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/4fc66c41-efcf-4014-bedb-3955aed09eba/disk"/>
Nov 15 04:19:48 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:19:48 user nova-compute[74805]:     </disk>
Nov 15 04:19:48 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:19:48 user nova-compute[74805]:       <mac address="fa:16:3e:77:a9:2a"/>
Nov 15 04:19:48 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:19:48 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:19:48 user nova-compute[74805]:       <target dev="tap1484f8c9-4a"/>
Nov 15 04:19:48 user nova-compute[74805]:     </interface>
Nov 15 04:19:48 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:19:48 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/4fc66c41-efcf-4014-bedb-3955aed09eba/console.log" append="off"/>
Nov 15 04:19:48 user nova-compute[74805]:     </serial>
Nov 15 04:19:48 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:19:48 user nova-compute[74805]:     <video>
Nov 15 04:19:48 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:19:48 user nova-compute[74805]:     </video>
Nov 15 04:19:48 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:19:48 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:19:48 user nova-compute[74805]:     </rng>
Nov 15 04:19:48 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:19:48 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:19:48 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:19:48 user nova-compute[74805]:     </memballoon>
Nov 15 04:19:48 user nova-compute[74805]:   </devices>
Nov 15 04:19:48 user nova-compute[74805]: </domain>
Nov 15 04:19:48 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:19:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1826505767',display_name='tempest-VolumesActionsTest-instance-1826505767',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1826505767',id=20,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf6b46f53769498ba5dc7974fa5557d9',ramdisk_id='',reservation_id='r-rrp1l4s4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1935850684',owner_user_name='tempest-VolumesActionsTest-1935850684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:19:46Z,user_data=None,user_id='30932c0fbe064cfb8e58632a94a0df5c',uuid=4fc66c41-efcf-4014-bedb-3955aed09eba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1484f8c9-4a63-494a-8710-6c6aa1ac355b", "address": "fa:16:3e:77:a9:2a", "network": {"id": "2137d20f-a0a2-4592-97ad-b12decfc2226", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1742182403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf6b46f53769498ba5dc7974fa5557d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1484f8c9-4a", "ovs_interfaceid": "1484f8c9-4a63-494a-8710-6c6aa1ac355b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Converting VIF {"id": "1484f8c9-4a63-494a-8710-6c6aa1ac355b", "address": "fa:16:3e:77:a9:2a", "network": {"id": "2137d20f-a0a2-4592-97ad-b12decfc2226", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1742182403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf6b46f53769498ba5dc7974fa5557d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1484f8c9-4a", "ovs_interfaceid": "1484f8c9-4a63-494a-8710-6c6aa1ac355b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:a9:2a,bridge_name='br-int',has_traffic_filtering=True,id=1484f8c9-4a63-494a-8710-6c6aa1ac355b,network=Network(2137d20f-a0a2-4592-97ad-b12decfc2226),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1484f8c9-4a') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG os_vif [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:a9:2a,bridge_name='br-int',has_traffic_filtering=True,id=1484f8c9-4a63-494a-8710-6c6aa1ac355b,network=Network(2137d20f-a0a2-4592-97ad-b12decfc2226),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1484f8c9-4a') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '963f1c56-4265-582e-be59-1a42ad09d891', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1484f8c9-4a, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1484f8c9-4a, col_values=(('qos', UUID('518af0a5-56c7-4560-893e-6c554b0b4a4a')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1484f8c9-4a, col_values=(('external_ids', {'iface-id': '1484f8c9-4a63-494a-8710-6c6aa1ac355b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:a9:2a', 'vm-uuid': '4fc66c41-efcf-4014-bedb-3955aed09eba'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:48 user nova-compute[74805]: INFO os_vif [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:a9:2a,bridge_name='br-int',has_traffic_filtering=True,id=1484f8c9-4a63-494a-8710-6c6aa1ac355b,network=Network(2137d20f-a0a2-4592-97ad-b12decfc2226),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1484f8c9-4a')
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] No VIF found with MAC fa:16:3e:77:a9:2a, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.network.neutron [req-af37147f-000f-41b6-95ee-3924542f91d7 req-3531e811-69f9-434f-a8ed-64388d08b3b9 service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Updated VIF entry in instance network info cache for port 62730abb-e77d-4e27-8e57-929086b708e3. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.network.neutron [req-af37147f-000f-41b6-95ee-3924542f91d7 req-3531e811-69f9-434f-a8ed-64388d08b3b9 service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Updating instance_info_cache with network_info: [{"id": "62730abb-e77d-4e27-8e57-929086b708e3", "address": "fa:16:3e:b0:20:4f", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62730abb-e7", "ovs_interfaceid": "62730abb-e77d-4e27-8e57-929086b708e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-af37147f-000f-41b6-95ee-3924542f91d7 req-3531e811-69f9-434f-a8ed-64388d08b3b9 service nova] Releasing lock "refresh_cache-51e0a627-f95e-4347-92a7-4a218413e884" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "51e0a627-f95e-4347-92a7-4a218413e884" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "51e0a627-f95e-4347-92a7-4a218413e884" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.objects.instance [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lazy-loading 'flavor' on Instance uuid 51e0a627-f95e-4347-92a7-4a218413e884 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "51e0a627-f95e-4347-92a7-4a218413e884" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:48 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Took 1.11 seconds to deallocate network for instance.
Nov 15 04:19:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ec1a18af-74f5-41e1-8a6f-a34a3dc028e8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ec1a18af-74f5-41e1-8a6f-a34a3dc028e8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "51e0a627-f95e-4347-92a7-4a218413e884" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "51e0a627-f95e-4347-92a7-4a218413e884" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:48 user nova-compute[74805]: INFO nova.compute.manager [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Attaching volume c514702d-74f1-4d8a-892b-2b6750ac4eaf to /dev/vdb
Nov 15 04:19:48 user nova-compute[74805]: DEBUG os_brick.utils [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a2b453-537d-4ccf-af2a-28c81c5e1f1e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea8600b-bf3b-46ae-bc98-737758ae109d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[17484d23-4a08-4311-bfd1-46d3de8d100a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[517786c8-9013-4828-8798-e2bd766c0c89]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:19:49 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edad39b-51e5-495b-8323-d3650109742e]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG os_brick.utils [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Updating existing volume attachment record: 7caf5354-fe49-4f4f-95a6-28f3cd5fd698 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG nova.compute.manager [req-882572ca-2904-40ee-acf3-3ed756e7f3f8 req-81e83a19-e33a-404f-9233-56bb4aec2fdc service nova] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Received event network-vif-plugged-94bbd0d6-bf79-45aa-b274-8a9b44dd26ab {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-882572ca-2904-40ee-acf3-3ed756e7f3f8 req-81e83a19-e33a-404f-9233-56bb4aec2fdc service nova] Acquiring lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-882572ca-2904-40ee-acf3-3ed756e7f3f8 req-81e83a19-e33a-404f-9233-56bb4aec2fdc service nova] Lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-882572ca-2904-40ee-acf3-3ed756e7f3f8 req-81e83a19-e33a-404f-9233-56bb4aec2fdc service nova] Lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG nova.compute.manager [req-882572ca-2904-40ee-acf3-3ed756e7f3f8 req-81e83a19-e33a-404f-9233-56bb4aec2fdc service nova] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] No waiting events found dispatching network-vif-plugged-94bbd0d6-bf79-45aa-b274-8a9b44dd26ab {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:19:49 user nova-compute[74805]: WARNING nova.compute.manager [req-882572ca-2904-40ee-acf3-3ed756e7f3f8 req-81e83a19-e33a-404f-9233-56bb4aec2fdc service nova] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Received unexpected event network-vif-plugged-94bbd0d6-bf79-45aa-b274-8a9b44dd26ab for instance with vm_state deleted and task_state None.
Nov 15 04:19:49 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-ec1a18af-74f5-41e1-8a6f-a34a3dc028e8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-ec1a18af-74f5-41e1-8a6f-a34a3dc028e8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ec1a18af-74f5-41e1-8a6f-a34a3dc028e8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.497s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:49 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cad2eedf-c1ef-436c-b608-5b6dafa47451 is timed out.
Nov 15 04:19:49 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Successfully detached device vdb from instance cad2eedf-c1ef-436c-b608-5b6dafa47451 from the live domain config.
Nov 15 04:19:49 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SyLpHCfM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:19:49 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:19:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:49 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-ec1a18af-74f5-41e1-8a6f-a34a3dc028e8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Deleted allocations for instance 1eb9b315-77a9-40f7-8a43-8c40186a0dca
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbc0f43-6064-4b4a-85f7-636cf165c0a8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:19:49 user nova-compute[74805]: No targets found.
Nov 15 04:19:49 user nova-compute[74805]: iSNS:
Nov 15 04:19:49 user nova-compute[74805]: No targets found.
Nov 15 04:19:49 user nova-compute[74805]: STATIC:
Nov 15 04:19:49 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402
Nov 15 04:19:49 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:19:49 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:19:49 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4
Nov 15 04:19:49 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:19:49 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:19:49 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7
Nov 15 04:19:49 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:19:49 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:19:49 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d
Nov 15 04:19:49 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:19:49 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:19:49 user nova-compute[74805]: FIRMWARE:
Nov 15 04:19:49 user nova-compute[74805]: No targets found.
Nov 15 04:19:49 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:19:49 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:19:49 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8f641f-1f54-4c4a-84a1-1572a06effc1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2de52b-0dbd-4f97-ac88-8a38d37ed212]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:19:49 user nova-compute[74805]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:19:49 user nova-compute[74805]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:19:49 user nova-compute[74805]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:19:49 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d (non-flash)
Nov 15 04:19:49 user nova-compute[74805]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:19:49 user nova-compute[74805]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:19:49 user nova-compute[74805]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:19:49 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f78737760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d'): ({'sdc'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Removing single pathed devices sdc {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ec1a18af-74f5-41e1-8a6f-a34a3dc028e8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "1eb9b315-77a9-40f7-8a43-8c40186a0dca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.783s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG nova.compute.manager [req-c28b1298-af9e-4d36-ab20-ade44b950b60 req-d86eafa9-e491-49aa-a88e-c636027deaae service nova] [instance: 1eb9b315-77a9-40f7-8a43-8c40186a0dca] Received event network-vif-deleted-94bbd0d6-bf79-45aa-b274-8a9b44dd26ab {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd3d101-8d65-4a32-a5c4-3177cfd8e87e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fd84c1-7212-4aab-81d6-2622edbbba00]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Flushing IO for device /dev/sdc {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.011s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc3ec3d-0cab-4a53-b392-0e44d4318f87]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6569eaf-a3b2-4865-86c4-fe8b5116e00c]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b9e9f3-73a2-43da-ab46-f1e4213d4982]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21db89c-28b5-414e-97ca-e84f48eb9406]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d, portal: 172.16.0.220,3260]
Nov 15 04:19:49 user nova-compute[74805]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d, portal: 172.16.0.220,3260] successful.
Nov 15 04:19:49 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96273922-6a78-407c-81c9-059c9e65020d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc5fa02-56ae-45c0-a3e0-79ff161448b6]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] <== disconnect_volume: return (287ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:50 user nova-compute[74805]: DEBUG nova.compute.manager [req-f7a183f9-710c-4fb2-ae79-e22d8f80b7d0 req-7511ec5d-6a31-4e71-85d2-e2c10358b3ee service nova] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Received event network-vif-plugged-1484f8c9-4a63-494a-8710-6c6aa1ac355b {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:19:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f7a183f9-710c-4fb2-ae79-e22d8f80b7d0 req-7511ec5d-6a31-4e71-85d2-e2c10358b3ee service nova] Acquiring lock "4fc66c41-efcf-4014-bedb-3955aed09eba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f7a183f9-710c-4fb2-ae79-e22d8f80b7d0 req-7511ec5d-6a31-4e71-85d2-e2c10358b3ee service nova] Lock "4fc66c41-efcf-4014-bedb-3955aed09eba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f7a183f9-710c-4fb2-ae79-e22d8f80b7d0 req-7511ec5d-6a31-4e71-85d2-e2c10358b3ee service nova] Lock "4fc66c41-efcf-4014-bedb-3955aed09eba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:50 user nova-compute[74805]: DEBUG nova.compute.manager [req-f7a183f9-710c-4fb2-ae79-e22d8f80b7d0 req-7511ec5d-6a31-4e71-85d2-e2c10358b3ee service nova] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] No waiting events found dispatching network-vif-plugged-1484f8c9-4a63-494a-8710-6c6aa1ac355b {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:19:50 user nova-compute[74805]: WARNING nova.compute.manager [req-f7a183f9-710c-4fb2-ae79-e22d8f80b7d0 req-7511ec5d-6a31-4e71-85d2-e2c10358b3ee service nova] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Received unexpected event network-vif-plugged-1484f8c9-4a63-494a-8710-6c6aa1ac355b for instance with vm_state building and task_state spawning.
Nov 15 04:19:50 user nova-compute[74805]: DEBUG nova.objects.instance [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lazy-loading 'flavor' on Instance uuid cad2eedf-c1ef-436c-b608-5b6dafa47451 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:19:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-eeb1928d-a81b-49a2-842d-4569fe2c6610 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.760s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:51 user nova-compute[74805]: DEBUG nova.compute.manager [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:19:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:19:51 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Instance spawned successfully.
Nov 15 04:19:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:19:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:19:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:19:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:19:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:19:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:19:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:19:51 user nova-compute[74805]: INFO nova.compute.manager [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Took 5.87 seconds to spawn the instance on the hypervisor.
Nov 15 04:19:51 user nova-compute[74805]: DEBUG nova.compute.manager [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:19:52 user nova-compute[74805]: INFO nova.compute.manager [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Took 6.69 seconds to build instance.
Nov 15 04:19:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5ffac6ee-3d50-4797-89b2-e7f908895156 tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Lock "4fc66c41-efcf-4014-bedb-3955aed09eba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.778s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:52 user nova-compute[74805]: DEBUG nova.compute.manager [req-8503bc05-2992-448d-b83f-1afcf2a97d93 req-4c398c41-4f3d-43df-b4b7-ea383b351128 service nova] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Received event network-vif-plugged-1484f8c9-4a63-494a-8710-6c6aa1ac355b {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:19:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8503bc05-2992-448d-b83f-1afcf2a97d93 req-4c398c41-4f3d-43df-b4b7-ea383b351128 service nova] Acquiring lock "4fc66c41-efcf-4014-bedb-3955aed09eba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8503bc05-2992-448d-b83f-1afcf2a97d93 req-4c398c41-4f3d-43df-b4b7-ea383b351128 service nova] Lock "4fc66c41-efcf-4014-bedb-3955aed09eba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8503bc05-2992-448d-b83f-1afcf2a97d93 req-4c398c41-4f3d-43df-b4b7-ea383b351128 service nova] Lock "4fc66c41-efcf-4014-bedb-3955aed09eba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:52 user nova-compute[74805]: DEBUG nova.compute.manager [req-8503bc05-2992-448d-b83f-1afcf2a97d93 req-4c398c41-4f3d-43df-b4b7-ea383b351128 service nova] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] No waiting events found dispatching network-vif-plugged-1484f8c9-4a63-494a-8710-6c6aa1ac355b {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:19:52 user nova-compute[74805]: WARNING nova.compute.manager [req-8503bc05-2992-448d-b83f-1afcf2a97d93 req-4c398c41-4f3d-43df-b4b7-ea383b351128 service nova] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Received unexpected event network-vif-plugged-1484f8c9-4a63-494a-8710-6c6aa1ac355b for instance with vm_state active and task_state None.
Nov 15 04:19:53 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:54 user nova-compute[74805]: DEBUG nova.network.neutron [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Port 2bdff360-1f21-4ce8-9c04-a5115a3316b2 binding to destination host user is already ACTIVE {{(pid=74805) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 04:19:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquiring lock "refresh_cache-39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:19:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquired lock "refresh_cache-39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:19:54 user nova-compute[74805]: DEBUG nova.network.neutron [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:19:54 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG nova.network.neutron [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Updating instance_info_cache with network_info: [{"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Releasing lock "refresh_cache-39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Creating tmpfile /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/tmpgsd4allg to verify with other compute node that the instance is on the same shared storage. {{(pid=74805) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBvotOfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:19:55 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:19:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:19:55 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:19:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:19:55 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee45f915-2777-4c0c-8c3d-97f74ac65b1b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:19:55 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG nova.compute.manager [req-bf4058a4-746f-4116-bb3f-8e853dc8cdbe req-2513ae2e-417d-4b6e-b485-22060ea17e99 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Received event network-vif-unplugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bf4058a4-746f-4116-bb3f-8e853dc8cdbe req-2513ae2e-417d-4b6e-b485-22060ea17e99 service nova] Acquiring lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bf4058a4-746f-4116-bb3f-8e853dc8cdbe req-2513ae2e-417d-4b6e-b485-22060ea17e99 service nova] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bf4058a4-746f-4116-bb3f-8e853dc8cdbe req-2513ae2e-417d-4b6e-b485-22060ea17e99 service nova] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG nova.compute.manager [req-bf4058a4-746f-4116-bb3f-8e853dc8cdbe req-2513ae2e-417d-4b6e-b485-22060ea17e99 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] No waiting events found dispatching network-vif-unplugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:19:55 user nova-compute[74805]: WARNING nova.compute.manager [req-bf4058a4-746f-4116-bb3f-8e853dc8cdbe req-2513ae2e-417d-4b6e-b485-22060ea17e99 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Received unexpected event network-vif-unplugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 for instance with vm_state resized and task_state resize_reverting.
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[917252b3-61db-4f11-9d9d-547904a404a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf] added
Nov 15 04:19:55 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f91684-8d85-40b5-bbb2-2a5f9ddf6c43]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[762e363b-3e47-4c60-ab96-4baa4a3a5fa2]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pBvotOfY {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pBvotOfY" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7664083f-f7a0-4573-a756-92373c525d51]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pBvotOfY'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62487ef-dddc-4cb0-a118-9c2726882675]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[666f887c-7783-4809-9f71-e937c6c9a729]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:19:55 user nova-compute[74805]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:19:55 user nova-compute[74805]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:19:55 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:19:55 user nova-compute[74805]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:19:55 user nova-compute[74805]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:19:55 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eccd2a-f6fc-4f36-9282-e4fb25be132f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf, portal: 172.16.0.220,3260]
Nov 15 04:19:55 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf, portal: 172.16.0.220,3260] successful.
Nov 15 04:19:55 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3b9127-198b-4b45-a49b-90042465b754]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3c5252-259d-401e-8119-620cae9dd1b7]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:19:55 user nova-compute[74805]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:19:55 user nova-compute[74805]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:19:55 user nova-compute[74805]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:19:55 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:19:55 user nova-compute[74805]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:19:55 user nova-compute[74805]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:19:55 user nova-compute[74805]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:19:55 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[31877994-c618-4a65-b913-27803ce7ac8e]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBvotOfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:19:55 user nova-compute[74805]: INFO nova.compute.manager [None req-3749b793-ad2f-4c50-91ef-caafcbcc7b6e tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Unrescuing
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3749b793-ad2f-4c50-91ef-caafcbcc7b6e tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Acquiring lock "refresh_cache-0de78a8a-d66a-4703-a044-89c2f2006860" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3749b793-ad2f-4c50-91ef-caafcbcc7b6e tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Acquired lock "refresh_cache-0de78a8a-d66a-4703-a044-89c2f2006860" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:19:55 user nova-compute[74805]: DEBUG nova.network.neutron [None req-3749b793-ad2f-4c50-91ef-caafcbcc7b6e tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:19:56 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Instance destroyed successfully.
Nov 15 04:19:56 user nova-compute[74805]: DEBUG nova.objects.instance [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lazy-loading 'resources' on Instance uuid 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2010307012',display_name='tempest-ServerActionsTestOtherB-server-2010307012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2010307012',id=3,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN2t8TNG6ZVHF/Uf5V+OtupNhI5/tplcqGEarq2oKWoGX9vvIofLCSj5BmzwvNfOMIgQ6qY6HA1c0ScmczPixk4TIDvFHJbrnEyQ0asmj0Ggpy7B5hD2wopJrs+94VPUA==',key_name='tempest-keypair-149654948',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e12b863b6ed49f3a03f95c105881e5e',ramdisk_id='',reservation_id='r-zfce7v2x',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-997020636',owner_user_name='tempest-ServerActionsTestOtherB-997020636-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:18:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6253a7981e834ef4979d177a04e8eaf8',uuid=39ab9e2c-5856-4fe6-aa2c-42f9ac52632c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Converting VIF {"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:e7:d1,bridge_name='br-int',has_traffic_filtering=True,id=2bdff360-1f21-4ce8-9c04-a5115a3316b2,network=Network(90f83e19-1c70-437a-9f75-cbbca516eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdff360-1f') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG os_vif [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:e7:d1,bridge_name='br-int',has_traffic_filtering=True,id=2bdff360-1f21-4ce8-9c04-a5115a3316b2,network=Network(90f83e19-1c70-437a-9f75-cbbca516eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdff360-1f') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2bdff360-1f, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dab379b1-8ad1-4e91-8613-ef733aaf217e) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:56 user nova-compute[74805]: INFO os_vif [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:e7:d1,bridge_name='br-int',has_traffic_filtering=True,id=2bdff360-1f21-4ce8-9c04-a5115a3316b2,network=Network(90f83e19-1c70-437a-9f75-cbbca516eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdff360-1f')
Nov 15 04:19:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'biAZqcTu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:19:56 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:19:56 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG nova.network.neutron [None req-3749b793-ad2f-4c50-91ef-caafcbcc7b6e tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Updating instance_info_cache with network_info: [{"id": "9f426f7d-ce70-41ba-affa-652a4f62a571", "address": "fa:16:3e:74:98:ab", "network": {"id": "e6f9095e-b477-4654-9fb7-7322e7bb3b9d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1108878484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc936c67de2046ff82115c5ebdb8c844", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f426f7d-ce", "ovs_interfaceid": "9f426f7d-ce70-41ba-affa-652a4f62a571", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3749b793-ad2f-4c50-91ef-caafcbcc7b6e tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Releasing lock "refresh_cache-0de78a8a-d66a-4703-a044-89c2f2006860" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG nova.objects.instance [None req-3749b793-ad2f-4c50-91ef-caafcbcc7b6e tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lazy-loading 'flavor' on Instance uuid 0de78a8a-d66a-4703-a044-89c2f2006860 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG nova.compute.manager [req-52151d3c-82f5-4241-90db-73215926ce1e req-bab20481-04c0-414f-ad43-b92f9e25af0a service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Received event network-vif-unplugged-9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-52151d3c-82f5-4241-90db-73215926ce1e req-bab20481-04c0-414f-ad43-b92f9e25af0a service nova] Acquiring lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-52151d3c-82f5-4241-90db-73215926ce1e req-bab20481-04c0-414f-ad43-b92f9e25af0a service nova] Lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-52151d3c-82f5-4241-90db-73215926ce1e req-bab20481-04c0-414f-ad43-b92f9e25af0a service nova] Lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG nova.compute.manager [req-52151d3c-82f5-4241-90db-73215926ce1e req-bab20481-04c0-414f-ad43-b92f9e25af0a service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] No waiting events found dispatching network-vif-unplugged-9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:19:56 user nova-compute[74805]: WARNING nova.compute.manager [req-52151d3c-82f5-4241-90db-73215926ce1e req-bab20481-04c0-414f-ad43-b92f9e25af0a service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Received unexpected event network-vif-unplugged-9f426f7d-ce70-41ba-affa-652a4f62a571 for instance with vm_state rescued and task_state unrescuing.
Nov 15 04:19:56 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '26538303063383537', 'path': '/dev/sdc'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538303063383537', 'path': '/dev/sdc'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.697s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG nova.objects.instance [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lazy-loading 'flavor' on Instance uuid 51e0a627-f95e-4347-92a7-4a218413e884 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed82cd24-a5bb-4f8c-9e74-842ec0300203]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:19:56 user nova-compute[74805]: No targets found.
Nov 15 04:19:56 user nova-compute[74805]: iSNS:
Nov 15 04:19:56 user nova-compute[74805]: No targets found.
Nov 15 04:19:56 user nova-compute[74805]: STATIC:
Nov 15 04:19:56 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402
Nov 15 04:19:56 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:19:56 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:19:56 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4
Nov 15 04:19:56 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:19:56 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:19:56 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7
Nov 15 04:19:56 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:19:56 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:19:56 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf
Nov 15 04:19:56 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:19:56 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:19:56 user nova-compute[74805]: FIRMWARE:
Nov 15 04:19:56 user nova-compute[74805]: No targets found.
Nov 15 04:19:56 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:19:56 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:19:56 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:19:56 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:19:56 user nova-compute[74805]:   <source dev="/dev/sdc"/>
Nov 15 04:19:56 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:19:56 user nova-compute[74805]:   <serial>c514702d-74f1-4d8a-892b-2b6750ac4eaf</serial>
Nov 15 04:19:56 user nova-compute[74805]: </disk>
Nov 15 04:19:56 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a85bfc-ace9-4b14-99cb-30bd39344d18]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfbb7a4-5ba2-4abc-8595-a4c212a9158f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:19:56 user nova-compute[74805]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:19:56 user nova-compute[74805]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:19:56 user nova-compute[74805]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:19:56 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:19:56 user nova-compute[74805]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:19:56 user nova-compute[74805]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:19:56 user nova-compute[74805]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:19:56 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2fac2015a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4'): ({'sdb'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Removing single pathed devices sdb {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f583a1-982d-4bd2-b7f6-af0e6f3e2ceb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5ca618-327f-4623-9452-dbd051dbd333]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Flushing IO for device /dev/sdb {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c595d240-0459-4d6a-b1b8-de3476897514]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:19:56 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[758cdd27-d5bc-4663-a5f9-45b4ef894852]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8128dab-a385-4899-b65e-462f6c0ec11f]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac49b92-43e6-4c16-a2bb-0fa91bf23d5a]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4, portal: 172.16.0.220,3260]
Nov 15 04:19:57 user nova-compute[74805]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4, portal: 172.16.0.220,3260] successful.
Nov 15 04:19:57 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7d8134-a410-47d1-a574-0a324b526743]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] <== disconnect_volume: return (1074ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:19:57 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Instance destroyed successfully.
Nov 15 04:19:57 user nova-compute[74805]: DEBUG nova.compute.manager [req-80ebc3ee-5dca-4651-9e44-83720d1216e7 req-883ec7e1-0835-4fdc-9f88-55a1dd3e08e8 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Received event network-changed-9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG nova.compute.manager [req-80ebc3ee-5dca-4651-9e44-83720d1216e7 req-883ec7e1-0835-4fdc-9f88-55a1dd3e08e8 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Refreshing instance network info cache due to event network-changed-9f426f7d-ce70-41ba-affa-652a4f62a571. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-80ebc3ee-5dca-4651-9e44-83720d1216e7 req-883ec7e1-0835-4fdc-9f88-55a1dd3e08e8 service nova] Acquiring lock "refresh_cache-0de78a8a-d66a-4703-a044-89c2f2006860" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-80ebc3ee-5dca-4651-9e44-83720d1216e7 req-883ec7e1-0835-4fdc-9f88-55a1dd3e08e8 service nova] Acquired lock "refresh_cache-0de78a8a-d66a-4703-a044-89c2f2006860" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG nova.network.neutron [req-80ebc3ee-5dca-4651-9e44-83720d1216e7 req-883ec7e1-0835-4fdc-9f88-55a1dd3e08e8 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Refreshing network info cache for port 9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG nova.compute.manager [req-713ccbdf-ccc5-4a3e-a1c1-a4cd5715e050 req-62492538-6eb4-42ac-8cdb-0d4ec806cf12 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Received event network-vif-plugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-713ccbdf-ccc5-4a3e-a1c1-a4cd5715e050 req-62492538-6eb4-42ac-8cdb-0d4ec806cf12 service nova] Acquiring lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-713ccbdf-ccc5-4a3e-a1c1-a4cd5715e050 req-62492538-6eb4-42ac-8cdb-0d4ec806cf12 service nova] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-713ccbdf-ccc5-4a3e-a1c1-a4cd5715e050 req-62492538-6eb4-42ac-8cdb-0d4ec806cf12 service nova] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG nova.compute.manager [req-713ccbdf-ccc5-4a3e-a1c1-a4cd5715e050 req-62492538-6eb4-42ac-8cdb-0d4ec806cf12 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] No waiting events found dispatching network-vif-plugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:19:57 user nova-compute[74805]: WARNING nova.compute.manager [req-713ccbdf-ccc5-4a3e-a1c1-a4cd5715e050 req-62492538-6eb4-42ac-8cdb-0d4ec806cf12 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Received unexpected event network-vif-plugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 for instance with vm_state resized and task_state resize_reverting.
Nov 15 04:19:57 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] No VIF found with MAC fa:16:3e:b0:20:4f, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f6ce83ce-ed6a-4b93-bd53-79a05e76d1b4 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "51e0a627-f95e-4347-92a7-4a218413e884" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.891s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG nova.network.neutron [req-80ebc3ee-5dca-4651-9e44-83720d1216e7 req-883ec7e1-0835-4fdc-9f88-55a1dd3e08e8 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Updated VIF entry in instance network info cache for port 9f426f7d-ce70-41ba-affa-652a4f62a571. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:19:57 user nova-compute[74805]: DEBUG nova.network.neutron [req-80ebc3ee-5dca-4651-9e44-83720d1216e7 req-883ec7e1-0835-4fdc-9f88-55a1dd3e08e8 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Updating instance_info_cache with network_info: [{"id": "9f426f7d-ce70-41ba-affa-652a4f62a571", "address": "fa:16:3e:74:98:ab", "network": {"id": "e6f9095e-b477-4654-9fb7-7322e7bb3b9d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1108878484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc936c67de2046ff82115c5ebdb8c844", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f426f7d-ce", "ovs_interfaceid": "9f426f7d-ce70-41ba-affa-652a4f62a571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:19:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-80ebc3ee-5dca-4651-9e44-83720d1216e7 req-883ec7e1-0835-4fdc-9f88-55a1dd3e08e8 service nova] Releasing lock "refresh_cache-0de78a8a-d66a-4703-a044-89c2f2006860" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:19:58 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:19:58 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74805) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 04:19:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:58 user nova-compute[74805]: DEBUG nova.objects.instance [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lazy-loading 'migration_context' on Instance uuid 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:19:58 user nova-compute[74805]: DEBUG nova.objects.base [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Object Instance<39ab9e2c-5856-4fe6-aa2c-42f9ac52632c> lazy-loaded attributes: resources,migration_context {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:19:58 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:19:58 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:19:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.454s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:58 user nova-compute[74805]: INFO nova.compute.manager [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Swapping old allocation on dict_keys(['ada87504-5552-4a33-b754-f9a54c67fe39']) held by migration 8aa43d18-f607-4bdb-b5be-aa341e5558b3 for instance
Nov 15 04:19:58 user nova-compute[74805]: DEBUG nova.compute.manager [req-8ecaec15-6a70-49b9-8120-e79150591873 req-9f214e2b-ccfe-42f9-9ed2-f623508b7d14 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Received event network-vif-plugged-9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:19:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8ecaec15-6a70-49b9-8120-e79150591873 req-9f214e2b-ccfe-42f9-9ed2-f623508b7d14 service nova] Acquiring lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:19:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8ecaec15-6a70-49b9-8120-e79150591873 req-9f214e2b-ccfe-42f9-9ed2-f623508b7d14 service nova] Lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:19:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8ecaec15-6a70-49b9-8120-e79150591873 req-9f214e2b-ccfe-42f9-9ed2-f623508b7d14 service nova] Lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:19:58 user nova-compute[74805]: DEBUG nova.compute.manager [req-8ecaec15-6a70-49b9-8120-e79150591873 req-9f214e2b-ccfe-42f9-9ed2-f623508b7d14 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] No waiting events found dispatching network-vif-plugged-9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:19:58 user nova-compute[74805]: WARNING nova.compute.manager [req-8ecaec15-6a70-49b9-8120-e79150591873 req-9f214e2b-ccfe-42f9-9ed2-f623508b7d14 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Received unexpected event network-vif-plugged-9f426f7d-ce70-41ba-affa-652a4f62a571 for instance with vm_state rescued and task_state unrescuing.
Nov 15 04:19:58 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Overwriting current allocation {'allocations': {'ada87504-5552-4a33-b754-f9a54c67fe39': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 24}}, 'project_id': '6e12b863b6ed49f3a03f95c105881e5e', 'user_id': '6253a7981e834ef4979d177a04e8eaf8', 'consumer_generation': 1} on consumer 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c {{(pid=74805) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 15 04:19:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquiring lock "refresh_cache-39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquired lock "refresh_cache-39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG nova.network.neutron [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG nova.network.neutron [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Updating instance_info_cache with network_info: [{"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Releasing lock "refresh_cache-39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG os_brick.utils [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9019ba2d-34e2-4846-b131-abec35a17201]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab47cac4-6b2d-4f80-85c3-099c247d9702]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG nova.compute.manager [req-3ead4960-2a5c-42fe-b721-13758f1ccbc7 req-9d0bac12-f67c-4fb2-bf81-31b08d75226f service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Received event network-changed-9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG nova.compute.manager [req-3ead4960-2a5c-42fe-b721-13758f1ccbc7 req-9d0bac12-f67c-4fb2-bf81-31b08d75226f service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Refreshing instance network info cache due to event network-changed-9f426f7d-ce70-41ba-affa-652a4f62a571. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3ead4960-2a5c-42fe-b721-13758f1ccbc7 req-9d0bac12-f67c-4fb2-bf81-31b08d75226f service nova] Acquiring lock "refresh_cache-0de78a8a-d66a-4703-a044-89c2f2006860" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3ead4960-2a5c-42fe-b721-13758f1ccbc7 req-9d0bac12-f67c-4fb2-bf81-31b08d75226f service nova] Acquired lock "refresh_cache-0de78a8a-d66a-4703-a044-89c2f2006860" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG nova.network.neutron [req-3ead4960-2a5c-42fe-b721-13758f1ccbc7 req-9d0bac12-f67c-4fb2-bf81-31b08d75226f service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Refreshing network info cache for port 9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[530c83b2-e297-4996-b1e8-5cf3c43fff40]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e434ce96-c38f-4df6-bb49-06872df46e8d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:19:59 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:19:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3152c9a1-e033-467b-b37a-376f8ea46afc]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG os_brick.utils [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:19:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:00 user nova-compute[74805]: INFO nova.compute.manager [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Rebuilding instance
Nov 15 04:20:00 user nova-compute[74805]: DEBUG nova.compute.manager [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:20:00 user nova-compute[74805]: DEBUG nova.network.neutron [req-3ead4960-2a5c-42fe-b721-13758f1ccbc7 req-9d0bac12-f67c-4fb2-bf81-31b08d75226f service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Updated VIF entry in instance network info cache for port 9f426f7d-ce70-41ba-affa-652a4f62a571. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:20:00 user nova-compute[74805]: DEBUG nova.network.neutron [req-3ead4960-2a5c-42fe-b721-13758f1ccbc7 req-9d0bac12-f67c-4fb2-bf81-31b08d75226f service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Updating instance_info_cache with network_info: [{"id": "9f426f7d-ce70-41ba-affa-652a4f62a571", "address": "fa:16:3e:74:98:ab", "network": {"id": "e6f9095e-b477-4654-9fb7-7322e7bb3b9d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1108878484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc936c67de2046ff82115c5ebdb8c844", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f426f7d-ce", "ovs_interfaceid": "9f426f7d-ce70-41ba-affa-652a4f62a571", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:20:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3ead4960-2a5c-42fe-b721-13758f1ccbc7 req-9d0bac12-f67c-4fb2-bf81-31b08d75226f service nova] Releasing lock "refresh_cache-0de78a8a-d66a-4703-a044-89c2f2006860" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:20:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-698ae550-7bed-4bdb-bc36-926afada636b req-ce4b7a6a-c9ef-40be-ae52-45f8ddf2cd7f service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Received event network-vif-unplugged-62730abb-e77d-4e27-8e57-929086b708e3 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:20:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-698ae550-7bed-4bdb-bc36-926afada636b req-ce4b7a6a-c9ef-40be-ae52-45f8ddf2cd7f service nova] Acquiring lock "51e0a627-f95e-4347-92a7-4a218413e884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-698ae550-7bed-4bdb-bc36-926afada636b req-ce4b7a6a-c9ef-40be-ae52-45f8ddf2cd7f service nova] Lock "51e0a627-f95e-4347-92a7-4a218413e884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-698ae550-7bed-4bdb-bc36-926afada636b req-ce4b7a6a-c9ef-40be-ae52-45f8ddf2cd7f service nova] Lock "51e0a627-f95e-4347-92a7-4a218413e884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-698ae550-7bed-4bdb-bc36-926afada636b req-ce4b7a6a-c9ef-40be-ae52-45f8ddf2cd7f service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] No waiting events found dispatching network-vif-unplugged-62730abb-e77d-4e27-8e57-929086b708e3 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:20:00 user nova-compute[74805]: WARNING nova.compute.manager [req-698ae550-7bed-4bdb-bc36-926afada636b req-ce4b7a6a-c9ef-40be-ae52-45f8ddf2cd7f service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Received unexpected event network-vif-unplugged-62730abb-e77d-4e27-8e57-929086b708e3 for instance with vm_state active and task_state rebuilding.
Nov 15 04:20:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-44052485-ad34-477b-acdc-a33602558e14 req-960839a3-105a-4763-9a2b-34b6b368fa29 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Received event network-vif-plugged-9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:20:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-44052485-ad34-477b-acdc-a33602558e14 req-960839a3-105a-4763-9a2b-34b6b368fa29 service nova] Acquiring lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-44052485-ad34-477b-acdc-a33602558e14 req-960839a3-105a-4763-9a2b-34b6b368fa29 service nova] Lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-44052485-ad34-477b-acdc-a33602558e14 req-960839a3-105a-4763-9a2b-34b6b368fa29 service nova] Lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-44052485-ad34-477b-acdc-a33602558e14 req-960839a3-105a-4763-9a2b-34b6b368fa29 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] No waiting events found dispatching network-vif-plugged-9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:20:00 user nova-compute[74805]: WARNING nova.compute.manager [req-44052485-ad34-477b-acdc-a33602558e14 req-960839a3-105a-4763-9a2b-34b6b368fa29 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Received unexpected event network-vif-plugged-9f426f7d-ce70-41ba-affa-652a4f62a571 for instance with vm_state rescued and task_state unrescuing.
Nov 15 04:20:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-44052485-ad34-477b-acdc-a33602558e14 req-960839a3-105a-4763-9a2b-34b6b368fa29 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Received event network-vif-plugged-9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:20:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-44052485-ad34-477b-acdc-a33602558e14 req-960839a3-105a-4763-9a2b-34b6b368fa29 service nova] Acquiring lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-44052485-ad34-477b-acdc-a33602558e14 req-960839a3-105a-4763-9a2b-34b6b368fa29 service nova] Lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-44052485-ad34-477b-acdc-a33602558e14 req-960839a3-105a-4763-9a2b-34b6b368fa29 service nova] Lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-44052485-ad34-477b-acdc-a33602558e14 req-960839a3-105a-4763-9a2b-34b6b368fa29 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] No waiting events found dispatching network-vif-plugged-9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:20:00 user nova-compute[74805]: WARNING nova.compute.manager [req-44052485-ad34-477b-acdc-a33602558e14 req-960839a3-105a-4763-9a2b-34b6b368fa29 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Received unexpected event network-vif-plugged-9f426f7d-ce70-41ba-affa-652a4f62a571 for instance with vm_state rescued and task_state unrescuing.
Nov 15 04:20:01 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Instance destroyed successfully.
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Cleaning up deleted instances {{(pid=74805) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:01 user nova-compute[74805]: INFO nova.compute.manager [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Detaching volume c514702d-74f1-4d8a-892b-2b6750ac4eaf
Nov 15 04:20:01 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] There are 0 instances to clean {{(pid=74805) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 04:20:01 user nova-compute[74805]: INFO nova.virt.block_device [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Attempting to driver detach volume c514702d-74f1-4d8a-892b-2b6750ac4eaf from mountpoint /dev/vdb
Nov 15 04:20:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Attempting to detach device vdb from instance 51e0a627-f95e-4347-92a7-4a218413e884 from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:20:01 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:20:01 user nova-compute[74805]:   <source dev="/dev/sdc"/>
Nov 15 04:20:01 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:20:01 user nova-compute[74805]:   <serial>c514702d-74f1-4d8a-892b-2b6750ac4eaf</serial>
Nov 15 04:20:01 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:20:01 user nova-compute[74805]: </disk>
Nov 15 04:20:01 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:20:01 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Successfully detached device vdb from instance 51e0a627-f95e-4347-92a7-4a218413e884 from the persistent domain config.
Nov 15 04:20:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBvotOfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:20:01 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 04:20:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07c6d33-31e3-4370-a66c-efd8911173bb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:20:01 user nova-compute[74805]: No targets found.
Nov 15 04:20:01 user nova-compute[74805]: iSNS:
Nov 15 04:20:01 user nova-compute[74805]: No targets found.
Nov 15 04:20:01 user nova-compute[74805]: STATIC:
Nov 15 04:20:01 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402
Nov 15 04:20:01 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:20:01 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:20:01 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7
Nov 15 04:20:01 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:20:01 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:20:01 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf
Nov 15 04:20:01 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:20:01 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:20:01 user nova-compute[74805]: FIRMWARE:
Nov 15 04:20:01 user nova-compute[74805]: No targets found.
Nov 15 04:20:01 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:20:01 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:20:01 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4c556b-32ea-4747-bb4c-f0a649f319d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de784ee-3096-4c3d-86d2-857357253f9a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:20:01 user nova-compute[74805]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:20:01 user nova-compute[74805]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:20:01 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:20:01 user nova-compute[74805]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:20:01 user nova-compute[74805]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:20:01 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c130a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf'): ({'sdc'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Removing single pathed devices sdc {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1aab7e6-bfe9-4ffe-a528-f585b5a7d88d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98c2a82-f3c1-4160-bd99-fc3b582bb86e]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Flushing IO for device /dev/sdc {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71167e6-12d0-4d0d-adf5-e2a3a16da7de]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f72d4e-f312-4645-984a-baa755fea440]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84d3e4c-414f-48f0-a46c-74b0ac6251c1]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[097e2898-84ef-4619-b339-bc09741f6c80]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf, portal: 172.16.0.220,3260]
Nov 15 04:20:01 user nova-compute[74805]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf, portal: 172.16.0.220,3260] successful.
Nov 15 04:20:01 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[70864202-ca38-4b5f-9298-06ab221298c0]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] <== disconnect_volume: return (302ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:20:01 user nova-compute[74805]: DEBUG nova.compute.manager [None req-3749b793-ad2f-4c50-91ef-caafcbcc7b6e tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:20:02 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Instance destroyed successfully.
Nov 15 04:20:02 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1880386667',display_name='tempest-ServerActionsTestOtherA-server-250389162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1880386667',id=16,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNL2QOXLXk1x9TsxLURUmSVRJaTx/RlWkfU3Js5N8CQyrY9MmbOAU4o8C49ofySnmFHbhPtn/D/NU/tAJtyE07dTKcQEk2x0+rT7NunvFZegFW77bWCq6V++KJvKeWIEWg==',key_name='tempest-keypair-86981041',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:18:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6dcdb40f067540dab36661ea0586f1d5',ramdisk_id='',reservation_id='r-a6zdjf19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1623992712',owner_user_name='tempest-ServerActionsTestOtherA-1623992712-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:20:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b6a8eff61f4d6ba2e83d7939143112',uuid=51e0a627-f95e-4347-92a7-4a218413e884,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62730abb-e77d-4e27-8e57-929086b708e3", "address": "fa:16:3e:b0:20:4f", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62730abb-e7", "ovs_interfaceid": "62730abb-e77d-4e27-8e57-929086b708e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converting VIF {"id": "62730abb-e77d-4e27-8e57-929086b708e3", "address": "fa:16:3e:b0:20:4f", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62730abb-e7", "ovs_interfaceid": "62730abb-e77d-4e27-8e57-929086b708e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:20:4f,bridge_name='br-int',has_traffic_filtering=True,id=62730abb-e77d-4e27-8e57-929086b708e3,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62730abb-e7') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG os_vif [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:20:4f,bridge_name='br-int',has_traffic_filtering=True,id=62730abb-e77d-4e27-8e57-929086b708e3,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62730abb-e7') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62730abb-e7, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dfcc3e09-36ce-4553-964c-01b7ed9a711c) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:02 user nova-compute[74805]: INFO os_vif [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:20:4f,bridge_name='br-int',has_traffic_filtering=True,id=62730abb-e77d-4e27-8e57-929086b708e3,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62730abb-e7')
Nov 15 04:20:02 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBvotOfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:20:02 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 04:20:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb23b5a5-eeb5-4153-9980-05da97651602]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:20:02 user nova-compute[74805]: No targets found.
Nov 15 04:20:02 user nova-compute[74805]: iSNS:
Nov 15 04:20:02 user nova-compute[74805]: No targets found.
Nov 15 04:20:02 user nova-compute[74805]: STATIC:
Nov 15 04:20:02 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402
Nov 15 04:20:02 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:20:02 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:20:02 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7
Nov 15 04:20:02 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:20:02 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:20:02 user nova-compute[74805]: FIRMWARE:
Nov 15 04:20:02 user nova-compute[74805]: No targets found.
Nov 15 04:20:02 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:20:02 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:20:02 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3531e0-fb95-4637-ba0d-0b2caeea8274]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[322f1f3e-5637-4491-a68a-0c49d7d1324d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:20:02 user nova-compute[74805]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:20:02 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:20:02 user nova-compute[74805]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:20:02 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2fb4236560>, {}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Disconnecting from: [] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.081s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] <== disconnect_volume: return (82ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:20:02 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Deleting instance files /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884_del
Nov 15 04:20:02 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Deletion of /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884_del complete
Nov 15 04:20:02 user nova-compute[74805]: DEBUG nova.compute.manager [req-10a7c441-31c2-4284-b4a3-f3ba245cbb25 req-e457e4fc-a8fc-4892-97db-b11f68cf9f9d service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Received event network-vif-plugged-62730abb-e77d-4e27-8e57-929086b708e3 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-10a7c441-31c2-4284-b4a3-f3ba245cbb25 req-e457e4fc-a8fc-4892-97db-b11f68cf9f9d service nova] Acquiring lock "51e0a627-f95e-4347-92a7-4a218413e884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-10a7c441-31c2-4284-b4a3-f3ba245cbb25 req-e457e4fc-a8fc-4892-97db-b11f68cf9f9d service nova] Lock "51e0a627-f95e-4347-92a7-4a218413e884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-10a7c441-31c2-4284-b4a3-f3ba245cbb25 req-e457e4fc-a8fc-4892-97db-b11f68cf9f9d service nova] Lock "51e0a627-f95e-4347-92a7-4a218413e884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG nova.compute.manager [req-10a7c441-31c2-4284-b4a3-f3ba245cbb25 req-e457e4fc-a8fc-4892-97db-b11f68cf9f9d service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] No waiting events found dispatching network-vif-plugged-62730abb-e77d-4e27-8e57-929086b708e3 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:20:02 user nova-compute[74805]: WARNING nova.compute.manager [req-10a7c441-31c2-4284-b4a3-f3ba245cbb25 req-e457e4fc-a8fc-4892-97db-b11f68cf9f9d service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Received unexpected event network-vif-plugged-62730abb-e77d-4e27-8e57-929086b708e3 for instance with vm_state active and task_state rebuilding.
Nov 15 04:20:02 user nova-compute[74805]: INFO nova.virt.block_device [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Booting with volume c514702d-74f1-4d8a-892b-2b6750ac4eaf at /dev/vdb
Nov 15 04:20:02 user nova-compute[74805]: DEBUG os_brick.utils [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5db9709-79c6-4778-92d1-0fb7f25d10ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a89c5a-ef6c-4abe-82a2-4a3f016c4ad9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[568a9467-d2d0-41ab-b62a-071c1921e1c0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cdaec4-f64b-4f7a-a3b5-aefa8c6d2fc7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:20:02 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:20:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0142d31-5787-4f94-b7a0-e71c8402d5d9]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG os_brick.utils [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:20:02 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Updating existing volume attachment record: f50b475d-6bb0-4d8c-be82-99201885b5e4 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:20:03 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:20:04 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:20:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Starting finish_revert_migration {{(pid=74805) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Start _get_guest_xml network_info=[{"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'biAZqcTu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '39ab9e2c-5856-4fe6-aa2c-42f9ac52632c', 'attached_at': '2023-11-15T04:20:06.000000', 'detached_at': '', 'volume_id': '7f3112d5-dcc8-4e6d-9601-30bc0d3243c4', 'serial': '7f3112d5-dcc8-4e6d-9601-30bc0d3243c4'}, 'delete_on_termination': False, 'attachment_id': '6454eaf1-5e73-44c6-9ab2-e350362d83ef', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:20:05 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:20:05 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:20:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG nova.objects.instance [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lazy-loading 'vcpu_model' on Instance uuid 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'biAZqcTu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:20:05 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:20:05 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:20:05 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:20:05 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:20:05 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:20:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c2b41c-3596-4b59-9043-4cbd648e77ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:20:05 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a8e1e1-812e-475b-88a7-f98dcace753b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4] added
Nov 15 04:20:06 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbef64c-9ac5-4fe1-afde-2148eec068a7]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac27be8f-f0a4-47f8-9d76-071f790b51e8]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v biAZqcTu {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v biAZqcTu" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3682162f-969d-4d01-8c1c-b36644dd16df]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'biAZqcTu'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f079e9-88d0-4b2a-a965-f448234c5022]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[583b43ff-18a0-48f4-ab05-ee44fbda4690]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:20:06 user nova-compute[74805]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:20:06 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:20:06 user nova-compute[74805]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:20:06 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a2b27a-1f3c-49fe-b10f-dadba643686e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4, portal: 172.16.0.220,3260]
Nov 15 04:20:06 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4, portal: 172.16.0.220,3260] successful.
Nov 15 04:20:06 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[03438f4e-7d26-4519-b8c5-8b78b0556046]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bc81a3-58d8-47a5-a235-9432596d4b9d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:20:06 user nova-compute[74805]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:20:06 user nova-compute[74805]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:20:06 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:20:06 user nova-compute[74805]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:20:06 user nova-compute[74805]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:20:06 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c2e2c6-b5cb-47a3-bd6a-a73b8d6e5cf0]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'biAZqcTu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '23634376332343034', 'path': '/dev/sdb'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634376332343034', 'path': '/dev/sdb'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2010307012',display_name='tempest-ServerActionsTestOtherB-server-2010307012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2010307012',id=3,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN2t8TNG6ZVHF/Uf5V+OtupNhI5/tplcqGEarq2oKWoGX9vvIofLCSj5BmzwvNfOMIgQ6qY6HA1c0ScmczPixk4TIDvFHJbrnEyQ0asmj0Ggpy7B5hD2wopJrs+94VPUA==',key_name='tempest-keypair-149654948',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6e12b863b6ed49f3a03f95c105881e5e',ramdisk_id='',reservation_id='r-zfce7v2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-997020636',owner_user_name='tempest-ServerActionsTestOtherB-997020636-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:19:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6253a7981e834ef4979d177a04e8eaf8',uuid=39ab9e2c-5856-4fe6-aa2c-42f9ac52632c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Converting VIF {"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:e7:d1,bridge_name='br-int',has_traffic_filtering=True,id=2bdff360-1f21-4ce8-9c04-a5115a3316b2,network=Network(90f83e19-1c70-437a-9f75-cbbca516eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdff360-1f') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:20:07 user nova-compute[74805]:   <uuid>39ab9e2c-5856-4fe6-aa2c-42f9ac52632c</uuid>
Nov 15 04:20:07 user nova-compute[74805]:   <name>instance-00000003</name>
Nov 15 04:20:07 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:20:07 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:20:07 user nova-compute[74805]:   <metadata>
Nov 15 04:20:07 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:20:07 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:20:07 user nova-compute[74805]:       <nova:name>tempest-ServerActionsTestOtherB-server-2010307012</nova:name>
Nov 15 04:20:07 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:20:05</nova:creationTime>
Nov 15 04:20:07 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:20:07 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:20:07 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:20:07 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:20:07 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:20:07 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:20:07 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:20:07 user nova-compute[74805]:       <nova:owner>
Nov 15 04:20:07 user nova-compute[74805]:         <nova:user uuid="6253a7981e834ef4979d177a04e8eaf8">tempest-ServerActionsTestOtherB-997020636-project-member</nova:user>
Nov 15 04:20:07 user nova-compute[74805]:         <nova:project uuid="6e12b863b6ed49f3a03f95c105881e5e">tempest-ServerActionsTestOtherB-997020636</nova:project>
Nov 15 04:20:07 user nova-compute[74805]:       </nova:owner>
Nov 15 04:20:07 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:20:07 user nova-compute[74805]:       <nova:ports>
Nov 15 04:20:07 user nova-compute[74805]:         <nova:port uuid="2bdff360-1f21-4ce8-9c04-a5115a3316b2">
Nov 15 04:20:07 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 04:20:07 user nova-compute[74805]:         </nova:port>
Nov 15 04:20:07 user nova-compute[74805]:       </nova:ports>
Nov 15 04:20:07 user nova-compute[74805]:     </nova:instance>
Nov 15 04:20:07 user nova-compute[74805]:   </metadata>
Nov 15 04:20:07 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:20:07 user nova-compute[74805]:     <system>
Nov 15 04:20:07 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:20:07 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:20:07 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:20:07 user nova-compute[74805]:       <entry name="serial">39ab9e2c-5856-4fe6-aa2c-42f9ac52632c</entry>
Nov 15 04:20:07 user nova-compute[74805]:       <entry name="uuid">39ab9e2c-5856-4fe6-aa2c-42f9ac52632c</entry>
Nov 15 04:20:07 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:20:07 user nova-compute[74805]:     </system>
Nov 15 04:20:07 user nova-compute[74805]:   </sysinfo>
Nov 15 04:20:07 user nova-compute[74805]:   <os>
Nov 15 04:20:07 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:20:07 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:20:07 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:20:07 user nova-compute[74805]:   </os>
Nov 15 04:20:07 user nova-compute[74805]:   <features>
Nov 15 04:20:07 user nova-compute[74805]:     <acpi/>
Nov 15 04:20:07 user nova-compute[74805]:     <apic/>
Nov 15 04:20:07 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:20:07 user nova-compute[74805]:   </features>
Nov 15 04:20:07 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:20:07 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:20:07 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:20:07 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:20:07 user nova-compute[74805]:   </clock>
Nov 15 04:20:07 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:20:07 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:20:07 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:20:07 user nova-compute[74805]:   </cpu>
Nov 15 04:20:07 user nova-compute[74805]:   <devices>
Nov 15 04:20:07 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:20:07 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:20:07 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk"/>
Nov 15 04:20:07 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:20:07 user nova-compute[74805]:     </disk>
Nov 15 04:20:07 user nova-compute[74805]:     <disk type="block" device="disk">
Nov 15 04:20:07 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:20:07 user nova-compute[74805]:       <source dev="/dev/sdb"/>
Nov 15 04:20:07 user nova-compute[74805]:       <target dev="vdb" bus="virtio"/>
Nov 15 04:20:07 user nova-compute[74805]:       <serial>7f3112d5-dcc8-4e6d-9601-30bc0d3243c4</serial>
Nov 15 04:20:07 user nova-compute[74805]:     </disk>
Nov 15 04:20:07 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:20:07 user nova-compute[74805]:       <mac address="fa:16:3e:28:e7:d1"/>
Nov 15 04:20:07 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:20:07 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:20:07 user nova-compute[74805]:       <target dev="tap2bdff360-1f"/>
Nov 15 04:20:07 user nova-compute[74805]:     </interface>
Nov 15 04:20:07 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:20:07 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/console.log" append="off"/>
Nov 15 04:20:07 user nova-compute[74805]:     </serial>
Nov 15 04:20:07 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:20:07 user nova-compute[74805]:     <video>
Nov 15 04:20:07 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:20:07 user nova-compute[74805]:     </video>
Nov 15 04:20:07 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:20:07 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:20:07 user nova-compute[74805]:     </rng>
Nov 15 04:20:07 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:20:07 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:20:07 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:20:07 user nova-compute[74805]:     </memballoon>
Nov 15 04:20:07 user nova-compute[74805]:   </devices>
Nov 15 04:20:07 user nova-compute[74805]: </domain>
Nov 15 04:20:07 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2010307012',display_name='tempest-ServerActionsTestOtherB-server-2010307012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2010307012',id=3,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN2t8TNG6ZVHF/Uf5V+OtupNhI5/tplcqGEarq2oKWoGX9vvIofLCSj5BmzwvNfOMIgQ6qY6HA1c0ScmczPixk4TIDvFHJbrnEyQ0asmj0Ggpy7B5hD2wopJrs+94VPUA==',key_name='tempest-keypair-149654948',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6e12b863b6ed49f3a03f95c105881e5e',ramdisk_id='',reservation_id='r-zfce7v2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-997020636',owner_user_name='tempest-ServerActionsTestOtherB-997020636-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:19:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6253a7981e834ef4979d177a04e8eaf8',uuid=39ab9e2c-5856-4fe6-aa2c-42f9ac52632c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Converting VIF {"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:e7:d1,bridge_name='br-int',has_traffic_filtering=True,id=2bdff360-1f21-4ce8-9c04-a5115a3316b2,network=Network(90f83e19-1c70-437a-9f75-cbbca516eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdff360-1f') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG os_vif [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:e7:d1,bridge_name='br-int',has_traffic_filtering=True,id=2bdff360-1f21-4ce8-9c04-a5115a3316b2,network=Network(90f83e19-1c70-437a-9f75-cbbca516eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdff360-1f') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8997d5c-65a8-5884-85c0-fee7e124b924', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2bdff360-1f, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2bdff360-1f, col_values=(('qos', UUID('229f4f20-3b86-44a6-9fef-d0b702f243c2')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2bdff360-1f, col_values=(('external_ids', {'iface-id': '2bdff360-1f21-4ce8-9c04-a5115a3316b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:e7:d1', 'vm-uuid': '39ab9e2c-5856-4fe6-aa2c-42f9ac52632c'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:07 user nova-compute[74805]: INFO os_vif [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:e7:d1,bridge_name='br-int',has_traffic_filtering=True,id=2bdff360-1f21-4ce8-9c04-a5115a3316b2,network=Network(90f83e19-1c70-437a-9f75-cbbca516eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdff360-1f')
Nov 15 04:20:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:20:07 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Creating image(s)
Nov 15 04:20:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "/opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "/opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "/opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.177s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk 1073741824" returned: 0 in 0.051s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.181s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Checking if we can resize image /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Cannot resize image /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Ensure instance console log exists: /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Start _get_guest_xml network_info=[{"id": "62730abb-e77d-4e27-8e57-929086b708e3", "address": "fa:16:3e:b0:20:4f", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62730abb-e7", "ovs_interfaceid": "62730abb-e77d-4e27-8e57-929086b708e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBvotOfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '51e0a627-f95e-4347-92a7-4a218413e884', 'attached_at': '', 'detached_at': '', 'volume_id': 'c514702d-74f1-4d8a-892b-2b6750ac4eaf', 'serial': 'c514702d-74f1-4d8a-892b-2b6750ac4eaf'}, 'delete_on_termination': False, 'attachment_id': 'f50b475d-6bb0-4d8c-be82-99201885b5e4', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:20:08 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 04:20:08 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 04:20:08 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG nova.objects.instance [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lazy-loading 'vcpu_model' on Instance uuid 51e0a627-f95e-4347-92a7-4a218413e884 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBvotOfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:20:08 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 04:20:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:20:08 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 04:20:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:20:08 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fc66c41-efcf-4014-bedb-3955aed09eba/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58bd3ee-5e4a-4714-b0da-048eb4ff3ad9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:20:08 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[93eb2778-9344-489c-828b-d2012b535c83]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf] added
Nov 15 04:20:08 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3b74a5-4d16-42ec-9a8c-4e49f3994bce]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f73762-69b7-4afc-8a55-8ba13bd56d08]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pBvotOfY {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pBvotOfY" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f977a689-52af-44c4-aef7-83042e22a3bc]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pBvotOfY'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ba550b-da6e-415c-b687-40cad9ed3403]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fc66c41-efcf-4014-bedb-3955aed09eba/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fc66c41-efcf-4014-bedb-3955aed09eba/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3303f793-b829-4d95-9971-f9902c962b95]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:20:08 user nova-compute[74805]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:20:08 user nova-compute[74805]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:20:08 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:20:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:20:08 user nova-compute[74805]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:20:08 user nova-compute[74805]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:20:08 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:20:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c51947c-2864-42a6-8851-786400123c19]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf, portal: 172.16.0.220,3260]
Nov 15 04:20:09 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf, portal: 172.16.0.220,3260] successful.
Nov 15 04:20:09 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2c4241-fa57-43ad-a69f-5abce0ef7e17]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a0ac9b-3b2d-4d49-a296-6fd4d6102495]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:20:09 user nova-compute[74805]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:20:09 user nova-compute[74805]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:20:09 user nova-compute[74805]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:20:09 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:20:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:20:09 user nova-compute[74805]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:20:09 user nova-compute[74805]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:20:09 user nova-compute[74805]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:20:09 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:20:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:20:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:20:09 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:20:09 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:20:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fc66c41-efcf-4014-bedb-3955aed09eba/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.043s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c54fe3-59e2-4620-9b5d-487076464cce]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:09 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:20:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBvotOfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.879s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] <== connect_volume: return (2881ms) {'type': 'block', 'scsi_wwn': '26538303063383537', 'path': '/dev/sdc'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538303063383537', 'path': '/dev/sdc'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.compute.manager [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.compute.manager [req-865b8e22-0723-4ac6-ac90-14c41453039d req-c272901d-ac02-42d1-a9b3-9de889b3bbdd service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Received event network-vif-plugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-865b8e22-0723-4ac6-ac90-14c41453039d req-c272901d-ac02-42d1-a9b3-9de889b3bbdd service nova] Acquiring lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-865b8e22-0723-4ac6-ac90-14c41453039d req-c272901d-ac02-42d1-a9b3-9de889b3bbdd service nova] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-865b8e22-0723-4ac6-ac90-14c41453039d req-c272901d-ac02-42d1-a9b3-9de889b3bbdd service nova] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.compute.manager [req-865b8e22-0723-4ac6-ac90-14c41453039d req-c272901d-ac02-42d1-a9b3-9de889b3bbdd service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] No waiting events found dispatching network-vif-plugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:20:11 user nova-compute[74805]: WARNING nova.compute.manager [req-865b8e22-0723-4ac6-ac90-14c41453039d req-c272901d-ac02-42d1-a9b3-9de889b3bbdd service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Received unexpected event network-vif-plugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 for instance with vm_state resized and task_state resize_reverting.
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.compute.manager [req-b5ffde71-9e53-496d-b83b-0d65ede76ce4 req-87c87233-e252-4096-9a91-13270cfd1e68 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Received event network-vif-plugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5ffde71-9e53-496d-b83b-0d65ede76ce4 req-87c87233-e252-4096-9a91-13270cfd1e68 service nova] Acquiring lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5ffde71-9e53-496d-b83b-0d65ede76ce4 req-87c87233-e252-4096-9a91-13270cfd1e68 service nova] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5ffde71-9e53-496d-b83b-0d65ede76ce4 req-87c87233-e252-4096-9a91-13270cfd1e68 service nova] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.compute.manager [req-b5ffde71-9e53-496d-b83b-0d65ede76ce4 req-87c87233-e252-4096-9a91-13270cfd1e68 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] No waiting events found dispatching network-vif-plugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:20:11 user nova-compute[74805]: WARNING nova.compute.manager [req-b5ffde71-9e53-496d-b83b-0d65ede76ce4 req-87c87233-e252-4096-9a91-13270cfd1e68 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Received unexpected event network-vif-plugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 for instance with vm_state resized and task_state resize_reverting.
Nov 15 04:20:11 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Instance running successfully.
Nov 15 04:20:11 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:20:11 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=7622MB free_disk=25.1878662109375GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] finish_revert_migration finished successfully. {{(pid=74805) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T04:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1880386667',display_name='tempest-ServerActionsTestOtherA-server-250389162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1880386667',id=16,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNL2QOXLXk1x9TsxLURUmSVRJaTx/RlWkfU3Js5N8CQyrY9MmbOAU4o8C49ofySnmFHbhPtn/D/NU/tAJtyE07dTKcQEk2x0+rT7NunvFZegFW77bWCq6V++KJvKeWIEWg==',key_name='tempest-keypair-86981041',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:18:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6dcdb40f067540dab36661ea0586f1d5',ramdisk_id='',reservation_id='r-a6zdjf19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1623992712',owner_user_name='tempest-ServerActionsTestOtherA-1623992712-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:20:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b6a8eff61f4d6ba2e83d7939143112',uuid=51e0a627-f95e-4347-92a7-4a218413e884,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62730abb-e77d-4e27-8e57-929086b708e3", "address": "fa:16:3e:b0:20:4f", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62730abb-e7", "ovs_interfaceid": "62730abb-e77d-4e27-8e57-929086b708e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converting VIF {"id": "62730abb-e77d-4e27-8e57-929086b708e3", "address": "fa:16:3e:b0:20:4f", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62730abb-e7", "ovs_interfaceid": "62730abb-e77d-4e27-8e57-929086b708e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:20:4f,bridge_name='br-int',has_traffic_filtering=True,id=62730abb-e77d-4e27-8e57-929086b708e3,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62730abb-e7') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:20:11 user nova-compute[74805]:   <uuid>51e0a627-f95e-4347-92a7-4a218413e884</uuid>
Nov 15 04:20:11 user nova-compute[74805]:   <name>instance-00000010</name>
Nov 15 04:20:11 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:20:11 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:20:11 user nova-compute[74805]:   <metadata>
Nov 15 04:20:11 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:20:11 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:20:11 user nova-compute[74805]:       <nova:name>tempest-ServerActionsTestOtherA-server-250389162</nova:name>
Nov 15 04:20:11 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:20:08</nova:creationTime>
Nov 15 04:20:11 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:20:11 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:20:11 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:20:11 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:20:11 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:20:11 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:20:11 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:20:11 user nova-compute[74805]:       <nova:owner>
Nov 15 04:20:11 user nova-compute[74805]:         <nova:user uuid="d0b6a8eff61f4d6ba2e83d7939143112">tempest-ServerActionsTestOtherA-1623992712-project-member</nova:user>
Nov 15 04:20:11 user nova-compute[74805]:         <nova:project uuid="6dcdb40f067540dab36661ea0586f1d5">tempest-ServerActionsTestOtherA-1623992712</nova:project>
Nov 15 04:20:11 user nova-compute[74805]:       </nova:owner>
Nov 15 04:20:11 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:20:11 user nova-compute[74805]:       <nova:ports>
Nov 15 04:20:11 user nova-compute[74805]:         <nova:port uuid="62730abb-e77d-4e27-8e57-929086b708e3">
Nov 15 04:20:11 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 04:20:11 user nova-compute[74805]:         </nova:port>
Nov 15 04:20:11 user nova-compute[74805]:       </nova:ports>
Nov 15 04:20:11 user nova-compute[74805]:     </nova:instance>
Nov 15 04:20:11 user nova-compute[74805]:   </metadata>
Nov 15 04:20:11 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:20:11 user nova-compute[74805]:     <system>
Nov 15 04:20:11 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:20:11 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:20:11 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:20:11 user nova-compute[74805]:       <entry name="serial">51e0a627-f95e-4347-92a7-4a218413e884</entry>
Nov 15 04:20:11 user nova-compute[74805]:       <entry name="uuid">51e0a627-f95e-4347-92a7-4a218413e884</entry>
Nov 15 04:20:11 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:20:11 user nova-compute[74805]:     </system>
Nov 15 04:20:11 user nova-compute[74805]:   </sysinfo>
Nov 15 04:20:11 user nova-compute[74805]:   <os>
Nov 15 04:20:11 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:20:11 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:20:11 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:20:11 user nova-compute[74805]:   </os>
Nov 15 04:20:11 user nova-compute[74805]:   <features>
Nov 15 04:20:11 user nova-compute[74805]:     <acpi/>
Nov 15 04:20:11 user nova-compute[74805]:     <apic/>
Nov 15 04:20:11 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:20:11 user nova-compute[74805]:   </features>
Nov 15 04:20:11 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:20:11 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:20:11 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:20:11 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:20:11 user nova-compute[74805]:   </clock>
Nov 15 04:20:11 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:20:11 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:20:11 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:20:11 user nova-compute[74805]:   </cpu>
Nov 15 04:20:11 user nova-compute[74805]:   <devices>
Nov 15 04:20:11 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:20:11 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:20:11 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk"/>
Nov 15 04:20:11 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:20:11 user nova-compute[74805]:     </disk>
Nov 15 04:20:11 user nova-compute[74805]:     <disk type="block" device="disk">
Nov 15 04:20:11 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:20:11 user nova-compute[74805]:       <source dev="/dev/sdc"/>
Nov 15 04:20:11 user nova-compute[74805]:       <target dev="vdb" bus="virtio"/>
Nov 15 04:20:11 user nova-compute[74805]:       <serial>c514702d-74f1-4d8a-892b-2b6750ac4eaf</serial>
Nov 15 04:20:11 user nova-compute[74805]:     </disk>
Nov 15 04:20:11 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:20:11 user nova-compute[74805]:       <mac address="fa:16:3e:b0:20:4f"/>
Nov 15 04:20:11 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:20:11 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:20:11 user nova-compute[74805]:       <target dev="tap62730abb-e7"/>
Nov 15 04:20:11 user nova-compute[74805]:     </interface>
Nov 15 04:20:11 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:20:11 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/console.log" append="off"/>
Nov 15 04:20:11 user nova-compute[74805]:     </serial>
Nov 15 04:20:11 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:20:11 user nova-compute[74805]:     <video>
Nov 15 04:20:11 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:20:11 user nova-compute[74805]:     </video>
Nov 15 04:20:11 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:20:11 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:20:11 user nova-compute[74805]:     </rng>
Nov 15 04:20:11 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:20:11 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:20:11 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:20:11 user nova-compute[74805]:     </memballoon>
Nov 15 04:20:11 user nova-compute[74805]:   </devices>
Nov 15 04:20:11 user nova-compute[74805]: </domain>
Nov 15 04:20:11 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T04:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1880386667',display_name='tempest-ServerActionsTestOtherA-server-250389162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1880386667',id=16,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNL2QOXLXk1x9TsxLURUmSVRJaTx/RlWkfU3Js5N8CQyrY9MmbOAU4o8C49ofySnmFHbhPtn/D/NU/tAJtyE07dTKcQEk2x0+rT7NunvFZegFW77bWCq6V++KJvKeWIEWg==',key_name='tempest-keypair-86981041',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:18:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6dcdb40f067540dab36661ea0586f1d5',ramdisk_id='',reservation_id='r-a6zdjf19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1623992712',owner_user_name='tempest-ServerActionsTestOtherA-1623992712-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:20:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b6a8eff61f4d6ba2e83d7939143112',uuid=51e0a627-f95e-4347-92a7-4a218413e884,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62730abb-e77d-4e27-8e57-929086b708e3", "address": "fa:16:3e:b0:20:4f", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62730abb-e7", "ovs_interfaceid": "62730abb-e77d-4e27-8e57-929086b708e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converting VIF {"id": "62730abb-e77d-4e27-8e57-929086b708e3", "address": "fa:16:3e:b0:20:4f", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62730abb-e7", "ovs_interfaceid": "62730abb-e77d-4e27-8e57-929086b708e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:20:4f,bridge_name='br-int',has_traffic_filtering=True,id=62730abb-e77d-4e27-8e57-929086b708e3,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62730abb-e7') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG os_vif [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:20:4f,bridge_name='br-int',has_traffic_filtering=True,id=62730abb-e77d-4e27-8e57-929086b708e3,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62730abb-e7') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fff8e90c-2f3f-5f50-b024-55c87472e398', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62730abb-e7, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap62730abb-e7, col_values=(('qos', UUID('cfdfc807-8115-409a-8185-dafddb420ffc')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap62730abb-e7, col_values=(('external_ids', {'iface-id': '62730abb-e77d-4e27-8e57-929086b708e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:20:4f', 'vm-uuid': '51e0a627-f95e-4347-92a7-4a218413e884'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:11 user nova-compute[74805]: INFO os_vif [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:20:4f,bridge_name='br-int',has_traffic_filtering=True,id=62730abb-e77d-4e27-8e57-929086b708e3,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62730abb-e7')
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] No VIF found with MAC fa:16:3e:b0:20:4f, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 2b1e540c-6226-445a-bd45-5b7b8807e2b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 0de78a8a-d66a-4703-a044-89c2f2006860 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance d63f3726-27df-455f-bda0-3ddca95b70d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance cad2eedf-c1ef-436c-b608-5b6dafa47451 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance e5004557-00fa-4824-9233-343c2261588d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 51e0a627-f95e-4347-92a7-4a218413e884 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance e9d8b785-83eb-4e78-9ce5-c2da589ee4f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 45c66453-2f83-476b-a03b-6bdbb01d1849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 4fc66c41-efcf-4014-bedb-3955aed09eba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:20:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:20:11 user nova-compute[74805]: INFO nova.compute.manager [None req-609b9b20-6131-47b1-a1af-c0536020ef9d tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Updating instance to original state: 'active'
Nov 15 04:20:12 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:20:12 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:20:12 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:20:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.677s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:12 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:20:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-49830d52-b8be-4154-b90d-78867a4c2262 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Acquiring lock "ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-49830d52-b8be-4154-b90d-78867a4c2262 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-49830d52-b8be-4154-b90d-78867a4c2262 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Acquiring lock "ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-49830d52-b8be-4154-b90d-78867a4c2262 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-49830d52-b8be-4154-b90d-78867a4c2262 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:12 user nova-compute[74805]: INFO nova.compute.manager [None req-49830d52-b8be-4154-b90d-78867a4c2262 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Terminating instance
Nov 15 04:20:12 user nova-compute[74805]: DEBUG nova.compute.manager [None req-49830d52-b8be-4154-b90d-78867a4c2262 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:20:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:13 user nova-compute[74805]: DEBUG nova.compute.manager [req-6d202cb9-ac5c-4707-98d9-7945a112452a req-b054f241-ade8-4c01-8508-a4b75ea09141 service nova] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Received event network-vif-unplugged-cb8b1e16-20b0-41b4-8d63-b1a46083e0ba {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:20:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6d202cb9-ac5c-4707-98d9-7945a112452a req-b054f241-ade8-4c01-8508-a4b75ea09141 service nova] Acquiring lock "ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6d202cb9-ac5c-4707-98d9-7945a112452a req-b054f241-ade8-4c01-8508-a4b75ea09141 service nova] Lock "ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6d202cb9-ac5c-4707-98d9-7945a112452a req-b054f241-ade8-4c01-8508-a4b75ea09141 service nova] Lock "ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:13 user nova-compute[74805]: DEBUG nova.compute.manager [req-6d202cb9-ac5c-4707-98d9-7945a112452a req-b054f241-ade8-4c01-8508-a4b75ea09141 service nova] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] No waiting events found dispatching network-vif-unplugged-cb8b1e16-20b0-41b4-8d63-b1a46083e0ba {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:20:13 user nova-compute[74805]: DEBUG nova.compute.manager [req-6d202cb9-ac5c-4707-98d9-7945a112452a req-b054f241-ade8-4c01-8508-a4b75ea09141 service nova] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Received event network-vif-unplugged-cb8b1e16-20b0-41b4-8d63-b1a46083e0ba for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:20:13 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:20:13 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:20:13 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:20:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:13 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Didn't find any instances for network info cache update. {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 04:20:13 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:20:13 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:20:13 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:20:13 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:20:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:13 user nova-compute[74805]: DEBUG nova.compute.manager [req-ed8dd50c-039c-43f6-a71d-78b4abc2796f req-a6975633-03b3-4169-99ae-78fe845e88f8 service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Received event network-vif-plugged-62730abb-e77d-4e27-8e57-929086b708e3 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:20:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ed8dd50c-039c-43f6-a71d-78b4abc2796f req-a6975633-03b3-4169-99ae-78fe845e88f8 service nova] Acquiring lock "51e0a627-f95e-4347-92a7-4a218413e884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ed8dd50c-039c-43f6-a71d-78b4abc2796f req-a6975633-03b3-4169-99ae-78fe845e88f8 service nova] Lock "51e0a627-f95e-4347-92a7-4a218413e884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ed8dd50c-039c-43f6-a71d-78b4abc2796f req-a6975633-03b3-4169-99ae-78fe845e88f8 service nova] Lock "51e0a627-f95e-4347-92a7-4a218413e884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:13 user nova-compute[74805]: DEBUG nova.compute.manager [req-ed8dd50c-039c-43f6-a71d-78b4abc2796f req-a6975633-03b3-4169-99ae-78fe845e88f8 service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] No waiting events found dispatching network-vif-plugged-62730abb-e77d-4e27-8e57-929086b708e3 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:20:13 user nova-compute[74805]: WARNING nova.compute.manager [req-ed8dd50c-039c-43f6-a71d-78b4abc2796f req-a6975633-03b3-4169-99ae-78fe845e88f8 service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Received unexpected event network-vif-plugged-62730abb-e77d-4e27-8e57-929086b708e3 for instance with vm_state active and task_state rebuild_spawning.
Nov 15 04:20:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:14 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Instance destroyed successfully.
Nov 15 04:20:14 user nova-compute[74805]: DEBUG nova.objects.instance [None req-49830d52-b8be-4154-b90d-78867a4c2262 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lazy-loading 'resources' on Instance uuid ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:20:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-49830d52-b8be-4154-b90d-78867a4c2262 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:18:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-781460415',display_name='tempest-VolumesActionsTest-instance-781460415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-781460415',id=17,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:18:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87c33c44f366409bbb2007dc83cc520a',ramdisk_id='',reservation_id='r-b6v6fg05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1048271835',owner_user_name='tempest-VolumesActionsTest-1048271835-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:18:29Z,user_data=None,user_id='d93268af3cc4492bbdc20d26ad09cacc',uuid=ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb8b1e16-20b0-41b4-8d63-b1a46083e0ba", "address": "fa:16:3e:0d:2a:a4", "network": {"id": "9094d1cf-3e56-409a-9fec-dfc97741820d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1184254201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c33c44f366409bbb2007dc83cc520a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb8b1e16-20", "ovs_interfaceid": "cb8b1e16-20b0-41b4-8d63-b1a46083e0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:20:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-49830d52-b8be-4154-b90d-78867a4c2262 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Converting VIF {"id": "cb8b1e16-20b0-41b4-8d63-b1a46083e0ba", "address": "fa:16:3e:0d:2a:a4", "network": {"id": "9094d1cf-3e56-409a-9fec-dfc97741820d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1184254201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c33c44f366409bbb2007dc83cc520a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb8b1e16-20", "ovs_interfaceid": "cb8b1e16-20b0-41b4-8d63-b1a46083e0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:20:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-49830d52-b8be-4154-b90d-78867a4c2262 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:2a:a4,bridge_name='br-int',has_traffic_filtering=True,id=cb8b1e16-20b0-41b4-8d63-b1a46083e0ba,network=Network(9094d1cf-3e56-409a-9fec-dfc97741820d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb8b1e16-20') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:20:14 user nova-compute[74805]: DEBUG os_vif [None req-49830d52-b8be-4154-b90d-78867a4c2262 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:2a:a4,bridge_name='br-int',has_traffic_filtering=True,id=cb8b1e16-20b0-41b4-8d63-b1a46083e0ba,network=Network(9094d1cf-3e56-409a-9fec-dfc97741820d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb8b1e16-20') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:20:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb8b1e16-20, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:20:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:20:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0dbf24b6-739f-47fa-93f2-67b63880374b) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:20:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:20:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:14 user nova-compute[74805]: INFO os_vif [None req-49830d52-b8be-4154-b90d-78867a4c2262 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:2a:a4,bridge_name='br-int',has_traffic_filtering=True,id=cb8b1e16-20b0-41b4-8d63-b1a46083e0ba,network=Network(9094d1cf-3e56-409a-9fec-dfc97741820d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb8b1e16-20')
Nov 15 04:20:14 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-49830d52-b8be-4154-b90d-78867a4c2262 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Deleting instance files /opt/stack/data/nova/instances/ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13_del
Nov 15 04:20:14 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-49830d52-b8be-4154-b90d-78867a4c2262 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Deletion of /opt/stack/data/nova/instances/ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13_del complete
Nov 15 04:20:14 user nova-compute[74805]: INFO nova.compute.manager [None req-49830d52-b8be-4154-b90d-78867a4c2262 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 15 04:20:14 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-49830d52-b8be-4154-b90d-78867a4c2262 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:20:14 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:20:14 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:20:14 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:20:14 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Took 0.49 seconds to deallocate network for instance.
Nov 15 04:20:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-49830d52-b8be-4154-b90d-78867a4c2262 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-49830d52-b8be-4154-b90d-78867a4c2262 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:15 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-49830d52-b8be-4154-b90d-78867a4c2262 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:20:15 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-49830d52-b8be-4154-b90d-78867a4c2262 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:20:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-49830d52-b8be-4154-b90d-78867a4c2262 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.419s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:15 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-49830d52-b8be-4154-b90d-78867a4c2262 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Deleted allocations for instance ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13
Nov 15 04:20:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-49830d52-b8be-4154-b90d-78867a4c2262 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.492s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:15 user nova-compute[74805]: DEBUG nova.compute.manager [req-f56cdadc-2007-4cb9-b1fa-50dd811e0d1f req-09ce506d-af5f-4d23-b82e-dec3b44b34d3 service nova] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Received event network-vif-plugged-cb8b1e16-20b0-41b4-8d63-b1a46083e0ba {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:20:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f56cdadc-2007-4cb9-b1fa-50dd811e0d1f req-09ce506d-af5f-4d23-b82e-dec3b44b34d3 service nova] Acquiring lock "ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f56cdadc-2007-4cb9-b1fa-50dd811e0d1f req-09ce506d-af5f-4d23-b82e-dec3b44b34d3 service nova] Lock "ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f56cdadc-2007-4cb9-b1fa-50dd811e0d1f req-09ce506d-af5f-4d23-b82e-dec3b44b34d3 service nova] Lock "ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:15 user nova-compute[74805]: DEBUG nova.compute.manager [req-f56cdadc-2007-4cb9-b1fa-50dd811e0d1f req-09ce506d-af5f-4d23-b82e-dec3b44b34d3 service nova] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] No waiting events found dispatching network-vif-plugged-cb8b1e16-20b0-41b4-8d63-b1a46083e0ba {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:20:15 user nova-compute[74805]: WARNING nova.compute.manager [req-f56cdadc-2007-4cb9-b1fa-50dd811e0d1f req-09ce506d-af5f-4d23-b82e-dec3b44b34d3 service nova] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Received unexpected event network-vif-plugged-cb8b1e16-20b0-41b4-8d63-b1a46083e0ba for instance with vm_state deleted and task_state None.
Nov 15 04:20:15 user nova-compute[74805]: DEBUG nova.compute.manager [req-b5793ade-a157-4cf8-bb38-50c4518b3d59 req-57a27049-92bb-40b5-923b-ca0ba7828dfb service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Received event network-vif-plugged-62730abb-e77d-4e27-8e57-929086b708e3 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:20:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5793ade-a157-4cf8-bb38-50c4518b3d59 req-57a27049-92bb-40b5-923b-ca0ba7828dfb service nova] Acquiring lock "51e0a627-f95e-4347-92a7-4a218413e884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5793ade-a157-4cf8-bb38-50c4518b3d59 req-57a27049-92bb-40b5-923b-ca0ba7828dfb service nova] Lock "51e0a627-f95e-4347-92a7-4a218413e884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5793ade-a157-4cf8-bb38-50c4518b3d59 req-57a27049-92bb-40b5-923b-ca0ba7828dfb service nova] Lock "51e0a627-f95e-4347-92a7-4a218413e884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:15 user nova-compute[74805]: DEBUG nova.compute.manager [req-b5793ade-a157-4cf8-bb38-50c4518b3d59 req-57a27049-92bb-40b5-923b-ca0ba7828dfb service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] No waiting events found dispatching network-vif-plugged-62730abb-e77d-4e27-8e57-929086b708e3 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:20:15 user nova-compute[74805]: WARNING nova.compute.manager [req-b5793ade-a157-4cf8-bb38-50c4518b3d59 req-57a27049-92bb-40b5-923b-ca0ba7828dfb service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Received unexpected event network-vif-plugged-62730abb-e77d-4e27-8e57-929086b708e3 for instance with vm_state active and task_state rebuild_spawning.
Nov 15 04:20:15 user nova-compute[74805]: DEBUG nova.compute.manager [req-b5793ade-a157-4cf8-bb38-50c4518b3d59 req-57a27049-92bb-40b5-923b-ca0ba7828dfb service nova] [instance: ff2de14a-9da4-47e8-9a2e-7e7ae5c3bf13] Received event network-vif-deleted-cb8b1e16-20b0-41b4-8d63-b1a46083e0ba {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:20:16 user nova-compute[74805]: DEBUG nova.compute.manager [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:20:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:20:16 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Instance spawned successfully.
Nov 15 04:20:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:20:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:20:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:20:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:20:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:20:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:20:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:20:16 user nova-compute[74805]: DEBUG nova.compute.manager [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:20:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:16 user nova-compute[74805]: DEBUG nova.objects.instance [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74805) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 15 04:20:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f3984307-977b-4021-9913-7e3cc4a93986 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.075s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-10693354-80e2-4287-80be-efdd6b6770f0 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "cad2eedf-c1ef-436c-b608-5b6dafa47451" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-10693354-80e2-4287-80be-efdd6b6770f0 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-10693354-80e2-4287-80be-efdd6b6770f0 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "cad2eedf-c1ef-436c-b608-5b6dafa47451-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-10693354-80e2-4287-80be-efdd6b6770f0 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-10693354-80e2-4287-80be-efdd6b6770f0 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:21 user nova-compute[74805]: INFO nova.compute.manager [None req-10693354-80e2-4287-80be-efdd6b6770f0 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Terminating instance
Nov 15 04:20:21 user nova-compute[74805]: DEBUG nova.compute.manager [None req-10693354-80e2-4287-80be-efdd6b6770f0 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:20:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:21 user nova-compute[74805]: DEBUG nova.compute.manager [req-86acc5f8-7c66-4a46-82b1-f386b2debbdf req-7f13ba6d-8c81-499c-aa75-ffccab75a4f9 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Received event network-vif-unplugged-333d7ad3-7a5b-49e8-a657-a712443ad922 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:20:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-86acc5f8-7c66-4a46-82b1-f386b2debbdf req-7f13ba6d-8c81-499c-aa75-ffccab75a4f9 service nova] Acquiring lock "cad2eedf-c1ef-436c-b608-5b6dafa47451-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-86acc5f8-7c66-4a46-82b1-f386b2debbdf req-7f13ba6d-8c81-499c-aa75-ffccab75a4f9 service nova] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-86acc5f8-7c66-4a46-82b1-f386b2debbdf req-7f13ba6d-8c81-499c-aa75-ffccab75a4f9 service nova] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:21 user nova-compute[74805]: DEBUG nova.compute.manager [req-86acc5f8-7c66-4a46-82b1-f386b2debbdf req-7f13ba6d-8c81-499c-aa75-ffccab75a4f9 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] No waiting events found dispatching network-vif-unplugged-333d7ad3-7a5b-49e8-a657-a712443ad922 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:20:21 user nova-compute[74805]: DEBUG nova.compute.manager [req-86acc5f8-7c66-4a46-82b1-f386b2debbdf req-7f13ba6d-8c81-499c-aa75-ffccab75a4f9 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Received event network-vif-unplugged-333d7ad3-7a5b-49e8-a657-a712443ad922 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:20:22 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Instance destroyed successfully.
Nov 15 04:20:22 user nova-compute[74805]: DEBUG nova.objects.instance [None req-10693354-80e2-4287-80be-efdd6b6770f0 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lazy-loading 'resources' on Instance uuid cad2eedf-c1ef-436c-b608-5b6dafa47451 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:20:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-10693354-80e2-4287-80be-efdd6b6770f0 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-882338115',display_name='tempest-TestMinimumBasicScenario-server-882338115',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-882338115',id=12,image_ref='c40fd4f6-246a-4fa8-80fa-f56a69d0386c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoM4mPJpNa3lSZNqZNye7yd+TzehokoE4PQcucjBnq3agpjLVjHz6yfP2n5YbekRY7ga7hrRvA9IilP2Z+bVGfBl94B2ikgCr8ddgEyR544o0t1jjaQlKeA+jJsJfPcaA==',key_name='tempest-TestMinimumBasicScenario-883673859',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:15:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ddde64bc93cc40f189e1d0b6d948cd0a',ramdisk_id='',reservation_id='r-a1rc5i03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c40fd4f6-246a-4fa8-80fa-f56a69d0386c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-342422642',owner_user_name='tempest-TestMinimumBasicScenario-342422642-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:17:43Z,user_data=None,user_id='eac59db39ba64883a64ab3133eaf1972',uuid=cad2eedf-c1ef-436c-b608-5b6dafa47451,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "333d7ad3-7a5b-49e8-a657-a712443ad922", "address": "fa:16:3e:ff:8a:9e", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333d7ad3-7a", "ovs_interfaceid": "333d7ad3-7a5b-49e8-a657-a712443ad922", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:20:22 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-10693354-80e2-4287-80be-efdd6b6770f0 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Converting VIF {"id": "333d7ad3-7a5b-49e8-a657-a712443ad922", "address": "fa:16:3e:ff:8a:9e", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333d7ad3-7a", "ovs_interfaceid": "333d7ad3-7a5b-49e8-a657-a712443ad922", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:20:22 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-10693354-80e2-4287-80be-efdd6b6770f0 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:8a:9e,bridge_name='br-int',has_traffic_filtering=True,id=333d7ad3-7a5b-49e8-a657-a712443ad922,network=Network(8408f959-0c0d-4a22-afa0-b51304c254ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333d7ad3-7a') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:20:22 user nova-compute[74805]: DEBUG os_vif [None req-10693354-80e2-4287-80be-efdd6b6770f0 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:8a:9e,bridge_name='br-int',has_traffic_filtering=True,id=333d7ad3-7a5b-49e8-a657-a712443ad922,network=Network(8408f959-0c0d-4a22-afa0-b51304c254ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333d7ad3-7a') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:20:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap333d7ad3-7a, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:20:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:20:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f2e93d3-56cf-4e43-904f-43e211ed02ea) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:20:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:20:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:22 user nova-compute[74805]: INFO os_vif [None req-10693354-80e2-4287-80be-efdd6b6770f0 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:8a:9e,bridge_name='br-int',has_traffic_filtering=True,id=333d7ad3-7a5b-49e8-a657-a712443ad922,network=Network(8408f959-0c0d-4a22-afa0-b51304c254ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333d7ad3-7a')
Nov 15 04:20:22 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-10693354-80e2-4287-80be-efdd6b6770f0 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Deleting instance files /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451_del
Nov 15 04:20:22 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-10693354-80e2-4287-80be-efdd6b6770f0 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Deletion of /opt/stack/data/nova/instances/cad2eedf-c1ef-436c-b608-5b6dafa47451_del complete
Nov 15 04:20:22 user nova-compute[74805]: INFO nova.compute.manager [None req-10693354-80e2-4287-80be-efdd6b6770f0 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 15 04:20:22 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-10693354-80e2-4287-80be-efdd6b6770f0 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:20:22 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:20:22 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:20:23 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:20:23 user nova-compute[74805]: DEBUG nova.compute.manager [req-b9abdde5-feac-49b5-8b4c-89033156f1d0 req-3a071580-3fc9-44da-8776-1d3ceb2819f2 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Received event network-vif-deleted-333d7ad3-7a5b-49e8-a657-a712443ad922 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:20:23 user nova-compute[74805]: INFO nova.compute.manager [req-b9abdde5-feac-49b5-8b4c-89033156f1d0 req-3a071580-3fc9-44da-8776-1d3ceb2819f2 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Neutron deleted interface 333d7ad3-7a5b-49e8-a657-a712443ad922; detaching it from the instance and deleting it from the info cache
Nov 15 04:20:23 user nova-compute[74805]: DEBUG nova.network.neutron [req-b9abdde5-feac-49b5-8b4c-89033156f1d0 req-3a071580-3fc9-44da-8776-1d3ceb2819f2 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:20:23 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Took 0.66 seconds to deallocate network for instance.
Nov 15 04:20:23 user nova-compute[74805]: DEBUG nova.compute.manager [req-b9abdde5-feac-49b5-8b4c-89033156f1d0 req-3a071580-3fc9-44da-8776-1d3ceb2819f2 service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Detach interface failed, port_id=333d7ad3-7a5b-49e8-a657-a712443ad922, reason: Instance cad2eedf-c1ef-436c-b608-5b6dafa47451 could not be found. {{(pid=74805) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 04:20:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-10693354-80e2-4287-80be-efdd6b6770f0 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-10693354-80e2-4287-80be-efdd6b6770f0 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:23 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-10693354-80e2-4287-80be-efdd6b6770f0 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:20:23 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-10693354-80e2-4287-80be-efdd6b6770f0 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:20:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-10693354-80e2-4287-80be-efdd6b6770f0 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:23 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-10693354-80e2-4287-80be-efdd6b6770f0 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Deleted allocations for instance cad2eedf-c1ef-436c-b608-5b6dafa47451
Nov 15 04:20:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-10693354-80e2-4287-80be-efdd6b6770f0 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.413s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:23 user nova-compute[74805]: DEBUG nova.compute.manager [req-d5f198f9-7d6e-4cd2-982b-8e828916192f req-3e4e9b68-c3e6-477e-9908-d73a572a661d service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Received event network-vif-plugged-333d7ad3-7a5b-49e8-a657-a712443ad922 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:20:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d5f198f9-7d6e-4cd2-982b-8e828916192f req-3e4e9b68-c3e6-477e-9908-d73a572a661d service nova] Acquiring lock "cad2eedf-c1ef-436c-b608-5b6dafa47451-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d5f198f9-7d6e-4cd2-982b-8e828916192f req-3e4e9b68-c3e6-477e-9908-d73a572a661d service nova] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d5f198f9-7d6e-4cd2-982b-8e828916192f req-3e4e9b68-c3e6-477e-9908-d73a572a661d service nova] Lock "cad2eedf-c1ef-436c-b608-5b6dafa47451-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:23 user nova-compute[74805]: DEBUG nova.compute.manager [req-d5f198f9-7d6e-4cd2-982b-8e828916192f req-3e4e9b68-c3e6-477e-9908-d73a572a661d service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] No waiting events found dispatching network-vif-plugged-333d7ad3-7a5b-49e8-a657-a712443ad922 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:20:23 user nova-compute[74805]: WARNING nova.compute.manager [req-d5f198f9-7d6e-4cd2-982b-8e828916192f req-3e4e9b68-c3e6-477e-9908-d73a572a661d service nova] [instance: cad2eedf-c1ef-436c-b608-5b6dafa47451] Received unexpected event network-vif-plugged-333d7ad3-7a5b-49e8-a657-a712443ad922 for instance with vm_state deleted and task_state None.
Nov 15 04:20:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Acquiring lock "0de78a8a-d66a-4703-a044-89c2f2006860" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "0de78a8a-d66a-4703-a044-89c2f2006860" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:29 user nova-compute[74805]: INFO nova.compute.manager [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Detaching volume e8b620f1-dd0d-423d-bcfe-927abccb9402
Nov 15 04:20:29 user nova-compute[74805]: INFO nova.virt.block_device [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Attempting to driver detach volume e8b620f1-dd0d-423d-bcfe-927abccb9402 from mountpoint /dev/vdb
Nov 15 04:20:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Attempting to detach device vdb from instance 0de78a8a-d66a-4703-a044-89c2f2006860 from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:20:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:20:29 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:20:29 user nova-compute[74805]:   <source dev="/dev/sde"/>
Nov 15 04:20:29 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:20:29 user nova-compute[74805]:   <serial>e8b620f1-dd0d-423d-bcfe-927abccb9402</serial>
Nov 15 04:20:29 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:20:29 user nova-compute[74805]: </disk>
Nov 15 04:20:29 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:20:29 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Successfully detached device vdb from instance 0de78a8a-d66a-4703-a044-89c2f2006860 from the persistent domain config.
Nov 15 04:20:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0de78a8a-d66a-4703-a044-89c2f2006860 from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:20:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:20:29 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:20:29 user nova-compute[74805]:   <source dev="/dev/sde"/>
Nov 15 04:20:29 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:20:29 user nova-compute[74805]:   <serial>e8b620f1-dd0d-423d-bcfe-927abccb9402</serial>
Nov 15 04:20:29 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:20:29 user nova-compute[74805]: </disk>
Nov 15 04:20:29 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:20:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:30 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0de78a8a-d66a-4703-a044-89c2f2006860 {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:20:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "13449149-a938-41ff-964f-16f96614bf3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "13449149-a938-41ff-964f-16f96614bf3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:39 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:20:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:40 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:20:40 user nova-compute[74805]: INFO nova.compute.claims [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Claim successful on node user
Nov 15 04:20:40 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Refreshing inventories for resource provider ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 04:20:40 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Updating ProviderTree inventory for provider ada87504-5552-4a33-b754-f9a54c67fe39 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 04:20:40 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Updating inventory in ProviderTree for provider ada87504-5552-4a33-b754-f9a54c67fe39 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 04:20:40 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Refreshing aggregate associations for resource provider ada87504-5552-4a33-b754-f9a54c67fe39, aggregates: None {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 04:20:40 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Refreshing trait associations for resource provider ada87504-5552-4a33-b754-f9a54c67fe39, traits: COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 04:20:40 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:20:40 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:20:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:40 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:20:40 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:20:40 user nova-compute[74805]: DEBUG nova.network.neutron [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:20:40 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:20:40 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:20:40 user nova-compute[74805]: DEBUG nova.policy [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba1bcf1e429045129d379293cc490bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8280c6302b2e42998c7c436522c47e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:20:40 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:20:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:20:40 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Creating image(s)
Nov 15 04:20:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "/opt/stack/data/nova/instances/13449149-a938-41ff-964f-16f96614bf3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "/opt/stack/data/nova/instances/13449149-a938-41ff-964f-16f96614bf3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "/opt/stack/data/nova/instances/13449149-a938-41ff-964f-16f96614bf3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.164s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/13449149-a938-41ff-964f-16f96614bf3e/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/13449149-a938-41ff-964f-16f96614bf3e/disk 1073741824" returned: 0 in 0.044s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.180s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:41 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Checking if we can resize image /opt/stack/data/nova/instances/13449149-a938-41ff-964f-16f96614bf3e/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:20:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449149-a938-41ff-964f-16f96614bf3e/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:41 user nova-compute[74805]: DEBUG nova.network.neutron [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Successfully created port: 3e95edf0-c248-41b6-b111-8411047ab446 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:20:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449149-a938-41ff-964f-16f96614bf3e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:41 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Cannot resize image /opt/stack/data/nova/instances/13449149-a938-41ff-964f-16f96614bf3e/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:20:41 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:20:41 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Ensure instance console log exists: /opt/stack/data/nova/instances/13449149-a938-41ff-964f-16f96614bf3e/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:20:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.network.neutron [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Successfully updated port: 3e95edf0-c248-41b6-b111-8411047ab446 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "refresh_cache-13449149-a938-41ff-964f-16f96614bf3e" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquired lock "refresh_cache-13449149-a938-41ff-964f-16f96614bf3e" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.network.neutron [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.compute.manager [req-6eed4355-a3fd-4178-841d-fde8b7a307c4 req-e9b63c1e-b3be-4758-b58d-f559d89c05fc service nova] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Received event network-changed-3e95edf0-c248-41b6-b111-8411047ab446 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.compute.manager [req-6eed4355-a3fd-4178-841d-fde8b7a307c4 req-e9b63c1e-b3be-4758-b58d-f559d89c05fc service nova] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Refreshing instance network info cache due to event network-changed-3e95edf0-c248-41b6-b111-8411047ab446. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6eed4355-a3fd-4178-841d-fde8b7a307c4 req-e9b63c1e-b3be-4758-b58d-f559d89c05fc service nova] Acquiring lock "refresh_cache-13449149-a938-41ff-964f-16f96614bf3e" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.network.neutron [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.network.neutron [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Updating instance_info_cache with network_info: [{"id": "3e95edf0-c248-41b6-b111-8411047ab446", "address": "fa:16:3e:a0:c7:07", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e95edf0-c2", "ovs_interfaceid": "3e95edf0-c248-41b6-b111-8411047ab446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Releasing lock "refresh_cache-13449149-a938-41ff-964f-16f96614bf3e" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Instance network_info: |[{"id": "3e95edf0-c248-41b6-b111-8411047ab446", "address": "fa:16:3e:a0:c7:07", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e95edf0-c2", "ovs_interfaceid": "3e95edf0-c248-41b6-b111-8411047ab446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6eed4355-a3fd-4178-841d-fde8b7a307c4 req-e9b63c1e-b3be-4758-b58d-f559d89c05fc service nova] Acquired lock "refresh_cache-13449149-a938-41ff-964f-16f96614bf3e" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.network.neutron [req-6eed4355-a3fd-4178-841d-fde8b7a307c4 req-e9b63c1e-b3be-4758-b58d-f559d89c05fc service nova] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Refreshing network info cache for port 3e95edf0-c248-41b6-b111-8411047ab446 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Start _get_guest_xml network_info=[{"id": "3e95edf0-c248-41b6-b111-8411047ab446", "address": "fa:16:3e:a0:c7:07", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e95edf0-c2", "ovs_interfaceid": "3e95edf0-c248-41b6-b111-8411047ab446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:20:42 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:20:42 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:20:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-530332267',display_name='tempest-AttachVolumeNegativeTest-server-530332267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-530332267',id=21,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTxWZRiq55Yl4mR4Mkemlff8oLW47/FT3iMd8EvdbKjMEFtFNrgArIkiO1Qi57hSoyWzkn8HFBHnEBbcdHc+mDH+XosH8C7ysOcPUR/4onPgh1Jn8gNe7FcROspW/YYKA==',key_name='tempest-keypair-1386040961',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8280c6302b2e42998c7c436522c47e79',ramdisk_id='',reservation_id='r-wvan3hg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-6184130',owner_user_name='tempest-AttachVolumeNegativeTest-6184130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:20:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba1bcf1e429045129d379293cc490bde',uuid=13449149-a938-41ff-964f-16f96614bf3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e95edf0-c248-41b6-b111-8411047ab446", "address": "fa:16:3e:a0:c7:07", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e95edf0-c2", "ovs_interfaceid": "3e95edf0-c248-41b6-b111-8411047ab446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Converting VIF {"id": "3e95edf0-c248-41b6-b111-8411047ab446", "address": "fa:16:3e:a0:c7:07", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e95edf0-c2", "ovs_interfaceid": "3e95edf0-c248-41b6-b111-8411047ab446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:c7:07,bridge_name='br-int',has_traffic_filtering=True,id=3e95edf0-c248-41b6-b111-8411047ab446,network=Network(3454b4d8-1ff9-4f3c-9a93-499645affcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e95edf0-c2') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.objects.instance [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lazy-loading 'pci_devices' on Instance uuid 13449149-a938-41ff-964f-16f96614bf3e {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:20:42 user nova-compute[74805]:   <uuid>13449149-a938-41ff-964f-16f96614bf3e</uuid>
Nov 15 04:20:42 user nova-compute[74805]:   <name>instance-00000015</name>
Nov 15 04:20:42 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:20:42 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:20:42 user nova-compute[74805]:   <metadata>
Nov 15 04:20:42 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:20:42 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:20:42 user nova-compute[74805]:       <nova:name>tempest-AttachVolumeNegativeTest-server-530332267</nova:name>
Nov 15 04:20:42 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:20:42</nova:creationTime>
Nov 15 04:20:42 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:20:42 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:20:42 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:20:42 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:20:42 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:20:42 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:20:42 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:20:42 user nova-compute[74805]:       <nova:owner>
Nov 15 04:20:42 user nova-compute[74805]:         <nova:user uuid="ba1bcf1e429045129d379293cc490bde">tempest-AttachVolumeNegativeTest-6184130-project-member</nova:user>
Nov 15 04:20:42 user nova-compute[74805]:         <nova:project uuid="8280c6302b2e42998c7c436522c47e79">tempest-AttachVolumeNegativeTest-6184130</nova:project>
Nov 15 04:20:42 user nova-compute[74805]:       </nova:owner>
Nov 15 04:20:42 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:20:42 user nova-compute[74805]:       <nova:ports>
Nov 15 04:20:42 user nova-compute[74805]:         <nova:port uuid="3e95edf0-c248-41b6-b111-8411047ab446">
Nov 15 04:20:42 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 04:20:42 user nova-compute[74805]:         </nova:port>
Nov 15 04:20:42 user nova-compute[74805]:       </nova:ports>
Nov 15 04:20:42 user nova-compute[74805]:     </nova:instance>
Nov 15 04:20:42 user nova-compute[74805]:   </metadata>
Nov 15 04:20:42 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:20:42 user nova-compute[74805]:     <system>
Nov 15 04:20:42 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:20:42 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:20:42 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:20:42 user nova-compute[74805]:       <entry name="serial">13449149-a938-41ff-964f-16f96614bf3e</entry>
Nov 15 04:20:42 user nova-compute[74805]:       <entry name="uuid">13449149-a938-41ff-964f-16f96614bf3e</entry>
Nov 15 04:20:42 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:20:42 user nova-compute[74805]:     </system>
Nov 15 04:20:42 user nova-compute[74805]:   </sysinfo>
Nov 15 04:20:42 user nova-compute[74805]:   <os>
Nov 15 04:20:42 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:20:42 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:20:42 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:20:42 user nova-compute[74805]:   </os>
Nov 15 04:20:42 user nova-compute[74805]:   <features>
Nov 15 04:20:42 user nova-compute[74805]:     <acpi/>
Nov 15 04:20:42 user nova-compute[74805]:     <apic/>
Nov 15 04:20:42 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:20:42 user nova-compute[74805]:   </features>
Nov 15 04:20:42 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:20:42 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:20:42 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:20:42 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:20:42 user nova-compute[74805]:   </clock>
Nov 15 04:20:42 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:20:42 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:20:42 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:20:42 user nova-compute[74805]:   </cpu>
Nov 15 04:20:42 user nova-compute[74805]:   <devices>
Nov 15 04:20:42 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:20:42 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:20:42 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/13449149-a938-41ff-964f-16f96614bf3e/disk"/>
Nov 15 04:20:42 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:20:42 user nova-compute[74805]:     </disk>
Nov 15 04:20:42 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:20:42 user nova-compute[74805]:       <mac address="fa:16:3e:a0:c7:07"/>
Nov 15 04:20:42 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:20:42 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:20:42 user nova-compute[74805]:       <target dev="tap3e95edf0-c2"/>
Nov 15 04:20:42 user nova-compute[74805]:     </interface>
Nov 15 04:20:42 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:20:42 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/13449149-a938-41ff-964f-16f96614bf3e/console.log" append="off"/>
Nov 15 04:20:42 user nova-compute[74805]:     </serial>
Nov 15 04:20:42 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:20:42 user nova-compute[74805]:     <video>
Nov 15 04:20:42 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:20:42 user nova-compute[74805]:     </video>
Nov 15 04:20:42 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:20:42 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:20:42 user nova-compute[74805]:     </rng>
Nov 15 04:20:42 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:20:42 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:20:42 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:20:42 user nova-compute[74805]:     </memballoon>
Nov 15 04:20:42 user nova-compute[74805]:   </devices>
Nov 15 04:20:42 user nova-compute[74805]: </domain>
Nov 15 04:20:42 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:20:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-530332267',display_name='tempest-AttachVolumeNegativeTest-server-530332267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-530332267',id=21,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTxWZRiq55Yl4mR4Mkemlff8oLW47/FT3iMd8EvdbKjMEFtFNrgArIkiO1Qi57hSoyWzkn8HFBHnEBbcdHc+mDH+XosH8C7ysOcPUR/4onPgh1Jn8gNe7FcROspW/YYKA==',key_name='tempest-keypair-1386040961',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8280c6302b2e42998c7c436522c47e79',ramdisk_id='',reservation_id='r-wvan3hg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-6184130',owner_user_name='tempest-AttachVolumeNegativeTest-6184130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:20:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba1bcf1e429045129d379293cc490bde',uuid=13449149-a938-41ff-964f-16f96614bf3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e95edf0-c248-41b6-b111-8411047ab446", "address": "fa:16:3e:a0:c7:07", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e95edf0-c2", "ovs_interfaceid": "3e95edf0-c248-41b6-b111-8411047ab446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Converting VIF {"id": "3e95edf0-c248-41b6-b111-8411047ab446", "address": "fa:16:3e:a0:c7:07", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e95edf0-c2", "ovs_interfaceid": "3e95edf0-c248-41b6-b111-8411047ab446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:c7:07,bridge_name='br-int',has_traffic_filtering=True,id=3e95edf0-c248-41b6-b111-8411047ab446,network=Network(3454b4d8-1ff9-4f3c-9a93-499645affcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e95edf0-c2') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG os_vif [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:c7:07,bridge_name='br-int',has_traffic_filtering=True,id=3e95edf0-c248-41b6-b111-8411047ab446,network=Network(3454b4d8-1ff9-4f3c-9a93-499645affcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e95edf0-c2') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'edbfa8e6-ce3e-5925-b9d2-8a6c3cecbc5f', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e95edf0-c2, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e95edf0-c2, col_values=(('qos', UUID('79f56cec-102b-4e38-97d4-77675e95ce13')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e95edf0-c2, col_values=(('external_ids', {'iface-id': '3e95edf0-c248-41b6-b111-8411047ab446', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:c7:07', 'vm-uuid': '13449149-a938-41ff-964f-16f96614bf3e'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:42 user nova-compute[74805]: INFO os_vif [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:c7:07,bridge_name='br-int',has_traffic_filtering=True,id=3e95edf0-c248-41b6-b111-8411047ab446,network=Network(3454b4d8-1ff9-4f3c-9a93-499645affcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e95edf0-c2')
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] No VIF found with MAC fa:16:3e:a0:c7:07, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.network.neutron [req-6eed4355-a3fd-4178-841d-fde8b7a307c4 req-e9b63c1e-b3be-4758-b58d-f559d89c05fc service nova] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Updated VIF entry in instance network info cache for port 3e95edf0-c248-41b6-b111-8411047ab446. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:20:42 user nova-compute[74805]: DEBUG nova.network.neutron [req-6eed4355-a3fd-4178-841d-fde8b7a307c4 req-e9b63c1e-b3be-4758-b58d-f559d89c05fc service nova] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Updating instance_info_cache with network_info: [{"id": "3e95edf0-c248-41b6-b111-8411047ab446", "address": "fa:16:3e:a0:c7:07", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e95edf0-c2", "ovs_interfaceid": "3e95edf0-c248-41b6-b111-8411047ab446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:20:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6eed4355-a3fd-4178-841d-fde8b7a307c4 req-e9b63c1e-b3be-4758-b58d-f559d89c05fc service nova] Releasing lock "refresh_cache-13449149-a938-41ff-964f-16f96614bf3e" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG nova.compute.manager [req-8980abb3-eb2a-45ee-8250-d258dbf206be req-d469c40b-6749-4653-b290-19ed6f50fad7 service nova] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Received event network-vif-plugged-3e95edf0-c248-41b6-b111-8411047ab446 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8980abb3-eb2a-45ee-8250-d258dbf206be req-d469c40b-6749-4653-b290-19ed6f50fad7 service nova] Acquiring lock "13449149-a938-41ff-964f-16f96614bf3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8980abb3-eb2a-45ee-8250-d258dbf206be req-d469c40b-6749-4653-b290-19ed6f50fad7 service nova] Lock "13449149-a938-41ff-964f-16f96614bf3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8980abb3-eb2a-45ee-8250-d258dbf206be req-d469c40b-6749-4653-b290-19ed6f50fad7 service nova] Lock "13449149-a938-41ff-964f-16f96614bf3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG nova.compute.manager [req-8980abb3-eb2a-45ee-8250-d258dbf206be req-d469c40b-6749-4653-b290-19ed6f50fad7 service nova] [instance: 13449149-a938-41ff-964f-16f96614bf3e] No waiting events found dispatching network-vif-plugged-3e95edf0-c248-41b6-b111-8411047ab446 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:20:44 user nova-compute[74805]: WARNING nova.compute.manager [req-8980abb3-eb2a-45ee-8250-d258dbf206be req-d469c40b-6749-4653-b290-19ed6f50fad7 service nova] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Received unexpected event network-vif-plugged-3e95edf0-c248-41b6-b111-8411047ab446 for instance with vm_state building and task_state spawning.
Nov 15 04:20:44 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Triggering sync for uuid 2b1e540c-6226-445a-bd45-5b7b8807e2b9 {{(pid=74805) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Triggering sync for uuid 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c {{(pid=74805) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Triggering sync for uuid 0de78a8a-d66a-4703-a044-89c2f2006860 {{(pid=74805) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Triggering sync for uuid d63f3726-27df-455f-bda0-3ddca95b70d9 {{(pid=74805) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Triggering sync for uuid e5004557-00fa-4824-9233-343c2261588d {{(pid=74805) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Triggering sync for uuid 51e0a627-f95e-4347-92a7-4a218413e884 {{(pid=74805) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Triggering sync for uuid e9d8b785-83eb-4e78-9ce5-c2da589ee4f7 {{(pid=74805) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Triggering sync for uuid 45c66453-2f83-476b-a03b-6bdbb01d1849 {{(pid=74805) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Triggering sync for uuid 4fc66c41-efcf-4014-bedb-3955aed09eba {{(pid=74805) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Triggering sync for uuid 13449149-a938-41ff-964f-16f96614bf3e {{(pid=74805) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "0de78a8a-d66a-4703-a044-89c2f2006860" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "d63f3726-27df-455f-bda0-3ddca95b70d9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "d63f3726-27df-455f-bda0-3ddca95b70d9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "e5004557-00fa-4824-9233-343c2261588d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "e5004557-00fa-4824-9233-343c2261588d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "51e0a627-f95e-4347-92a7-4a218413e884" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "51e0a627-f95e-4347-92a7-4a218413e884" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "45c66453-2f83-476b-a03b-6bdbb01d1849" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "45c66453-2f83-476b-a03b-6bdbb01d1849" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "4fc66c41-efcf-4014-bedb-3955aed09eba" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "4fc66c41-efcf-4014-bedb-3955aed09eba" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.005s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "13449149-a938-41ff-964f-16f96614bf3e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "e5004557-00fa-4824-9233-343c2261588d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "51e0a627-f95e-4347-92a7-4a218413e884" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "45c66453-2f83-476b-a03b-6bdbb01d1849" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "d63f3726-27df-455f-bda0-3ddca95b70d9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "4fc66c41-efcf-4014-bedb-3955aed09eba" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.111s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.125s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Acquiring lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG nova.objects.instance [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lazy-loading 'flavor' on Instance uuid e9d8b785-83eb-4e78-9ce5-c2da589ee4f7 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:20:46 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Instance spawned successfully.
Nov 15 04:20:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:46 user nova-compute[74805]: INFO nova.compute.manager [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Took 5.42 seconds to spawn the instance on the hypervisor.
Nov 15 04:20:46 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Acquiring lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:46 user nova-compute[74805]: INFO nova.compute.manager [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Attaching volume 71279626-07d2-4779-bcd0-21df594b4683 to /dev/sdc
Nov 15 04:20:46 user nova-compute[74805]: INFO nova.compute.manager [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Took 6.46 seconds to build instance.
Nov 15 04:20:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0f55d9bb-af28-4e0a-a284-9c2928617dd8 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "13449149-a938-41ff-964f-16f96614bf3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.549s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "13449149-a938-41ff-964f-16f96614bf3e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.921s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:46 user nova-compute[74805]: INFO nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 13449149-a938-41ff-964f-16f96614bf3e] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 15 04:20:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "13449149-a938-41ff-964f-16f96614bf3e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG os_brick.utils [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG nova.compute.manager [req-b5bf63d4-4691-4ca4-b8cd-e35e93a32d30 req-5f2ec126-3a61-4494-999a-69008c6804cf service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Received event network-changed-111f5423-0048-423b-8c88-c90bee78aca7 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG nova.compute.manager [req-b5bf63d4-4691-4ca4-b8cd-e35e93a32d30 req-5f2ec126-3a61-4494-999a-69008c6804cf service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Refreshing instance network info cache due to event network-changed-111f5423-0048-423b-8c88-c90bee78aca7. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5bf63d4-4691-4ca4-b8cd-e35e93a32d30 req-5f2ec126-3a61-4494-999a-69008c6804cf service nova] Acquiring lock "refresh_cache-e9d8b785-83eb-4e78-9ce5-c2da589ee4f7" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5bf63d4-4691-4ca4-b8cd-e35e93a32d30 req-5f2ec126-3a61-4494-999a-69008c6804cf service nova] Acquired lock "refresh_cache-e9d8b785-83eb-4e78-9ce5-c2da589ee4f7" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG nova.network.neutron [req-b5bf63d4-4691-4ca4-b8cd-e35e93a32d30 req-5f2ec126-3a61-4494-999a-69008c6804cf service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Refreshing network info cache for port 111f5423-0048-423b-8c88-c90bee78aca7 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6ecb55-bfbb-48e5-97e6-61806b1dbe91]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f74c84b-4680-4dc4-bd60-d1baa1467e58]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f28efc-a332-49c9-8ab0-999ccce35b91]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a62a6f-56bb-4d7c-bf22-c9249ac26b6b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:20:46 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:20:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2227a3b-2780-467d-9119-9688d92da9f2]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG os_brick.utils [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Updating existing volume attachment record: 18bb4d2b-7c1f-4dab-aca6-2a677e7cac79 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG nova.network.neutron [req-b5bf63d4-4691-4ca4-b8cd-e35e93a32d30 req-5f2ec126-3a61-4494-999a-69008c6804cf service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Updated VIF entry in instance network info cache for port 111f5423-0048-423b-8c88-c90bee78aca7. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG nova.network.neutron [req-b5bf63d4-4691-4ca4-b8cd-e35e93a32d30 req-5f2ec126-3a61-4494-999a-69008c6804cf service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Updating instance_info_cache with network_info: [{"id": "111f5423-0048-423b-8c88-c90bee78aca7", "address": "fa:16:3e:3b:a8:eb", "network": {"id": "0e964c0c-5222-4076-add0-1a305e30ab63", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1931209247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4585c1a0b4141ff943c8f470c2487fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f5423-00", "ovs_interfaceid": "111f5423-0048-423b-8c88-c90bee78aca7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5bf63d4-4691-4ca4-b8cd-e35e93a32d30 req-5f2ec126-3a61-4494-999a-69008c6804cf service nova] Releasing lock "refresh_cache-e9d8b785-83eb-4e78-9ce5-c2da589ee4f7" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG nova.compute.manager [req-b5bf63d4-4691-4ca4-b8cd-e35e93a32d30 req-5f2ec126-3a61-4494-999a-69008c6804cf service nova] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Received event network-vif-plugged-3e95edf0-c248-41b6-b111-8411047ab446 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5bf63d4-4691-4ca4-b8cd-e35e93a32d30 req-5f2ec126-3a61-4494-999a-69008c6804cf service nova] Acquiring lock "13449149-a938-41ff-964f-16f96614bf3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5bf63d4-4691-4ca4-b8cd-e35e93a32d30 req-5f2ec126-3a61-4494-999a-69008c6804cf service nova] Lock "13449149-a938-41ff-964f-16f96614bf3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5bf63d4-4691-4ca4-b8cd-e35e93a32d30 req-5f2ec126-3a61-4494-999a-69008c6804cf service nova] Lock "13449149-a938-41ff-964f-16f96614bf3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:46 user nova-compute[74805]: DEBUG nova.compute.manager [req-b5bf63d4-4691-4ca4-b8cd-e35e93a32d30 req-5f2ec126-3a61-4494-999a-69008c6804cf service nova] [instance: 13449149-a938-41ff-964f-16f96614bf3e] No waiting events found dispatching network-vif-plugged-3e95edf0-c248-41b6-b111-8411047ab446 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:20:46 user nova-compute[74805]: WARNING nova.compute.manager [req-b5bf63d4-4691-4ca4-b8cd-e35e93a32d30 req-5f2ec126-3a61-4494-999a-69008c6804cf service nova] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Received unexpected event network-vif-plugged-3e95edf0-c248-41b6-b111-8411047ab446 for instance with vm_state active and task_state None.
Nov 15 04:20:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:50 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0de78a8a-d66a-4703-a044-89c2f2006860 is timed out.
Nov 15 04:20:50 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Successfully detached device vdb from instance 0de78a8a-d66a-4703-a044-89c2f2006860 from the live domain config.
Nov 15 04:20:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JXcSZyxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:20:50 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:20:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc922535-ec52-45db-9fdc-53bb8823b784]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:20:50 user nova-compute[74805]: No targets found.
Nov 15 04:20:50 user nova-compute[74805]: iSNS:
Nov 15 04:20:50 user nova-compute[74805]: No targets found.
Nov 15 04:20:50 user nova-compute[74805]: STATIC:
Nov 15 04:20:50 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402
Nov 15 04:20:50 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:20:50 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:20:50 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4
Nov 15 04:20:50 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:20:50 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:20:50 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7
Nov 15 04:20:50 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:20:50 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:20:50 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf
Nov 15 04:20:50 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:20:50 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:20:50 user nova-compute[74805]: FIRMWARE:
Nov 15 04:20:50 user nova-compute[74805]: No targets found.
Nov 15 04:20:50 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:20:50 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:20:50 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc7a758-5279-4222-bb65-41ec4586e331]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[32300be7-79c2-4858-8c14-a3db3d1ff213]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:20:50 user nova-compute[74805]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:20:50 user nova-compute[74805]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:20:50 user nova-compute[74805]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:20:50 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 (non-flash)
Nov 15 04:20:50 user nova-compute[74805]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:20:50 user nova-compute[74805]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:20:50 user nova-compute[74805]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:20:50 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c256a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402'): ({'sde'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Removing single pathed devices sde {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a04ad9-612b-43ea-a229-79c6a6a4baa1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d21f8fe-7d73-4358-ae23-93e276e569d4]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Flushing IO for device /dev/sde {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[19971480-a281-41f3-b223-995d37f5f42b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf354de-6369-4b6d-a265-af4dfd95137a]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] SCSI volumes sde have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4840ed3-9a94-42d3-8803-4c94db402c18]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6791c5bc-3a17-4f57-80e6-eda7422b66bd]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402, portal: 172.16.0.220,3260]
Nov 15 04:20:50 user nova-compute[74805]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402, portal: 172.16.0.220,3260] successful.
Nov 15 04:20:50 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b620f1-dd0d-423d-bcfe-927abccb9402 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d0b21e-984b-4865-8f5a-612596a87863]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] <== disconnect_volume: return (330ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:20:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG nova.objects.instance [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lazy-loading 'flavor' on Instance uuid 0de78a8a-d66a-4703-a044-89c2f2006860 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2d22fcfc-7193-46ee-b990-4d2c4e97d8c3 tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "0de78a8a-d66a-4703-a044-89c2f2006860" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.057s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "0de78a8a-d66a-4703-a044-89c2f2006860" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.017s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ESZawdMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:20:51 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:20:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:20:51 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:20:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:20:51 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "0de78a8a-d66a-4703-a044-89c2f2006860" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a1254d-2266-48e7-9ba3-45f369460a82]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:20:51 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d33fde-12ce-4135-824a-e14f156896ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683] added
Nov 15 04:20:51 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[635dfb8c-da03-4f2f-851b-336fbf4ca2c9]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.101s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a9d81f-323a-41e2-87dc-e6d52a70c235]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ESZawdMH {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ESZawdMH" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31bdc8d-1602-4fe7-9939-1aeda4ef5f6b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ESZawdMH'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbeabc95-5fe6-46c8-a416-28e5cc9b9a26]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7c5fa3-1993-4f66-8dfa-c12ccd32306b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:20:51 user nova-compute[74805]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:20:51 user nova-compute[74805]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:20:51 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:20:51 user nova-compute[74805]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:20:51 user nova-compute[74805]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:20:51 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec54801-6639-47d1-b6b0-741ac478e406]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683, portal: 172.16.0.220,3260]
Nov 15 04:20:51 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683, portal: 172.16.0.220,3260] successful.
Nov 15 04:20:51 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcbd08f-2045-4b6b-bdc6-90a91d5fe84c]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[91316792-f384-44fa-accc-cd6be8c47694]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:20:51 user nova-compute[74805]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:20:51 user nova-compute[74805]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:20:51 user nova-compute[74805]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 (non-flash)
Nov 15 04:20:51 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:20:51 user nova-compute[74805]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:20:51 user nova-compute[74805]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:20:51 user nova-compute[74805]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 (non-flash)
Nov 15 04:20:51 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9716310f-3ec5-455e-810c-685977601179]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:20:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ESZawdMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:20:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:20:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '26262343835336137', 'path': '/dev/sde'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:20:52 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262343835336137', 'path': '/dev/sde'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:20:52 user nova-compute[74805]: DEBUG nova.objects.instance [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lazy-loading 'flavor' on Instance uuid e9d8b785-83eb-4e78-9ce5-c2da589ee4f7 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:20:52 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:20:52 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:20:52 user nova-compute[74805]:   <source dev="/dev/sde"/>
Nov 15 04:20:52 user nova-compute[74805]:   <target dev="sdc" bus="scsi"/>
Nov 15 04:20:52 user nova-compute[74805]:   <serial>71279626-07d2-4779-bcd0-21df594b4683</serial>
Nov 15 04:20:52 user nova-compute[74805]:   <address type="drive" controller="0" unit="2"/>
Nov 15 04:20:52 user nova-compute[74805]: </disk>
Nov 15 04:20:52 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:20:53 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] No BDM found with device name sda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:20:53 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:20:53 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:20:53 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] No VIF found with MAC fa:16:3e:3b:a8:eb, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:20:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-862029ad-158a-43d0-b526-c3b1c9cbe10f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.260s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:20:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Acquiring lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:20:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:20:54 user nova-compute[74805]: INFO nova.compute.manager [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Detaching volume 71279626-07d2-4779-bcd0-21df594b4683
Nov 15 04:20:54 user nova-compute[74805]: INFO nova.virt.block_device [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Attempting to driver detach volume 71279626-07d2-4779-bcd0-21df594b4683 from mountpoint /dev/sdc
Nov 15 04:20:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Attempting to detach device sdc from instance e9d8b785-83eb-4e78-9ce5-c2da589ee4f7 from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:20:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:20:54 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:20:54 user nova-compute[74805]:   <source dev="/dev/sde"/>
Nov 15 04:20:54 user nova-compute[74805]:   <target dev="sdc" bus="scsi"/>
Nov 15 04:20:54 user nova-compute[74805]:   <serial>71279626-07d2-4779-bcd0-21df594b4683</serial>
Nov 15 04:20:54 user nova-compute[74805]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 15 04:20:54 user nova-compute[74805]: </disk>
Nov 15 04:20:54 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:20:54 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Successfully detached device sdc from instance e9d8b785-83eb-4e78-9ce5-c2da589ee4f7 from the persistent domain config.
Nov 15 04:20:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance e9d8b785-83eb-4e78-9ce5-c2da589ee4f7 from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:20:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:20:54 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:20:54 user nova-compute[74805]:   <source dev="/dev/sde"/>
Nov 15 04:20:54 user nova-compute[74805]:   <target dev="sdc" bus="scsi"/>
Nov 15 04:20:54 user nova-compute[74805]:   <serial>71279626-07d2-4779-bcd0-21df594b4683</serial>
Nov 15 04:20:54 user nova-compute[74805]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 15 04:20:54 user nova-compute[74805]: </disk>
Nov 15 04:20:54 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:20:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance e9d8b785-83eb-4e78-9ce5-c2da589ee4f7 {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:20:54 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:20:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Acquiring lock "b3800420-c3dd-4c51-a500-e405031e9a34" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "b3800420-c3dd-4c51-a500-e405031e9a34" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:04 user nova-compute[74805]: DEBUG nova.compute.manager [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:21:04 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:21:04 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:21:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:04 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:21:04 user nova-compute[74805]: INFO nova.compute.claims [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Claim successful on node user
Nov 15 04:21:04 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:21:04 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:21:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.459s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:04 user nova-compute[74805]: DEBUG nova.compute.manager [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:21:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:04 user nova-compute[74805]: DEBUG nova.compute.manager [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:21:04 user nova-compute[74805]: DEBUG nova.network.neutron [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:21:04 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:21:05 user nova-compute[74805]: DEBUG nova.compute.manager [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:21:05 user nova-compute[74805]: DEBUG nova.policy [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd93268af3cc4492bbdc20d26ad09cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c33c44f366409bbb2007dc83cc520a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:21:05 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:21:05 user nova-compute[74805]: DEBUG nova.compute.manager [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:21:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:21:05 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Creating image(s)
Nov 15 04:21:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3800420-c3dd-4c51-a500-e405031e9a34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "/opt/stack/data/nova/instances/b3800420-c3dd-4c51-a500-e405031e9a34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "/opt/stack/data/nova/instances/b3800420-c3dd-4c51-a500-e405031e9a34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.174s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.183s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/b3800420-c3dd-4c51-a500-e405031e9a34/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/b3800420-c3dd-4c51-a500-e405031e9a34/disk 1073741824" returned: 0 in 0.047s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:05 user nova-compute[74805]: DEBUG nova.network.neutron [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Successfully created port: da918dfb-1b07-46d1-80a1-d2dac424f931 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:21:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.179s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:05 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3800420-c3dd-4c51-a500-e405031e9a34/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:21:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3800420-c3dd-4c51-a500-e405031e9a34/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3800420-c3dd-4c51-a500-e405031e9a34/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:05 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Cannot resize image /opt/stack/data/nova/instances/b3800420-c3dd-4c51-a500-e405031e9a34/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:21:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:21:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Ensure instance console log exists: /opt/stack/data/nova/instances/b3800420-c3dd-4c51-a500-e405031e9a34/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:21:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:06 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:21:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:06 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:21:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449149-a938-41ff-964f-16f96614bf3e/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449149-a938-41ff-964f-16f96614bf3e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449149-a938-41ff-964f-16f96614bf3e/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:06 user nova-compute[74805]: DEBUG nova.network.neutron [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Successfully updated port: da918dfb-1b07-46d1-80a1-d2dac424f931 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:21:06 user nova-compute[74805]: DEBUG nova.compute.manager [req-eaab1228-2e62-4669-8bdd-48eb95fdd6f4 req-fde96791-5fa8-4130-b18c-c328fc6ebfa5 service nova] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Received event network-changed-da918dfb-1b07-46d1-80a1-d2dac424f931 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:21:06 user nova-compute[74805]: DEBUG nova.compute.manager [req-eaab1228-2e62-4669-8bdd-48eb95fdd6f4 req-fde96791-5fa8-4130-b18c-c328fc6ebfa5 service nova] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Refreshing instance network info cache due to event network-changed-da918dfb-1b07-46d1-80a1-d2dac424f931. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:21:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-eaab1228-2e62-4669-8bdd-48eb95fdd6f4 req-fde96791-5fa8-4130-b18c-c328fc6ebfa5 service nova] Acquiring lock "refresh_cache-b3800420-c3dd-4c51-a500-e405031e9a34" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:21:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-eaab1228-2e62-4669-8bdd-48eb95fdd6f4 req-fde96791-5fa8-4130-b18c-c328fc6ebfa5 service nova] Acquired lock "refresh_cache-b3800420-c3dd-4c51-a500-e405031e9a34" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:21:06 user nova-compute[74805]: DEBUG nova.network.neutron [req-eaab1228-2e62-4669-8bdd-48eb95fdd6f4 req-fde96791-5fa8-4130-b18c-c328fc6ebfa5 service nova] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Refreshing network info cache for port da918dfb-1b07-46d1-80a1-d2dac424f931 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:21:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Acquiring lock "refresh_cache-b3800420-c3dd-4c51-a500-e405031e9a34" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:21:06 user nova-compute[74805]: DEBUG nova.network.neutron [req-eaab1228-2e62-4669-8bdd-48eb95fdd6f4 req-fde96791-5fa8-4130-b18c-c328fc6ebfa5 service nova] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:21:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449149-a938-41ff-964f-16f96614bf3e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:06 user nova-compute[74805]: DEBUG nova.network.neutron [req-eaab1228-2e62-4669-8bdd-48eb95fdd6f4 req-fde96791-5fa8-4130-b18c-c328fc6ebfa5 service nova] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:21:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-eaab1228-2e62-4669-8bdd-48eb95fdd6f4 req-fde96791-5fa8-4130-b18c-c328fc6ebfa5 service nova] Releasing lock "refresh_cache-b3800420-c3dd-4c51-a500-e405031e9a34" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:21:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Acquired lock "refresh_cache-b3800420-c3dd-4c51-a500-e405031e9a34" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:21:06 user nova-compute[74805]: DEBUG nova.network.neutron [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:21:06 user nova-compute[74805]: DEBUG nova.network.neutron [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:21:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.objects.instance [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'flavor' on Instance uuid e5004557-00fa-4824-9233-343c2261588d {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "refresh_cache-e5004557-00fa-4824-9233-343c2261588d" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquired lock "refresh_cache-e5004557-00fa-4824-9233-343c2261588d" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.network.neutron [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.objects.instance [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'info_cache' on Instance uuid e5004557-00fa-4824-9233-343c2261588d {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.network.neutron [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Updating instance_info_cache with network_info: [{"id": "da918dfb-1b07-46d1-80a1-d2dac424f931", "address": "fa:16:3e:33:1b:31", "network": {"id": "9094d1cf-3e56-409a-9fec-dfc97741820d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1184254201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c33c44f366409bbb2007dc83cc520a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda918dfb-1b", "ovs_interfaceid": "da918dfb-1b07-46d1-80a1-d2dac424f931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.objects.base [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Object Instance<e5004557-00fa-4824-9233-343c2261588d> lazy-loaded attributes: flavor,info_cache {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Releasing lock "refresh_cache-b3800420-c3dd-4c51-a500-e405031e9a34" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.compute.manager [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Instance network_info: |[{"id": "da918dfb-1b07-46d1-80a1-d2dac424f931", "address": "fa:16:3e:33:1b:31", "network": {"id": "9094d1cf-3e56-409a-9fec-dfc97741820d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1184254201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c33c44f366409bbb2007dc83cc520a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda918dfb-1b", "ovs_interfaceid": "da918dfb-1b07-46d1-80a1-d2dac424f931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Start _get_guest_xml network_info=[{"id": "da918dfb-1b07-46d1-80a1-d2dac424f931", "address": "fa:16:3e:33:1b:31", "network": {"id": "9094d1cf-3e56-409a-9fec-dfc97741820d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1184254201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c33c44f366409bbb2007dc83cc520a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda918dfb-1b", "ovs_interfaceid": "da918dfb-1b07-46d1-80a1-d2dac424f931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:21:07 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:21:07 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-23575556',display_name='tempest-VolumesActionsTest-instance-23575556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-23575556',id=22,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87c33c44f366409bbb2007dc83cc520a',ramdisk_id='',reservation_id='r-mwu3zxn6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1048271835',owner_user_name='tempest-VolumesActionsTest-1048271835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:21:05Z,user_data=None,user_id='d93268af3cc4492bbdc20d26ad09cacc',uuid=b3800420-c3dd-4c51-a500-e405031e9a34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da918dfb-1b07-46d1-80a1-d2dac424f931", "address": "fa:16:3e:33:1b:31", "network": {"id": "9094d1cf-3e56-409a-9fec-dfc97741820d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1184254201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c33c44f366409bbb2007dc83cc520a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda918dfb-1b", "ovs_interfaceid": "da918dfb-1b07-46d1-80a1-d2dac424f931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Converting VIF {"id": "da918dfb-1b07-46d1-80a1-d2dac424f931", "address": "fa:16:3e:33:1b:31", "network": {"id": "9094d1cf-3e56-409a-9fec-dfc97741820d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1184254201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c33c44f366409bbb2007dc83cc520a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda918dfb-1b", "ovs_interfaceid": "da918dfb-1b07-46d1-80a1-d2dac424f931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:1b:31,bridge_name='br-int',has_traffic_filtering=True,id=da918dfb-1b07-46d1-80a1-d2dac424f931,network=Network(9094d1cf-3e56-409a-9fec-dfc97741820d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda918dfb-1b') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.objects.instance [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lazy-loading 'pci_devices' on Instance uuid b3800420-c3dd-4c51-a500-e405031e9a34 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:21:07 user nova-compute[74805]:   <uuid>b3800420-c3dd-4c51-a500-e405031e9a34</uuid>
Nov 15 04:21:07 user nova-compute[74805]:   <name>instance-00000016</name>
Nov 15 04:21:07 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:21:07 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:21:07 user nova-compute[74805]:   <metadata>
Nov 15 04:21:07 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:21:07 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:21:07 user nova-compute[74805]:       <nova:name>tempest-VolumesActionsTest-instance-23575556</nova:name>
Nov 15 04:21:07 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:21:07</nova:creationTime>
Nov 15 04:21:07 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:21:07 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:21:07 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:21:07 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:21:07 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:21:07 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:21:07 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:21:07 user nova-compute[74805]:       <nova:owner>
Nov 15 04:21:07 user nova-compute[74805]:         <nova:user uuid="d93268af3cc4492bbdc20d26ad09cacc">tempest-VolumesActionsTest-1048271835-project-member</nova:user>
Nov 15 04:21:07 user nova-compute[74805]:         <nova:project uuid="87c33c44f366409bbb2007dc83cc520a">tempest-VolumesActionsTest-1048271835</nova:project>
Nov 15 04:21:07 user nova-compute[74805]:       </nova:owner>
Nov 15 04:21:07 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:21:07 user nova-compute[74805]:       <nova:ports>
Nov 15 04:21:07 user nova-compute[74805]:         <nova:port uuid="da918dfb-1b07-46d1-80a1-d2dac424f931">
Nov 15 04:21:07 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 04:21:07 user nova-compute[74805]:         </nova:port>
Nov 15 04:21:07 user nova-compute[74805]:       </nova:ports>
Nov 15 04:21:07 user nova-compute[74805]:     </nova:instance>
Nov 15 04:21:07 user nova-compute[74805]:   </metadata>
Nov 15 04:21:07 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:21:07 user nova-compute[74805]:     <system>
Nov 15 04:21:07 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:21:07 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:21:07 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:21:07 user nova-compute[74805]:       <entry name="serial">b3800420-c3dd-4c51-a500-e405031e9a34</entry>
Nov 15 04:21:07 user nova-compute[74805]:       <entry name="uuid">b3800420-c3dd-4c51-a500-e405031e9a34</entry>
Nov 15 04:21:07 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:21:07 user nova-compute[74805]:     </system>
Nov 15 04:21:07 user nova-compute[74805]:   </sysinfo>
Nov 15 04:21:07 user nova-compute[74805]:   <os>
Nov 15 04:21:07 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:21:07 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:21:07 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:21:07 user nova-compute[74805]:   </os>
Nov 15 04:21:07 user nova-compute[74805]:   <features>
Nov 15 04:21:07 user nova-compute[74805]:     <acpi/>
Nov 15 04:21:07 user nova-compute[74805]:     <apic/>
Nov 15 04:21:07 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:21:07 user nova-compute[74805]:   </features>
Nov 15 04:21:07 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:21:07 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:21:07 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:21:07 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:21:07 user nova-compute[74805]:   </clock>
Nov 15 04:21:07 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:21:07 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:21:07 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:21:07 user nova-compute[74805]:   </cpu>
Nov 15 04:21:07 user nova-compute[74805]:   <devices>
Nov 15 04:21:07 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:21:07 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:21:07 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/b3800420-c3dd-4c51-a500-e405031e9a34/disk"/>
Nov 15 04:21:07 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:21:07 user nova-compute[74805]:     </disk>
Nov 15 04:21:07 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:21:07 user nova-compute[74805]:       <mac address="fa:16:3e:33:1b:31"/>
Nov 15 04:21:07 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:21:07 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:21:07 user nova-compute[74805]:       <target dev="tapda918dfb-1b"/>
Nov 15 04:21:07 user nova-compute[74805]:     </interface>
Nov 15 04:21:07 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:21:07 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/b3800420-c3dd-4c51-a500-e405031e9a34/console.log" append="off"/>
Nov 15 04:21:07 user nova-compute[74805]:     </serial>
Nov 15 04:21:07 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:21:07 user nova-compute[74805]:     <video>
Nov 15 04:21:07 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:21:07 user nova-compute[74805]:     </video>
Nov 15 04:21:07 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:21:07 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:21:07 user nova-compute[74805]:     </rng>
Nov 15 04:21:07 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:21:07 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:21:07 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:21:07 user nova-compute[74805]:     </memballoon>
Nov 15 04:21:07 user nova-compute[74805]:   </devices>
Nov 15 04:21:07 user nova-compute[74805]: </domain>
Nov 15 04:21:07 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-23575556',display_name='tempest-VolumesActionsTest-instance-23575556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-23575556',id=22,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87c33c44f366409bbb2007dc83cc520a',ramdisk_id='',reservation_id='r-mwu3zxn6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1048271835',owner_user_name='tempest-VolumesActionsTest-1048271835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:21:05Z,user_data=None,user_id='d93268af3cc4492bbdc20d26ad09cacc',uuid=b3800420-c3dd-4c51-a500-e405031e9a34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da918dfb-1b07-46d1-80a1-d2dac424f931", "address": "fa:16:3e:33:1b:31", "network": {"id": "9094d1cf-3e56-409a-9fec-dfc97741820d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1184254201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c33c44f366409bbb2007dc83cc520a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda918dfb-1b", "ovs_interfaceid": "da918dfb-1b07-46d1-80a1-d2dac424f931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Converting VIF {"id": "da918dfb-1b07-46d1-80a1-d2dac424f931", "address": "fa:16:3e:33:1b:31", "network": {"id": "9094d1cf-3e56-409a-9fec-dfc97741820d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1184254201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c33c44f366409bbb2007dc83cc520a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda918dfb-1b", "ovs_interfaceid": "da918dfb-1b07-46d1-80a1-d2dac424f931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:1b:31,bridge_name='br-int',has_traffic_filtering=True,id=da918dfb-1b07-46d1-80a1-d2dac424f931,network=Network(9094d1cf-3e56-409a-9fec-dfc97741820d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda918dfb-1b') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG os_vif [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:1b:31,bridge_name='br-int',has_traffic_filtering=True,id=da918dfb-1b07-46d1-80a1-d2dac424f931,network=Network(9094d1cf-3e56-409a-9fec-dfc97741820d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda918dfb-1b') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7aa06722-be3d-55fc-9f8c-a62dbd9832e6', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda918dfb-1b, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda918dfb-1b, col_values=(('qos', UUID('e90569ae-8a70-42b5-afff-20fdbfb9b00b')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda918dfb-1b, col_values=(('external_ids', {'iface-id': 'da918dfb-1b07-46d1-80a1-d2dac424f931', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:1b:31', 'vm-uuid': 'b3800420-c3dd-4c51-a500-e405031e9a34'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:07 user nova-compute[74805]: INFO os_vif [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:1b:31,bridge_name='br-int',has_traffic_filtering=True,id=da918dfb-1b07-46d1-80a1-d2dac424f931,network=Network(9094d1cf-3e56-409a-9fec-dfc97741820d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda918dfb-1b')
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] No VIF found with MAC fa:16:3e:33:1b:31, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.network.neutron [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Updating instance_info_cache with network_info: [{"id": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "address": "fa:16:3e:c8:0f:b4", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96104fe5-a8", "ovs_interfaceid": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Releasing lock "refresh_cache-e5004557-00fa-4824-9233-343c2261588d" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:21:07 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: e5004557-00fa-4824-9233-343c2261588d] Instance destroyed successfully.
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.objects.instance [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'resources' on Instance uuid e5004557-00fa-4824-9233-343c2261588d {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.objects.base [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Object Instance<e5004557-00fa-4824-9233-343c2261588d> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:17:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1146298859',display_name='tempest-AttachVolumeTestJSON-server-1146298859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1146298859',id=15,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcDGmoSL9n6BzrErqwQE4CV+qAoPf9h8eN4+5EDz04bsyjTTZ4Sit9JWjEhWommytKEKkL3SeMOXxTqRGtePTLcAr9xdzbbxAAil9ruYGUIPqhf/tGyrXvLN/cCYSgOhg==',key_name='tempest-keypair-2130424993',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:17:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b7ba201faadb461882c823f9bd895af9',ramdisk_id='',reservation_id='r-g45utcp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-17326548',owner_user_name='tempest-AttachVolumeTestJSON-17326548-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:19:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50fe72dfe19f4c9792c4733f14b2d464',uuid=e5004557-00fa-4824-9233-343c2261588d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "address": "fa:16:3e:c8:0f:b4", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96104fe5-a8", "ovs_interfaceid": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Converting VIF {"id": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "address": "fa:16:3e:c8:0f:b4", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96104fe5-a8", "ovs_interfaceid": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:0f:b4,bridge_name='br-int',has_traffic_filtering=True,id=96104fe5-a8a5-445d-9c2a-6631a15e4349,network=Network(5b2973a0-643c-4d30-a6cd-3d1391fe2cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96104fe5-a8') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG os_vif [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:0f:b4,bridge_name='br-int',has_traffic_filtering=True,id=96104fe5-a8a5-445d-9c2a-6631a15e4349,network=Network(5b2973a0-643c-4d30-a6cd-3d1391fe2cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96104fe5-a8') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96104fe5-a8, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc59cdf7-24c6-4f61-9570-7977f5a7862c) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:07 user nova-compute[74805]: INFO os_vif [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:0f:b4,bridge_name='br-int',has_traffic_filtering=True,id=96104fe5-a8a5-445d-9c2a-6631a15e4349,network=Network(5b2973a0-643c-4d30-a6cd-3d1391fe2cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96104fe5-a8')
Nov 15 04:21:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHMBdyZI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:21:07 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:21:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e26adbc-9cdf-4ee9-8741-59f228f14104]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:21:07 user nova-compute[74805]: No targets found.
Nov 15 04:21:07 user nova-compute[74805]: iSNS:
Nov 15 04:21:07 user nova-compute[74805]: No targets found.
Nov 15 04:21:07 user nova-compute[74805]: STATIC:
Nov 15 04:21:07 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4
Nov 15 04:21:07 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:21:07 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:21:07 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7
Nov 15 04:21:07 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:21:07 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:21:07 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683
Nov 15 04:21:07 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:21:07 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:21:07 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf
Nov 15 04:21:07 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:21:07 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:21:07 user nova-compute[74805]: FIRMWARE:
Nov 15 04:21:07 user nova-compute[74805]: No targets found.
Nov 15 04:21:07 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:21:07 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:21:07 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d9b7b6-3aff-40f9-81be-2b2a5fb380f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac194ca6-eb09-48fc-b052-4640c7ab9d63]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:21:07 user nova-compute[74805]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:21:07 user nova-compute[74805]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:21:07 user nova-compute[74805]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 (non-flash)
Nov 15 04:21:07 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:21:07 user nova-compute[74805]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:21:07 user nova-compute[74805]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:21:07 user nova-compute[74805]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 (non-flash)
Nov 15 04:21:07 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f78734700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7'): ({'sdd'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Removing single pathed devices sdd {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb89245c-9eb6-45bb-979d-9658aed85b9a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccf88b7-9aba-4a43-b251-b8b668ce45c4]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Flushing IO for device /dev/sdd {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[70835052-791d-4bc2-8b81-e44abfcf6c39]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[921ae7d9-2cc6-45ad-bb4d-7d7fd1825446]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] SCSI volumes sdd have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[270addea-eb38-4032-a31a-59baa1c31115]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d5d01e-3018-4f0e-9a0b-344a95a15fd5]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7, portal: 172.16.0.220,3260]
Nov 15 04:21:08 user nova-compute[74805]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7, portal: 172.16.0.220,3260] successful.
Nov 15 04:21:08 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd70c6b7-515e-48ef-822a-3da7c1951a82]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] <== disconnect_volume: return (413ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Start _get_guest_xml network_info=[{"id": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "address": "fa:16:3e:c8:0f:b4", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96104fe5-a8", "ovs_interfaceid": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHMBdyZI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'e5004557-00fa-4824-9233-343c2261588d', 'attached_at': '', 'detached_at': '', 'volume_id': '944e52fb-ec1c-4673-a146-945688c4c4d7', 'serial': '944e52fb-ec1c-4673-a146-945688c4c4d7'}, 'delete_on_termination': False, 'attachment_id': '8262b6ee-ad31-4974-899c-3461d3b1c872', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG nova.objects.instance [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'numa_topology' on Instance uuid e5004557-00fa-4824-9233-343c2261588d {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG nova.compute.manager [req-8bb4dd8a-9bdd-49fb-b26f-ecf8f3a344c1 req-ea6e3ae0-aec4-47ae-b918-c86da684482f service nova] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Received event network-changed-28a2a15e-d316-4502-a5d8-c7877fc85311 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG nova.compute.manager [req-8bb4dd8a-9bdd-49fb-b26f-ecf8f3a344c1 req-ea6e3ae0-aec4-47ae-b918-c86da684482f service nova] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Refreshing instance network info cache due to event network-changed-28a2a15e-d316-4502-a5d8-c7877fc85311. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8bb4dd8a-9bdd-49fb-b26f-ecf8f3a344c1 req-ea6e3ae0-aec4-47ae-b918-c86da684482f service nova] Acquiring lock "refresh_cache-45c66453-2f83-476b-a03b-6bdbb01d1849" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8bb4dd8a-9bdd-49fb-b26f-ecf8f3a344c1 req-ea6e3ae0-aec4-47ae-b918-c86da684482f service nova] Acquired lock "refresh_cache-45c66453-2f83-476b-a03b-6bdbb01d1849" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG nova.network.neutron [req-8bb4dd8a-9bdd-49fb-b26f-ecf8f3a344c1 req-ea6e3ae0-aec4-47ae-b918-c86da684482f service nova] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Refreshing network info cache for port 28a2a15e-d316-4502-a5d8-c7877fc85311 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG nova.objects.base [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Object Instance<e5004557-00fa-4824-9233-343c2261588d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:21:08 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:21:08 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:21:08 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG nova.objects.instance [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'vcpu_model' on Instance uuid e5004557-00fa-4824-9233-343c2261588d {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG nova.objects.base [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Object Instance<e5004557-00fa-4824-9233-343c2261588d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHMBdyZI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:21:08 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:21:08 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:21:08 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce616df-24ce-4fa7-8611-07eecf72b7ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:21:08 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8553d1-ad81-459e-ac61-72dfbdbf72d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7] added
Nov 15 04:21:08 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e60f5e7-eecd-4599-ad7a-e5c05c9030c4]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56d1db2-307a-444e-9cad-e4961e066be2]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XHMBdyZI {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XHMBdyZI" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6218e996-4954-4946-860c-0de8db637e0b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XHMBdyZI'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d52dd2-b9f5-4ab0-a4b9-09b8614d716c]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e30fafd-e9ec-414b-9029-1a093ff1b49e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:21:08 user nova-compute[74805]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:21:08 user nova-compute[74805]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 (non-flash)
Nov 15 04:21:08 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:21:08 user nova-compute[74805]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:21:08 user nova-compute[74805]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 (non-flash)
Nov 15 04:21:08 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.163s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ac9acc-4b86-49c3-b407-b07ad2100b04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7, portal: 172.16.0.220,3260]
Nov 15 04:21:08 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7, portal: 172.16.0.220,3260] successful.
Nov 15 04:21:08 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[186fcf9e-ce1e-44b3-9f20-8d70f4e66d2c]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG nova.network.neutron [req-8bb4dd8a-9bdd-49fb-b26f-ecf8f3a344c1 req-ea6e3ae0-aec4-47ae-b918-c86da684482f service nova] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Updated VIF entry in instance network info cache for port 28a2a15e-d316-4502-a5d8-c7877fc85311. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG nova.network.neutron [req-8bb4dd8a-9bdd-49fb-b26f-ecf8f3a344c1 req-ea6e3ae0-aec4-47ae-b918-c86da684482f service nova] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Updating instance_info_cache with network_info: [{"id": "28a2a15e-d316-4502-a5d8-c7877fc85311", "address": "fa:16:3e:9c:8d:32", "network": {"id": "8a59b0de-c0e7-442f-90fa-ccb85294d3f7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640403300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13324230e774496aa688ef50d872cb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28a2a15e-d3", "ovs_interfaceid": "28a2a15e-d316-4502-a5d8-c7877fc85311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f5dab7-c642-42dc-97db-fa3059ef3a9f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:21:08 user nova-compute[74805]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:21:08 user nova-compute[74805]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 (non-flash)
Nov 15 04:21:08 user nova-compute[74805]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:21:08 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:21:08 user nova-compute[74805]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:21:08 user nova-compute[74805]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 (non-flash)
Nov 15 04:21:08 user nova-compute[74805]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:21:08 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.479s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55baac6-0a56-48b6-9a79-daca584faa03]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHMBdyZI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8bb4dd8a-9bdd-49fb-b26f-ecf8f3a344c1 req-ea6e3ae0-aec4-47ae-b918-c86da684482f service nova] Releasing lock "refresh_cache-45c66453-2f83-476b-a03b-6bdbb01d1849" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:08 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:21:09 user nova-compute[74805]: DEBUG nova.compute.manager [req-6e39b22c-678a-4f59-859f-320ee3765045 req-6560a2d6-bbfb-4f97-9da5-6a76af3e3b65 service nova] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Received event network-vif-plugged-da918dfb-1b07-46d1-80a1-d2dac424f931 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:21:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6e39b22c-678a-4f59-859f-320ee3765045 req-6560a2d6-bbfb-4f97-9da5-6a76af3e3b65 service nova] Acquiring lock "b3800420-c3dd-4c51-a500-e405031e9a34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6e39b22c-678a-4f59-859f-320ee3765045 req-6560a2d6-bbfb-4f97-9da5-6a76af3e3b65 service nova] Lock "b3800420-c3dd-4c51-a500-e405031e9a34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6e39b22c-678a-4f59-859f-320ee3765045 req-6560a2d6-bbfb-4f97-9da5-6a76af3e3b65 service nova] Lock "b3800420-c3dd-4c51-a500-e405031e9a34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:09 user nova-compute[74805]: DEBUG nova.compute.manager [req-6e39b22c-678a-4f59-859f-320ee3765045 req-6560a2d6-bbfb-4f97-9da5-6a76af3e3b65 service nova] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] No waiting events found dispatching network-vif-plugged-da918dfb-1b07-46d1-80a1-d2dac424f931 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:21:09 user nova-compute[74805]: WARNING nova.compute.manager [req-6e39b22c-678a-4f59-859f-320ee3765045 req-6560a2d6-bbfb-4f97-9da5-6a76af3e3b65 service nova] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Received unexpected event network-vif-plugged-da918dfb-1b07-46d1-80a1-d2dac424f931 for instance with vm_state building and task_state spawning.
Nov 15 04:21:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:09 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:09 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:21:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fc66c41-efcf-4014-bedb-3955aed09eba/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.515s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:21:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] <== connect_volume: return (1518ms) {'type': 'block', 'scsi_wwn': '23831623665326531', 'path': '/dev/sdd'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:21:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831623665326531', 'path': '/dev/sdd'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:21:09 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:17:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1146298859',display_name='tempest-AttachVolumeTestJSON-server-1146298859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1146298859',id=15,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcDGmoSL9n6BzrErqwQE4CV+qAoPf9h8eN4+5EDz04bsyjTTZ4Sit9JWjEhWommytKEKkL3SeMOXxTqRGtePTLcAr9xdzbbxAAil9ruYGUIPqhf/tGyrXvLN/cCYSgOhg==',key_name='tempest-keypair-2130424993',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:17:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b7ba201faadb461882c823f9bd895af9',ramdisk_id='',reservation_id='r-g45utcp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-17326548',owner_user_name='tempest-AttachVolumeTestJSON-17326548-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:19:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50fe72dfe19f4c9792c4733f14b2d464',uuid=e5004557-00fa-4824-9233-343c2261588d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "address": "fa:16:3e:c8:0f:b4", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96104fe5-a8", "ovs_interfaceid": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:21:09 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Converting VIF {"id": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "address": "fa:16:3e:c8:0f:b4", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96104fe5-a8", "ovs_interfaceid": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:21:09 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:0f:b4,bridge_name='br-int',has_traffic_filtering=True,id=96104fe5-a8a5-445d-9c2a-6631a15e4349,network=Network(5b2973a0-643c-4d30-a6cd-3d1391fe2cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96104fe5-a8') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:21:09 user nova-compute[74805]: DEBUG nova.objects.instance [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'pci_devices' on Instance uuid e5004557-00fa-4824-9233-343c2261588d {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:21:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fc66c41-efcf-4014-bedb-3955aed09eba/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fc66c41-efcf-4014-bedb-3955aed09eba/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:10 user nova-compute[74805]: DEBUG nova.objects.base [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Object Instance<e5004557-00fa-4824-9233-343c2261588d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:21:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:21:10 user nova-compute[74805]:   <uuid>e5004557-00fa-4824-9233-343c2261588d</uuid>
Nov 15 04:21:10 user nova-compute[74805]:   <name>instance-0000000f</name>
Nov 15 04:21:10 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:21:10 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:21:10 user nova-compute[74805]:   <metadata>
Nov 15 04:21:10 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:21:10 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:21:10 user nova-compute[74805]:       <nova:name>tempest-AttachVolumeTestJSON-server-1146298859</nova:name>
Nov 15 04:21:10 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:21:08</nova:creationTime>
Nov 15 04:21:10 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:21:10 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:21:10 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:21:10 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:21:10 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:21:10 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:21:10 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:21:10 user nova-compute[74805]:       <nova:owner>
Nov 15 04:21:10 user nova-compute[74805]:         <nova:user uuid="50fe72dfe19f4c9792c4733f14b2d464">tempest-AttachVolumeTestJSON-17326548-project-member</nova:user>
Nov 15 04:21:10 user nova-compute[74805]:         <nova:project uuid="b7ba201faadb461882c823f9bd895af9">tempest-AttachVolumeTestJSON-17326548</nova:project>
Nov 15 04:21:10 user nova-compute[74805]:       </nova:owner>
Nov 15 04:21:10 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:21:10 user nova-compute[74805]:       <nova:ports>
Nov 15 04:21:10 user nova-compute[74805]:         <nova:port uuid="96104fe5-a8a5-445d-9c2a-6631a15e4349">
Nov 15 04:21:10 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 04:21:10 user nova-compute[74805]:         </nova:port>
Nov 15 04:21:10 user nova-compute[74805]:       </nova:ports>
Nov 15 04:21:10 user nova-compute[74805]:     </nova:instance>
Nov 15 04:21:10 user nova-compute[74805]:   </metadata>
Nov 15 04:21:10 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:21:10 user nova-compute[74805]:     <system>
Nov 15 04:21:10 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:21:10 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:21:10 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:21:10 user nova-compute[74805]:       <entry name="serial">e5004557-00fa-4824-9233-343c2261588d</entry>
Nov 15 04:21:10 user nova-compute[74805]:       <entry name="uuid">e5004557-00fa-4824-9233-343c2261588d</entry>
Nov 15 04:21:10 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:21:10 user nova-compute[74805]:     </system>
Nov 15 04:21:10 user nova-compute[74805]:   </sysinfo>
Nov 15 04:21:10 user nova-compute[74805]:   <os>
Nov 15 04:21:10 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:21:10 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:21:10 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:21:10 user nova-compute[74805]:   </os>
Nov 15 04:21:10 user nova-compute[74805]:   <features>
Nov 15 04:21:10 user nova-compute[74805]:     <acpi/>
Nov 15 04:21:10 user nova-compute[74805]:     <apic/>
Nov 15 04:21:10 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:21:10 user nova-compute[74805]:   </features>
Nov 15 04:21:10 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:21:10 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:21:10 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:21:10 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:21:10 user nova-compute[74805]:   </clock>
Nov 15 04:21:10 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:21:10 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:21:10 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:21:10 user nova-compute[74805]:   </cpu>
Nov 15 04:21:10 user nova-compute[74805]:   <devices>
Nov 15 04:21:10 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:21:10 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:21:10 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk"/>
Nov 15 04:21:10 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:21:10 user nova-compute[74805]:     </disk>
Nov 15 04:21:10 user nova-compute[74805]:     <disk type="block" device="disk">
Nov 15 04:21:10 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:21:10 user nova-compute[74805]:       <source dev="/dev/sdd"/>
Nov 15 04:21:10 user nova-compute[74805]:       <target dev="vdb" bus="virtio"/>
Nov 15 04:21:10 user nova-compute[74805]:       <serial>944e52fb-ec1c-4673-a146-945688c4c4d7</serial>
Nov 15 04:21:10 user nova-compute[74805]:     </disk>
Nov 15 04:21:10 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:21:10 user nova-compute[74805]:       <mac address="fa:16:3e:c8:0f:b4"/>
Nov 15 04:21:10 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:21:10 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:21:10 user nova-compute[74805]:       <target dev="tap96104fe5-a8"/>
Nov 15 04:21:10 user nova-compute[74805]:     </interface>
Nov 15 04:21:10 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:21:10 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/console.log" append="off"/>
Nov 15 04:21:10 user nova-compute[74805]:     </serial>
Nov 15 04:21:10 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:21:10 user nova-compute[74805]:     <video>
Nov 15 04:21:10 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:21:10 user nova-compute[74805]:     </video>
Nov 15 04:21:10 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:21:10 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:21:10 user nova-compute[74805]:     </rng>
Nov 15 04:21:10 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:21:10 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:21:10 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:21:10 user nova-compute[74805]:     </memballoon>
Nov 15 04:21:10 user nova-compute[74805]:   </devices>
Nov 15 04:21:10 user nova-compute[74805]: </domain>
Nov 15 04:21:10 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:21:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Acquiring lock "45c66453-2f83-476b-a03b-6bdbb01d1849" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "45c66453-2f83-476b-a03b-6bdbb01d1849" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:10 user nova-compute[74805]: DEBUG nova.objects.instance [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lazy-loading 'flavor' on Instance uuid 45c66453-2f83-476b-a03b-6bdbb01d1849 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:21:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "45c66453-2f83-476b-a03b-6bdbb01d1849" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fc66c41-efcf-4014-bedb-3955aed09eba/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.compute.manager [req-bf43c861-43c8-4184-b16b-84c4f3792613 req-7c87a658-2258-414d-a6c8-03a627a73550 service nova] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Received event network-vif-plugged-da918dfb-1b07-46d1-80a1-d2dac424f931 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bf43c861-43c8-4184-b16b-84c4f3792613 req-7c87a658-2258-414d-a6c8-03a627a73550 service nova] Acquiring lock "b3800420-c3dd-4c51-a500-e405031e9a34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bf43c861-43c8-4184-b16b-84c4f3792613 req-7c87a658-2258-414d-a6c8-03a627a73550 service nova] Lock "b3800420-c3dd-4c51-a500-e405031e9a34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bf43c861-43c8-4184-b16b-84c4f3792613 req-7c87a658-2258-414d-a6c8-03a627a73550 service nova] Lock "b3800420-c3dd-4c51-a500-e405031e9a34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.compute.manager [req-bf43c861-43c8-4184-b16b-84c4f3792613 req-7c87a658-2258-414d-a6c8-03a627a73550 service nova] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] No waiting events found dispatching network-vif-plugged-da918dfb-1b07-46d1-80a1-d2dac424f931 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:21:11 user nova-compute[74805]: WARNING nova.compute.manager [req-bf43c861-43c8-4184-b16b-84c4f3792613 req-7c87a658-2258-414d-a6c8-03a627a73550 service nova] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Received unexpected event network-vif-plugged-da918dfb-1b07-46d1-80a1-d2dac424f931 for instance with vm_state building and task_state spawning.
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.compute.manager [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json" returned: 0 in 1.275s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Acquiring lock "45c66453-2f83-476b-a03b-6bdbb01d1849" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "45c66453-2f83-476b-a03b-6bdbb01d1849" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:11 user nova-compute[74805]: INFO nova.compute.manager [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Attaching volume 0953f066-9498-486a-9549-9bac2a67defe to /dev/vdb
Nov 15 04:21:11 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:21:11 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=7406MB free_disk=25.158538818359375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:11 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Instance spawned successfully.
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG os_brick.utils [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc7f06f-e396-470d-ad44-715517c7ec65]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cc01cc-1b6f-4b6c-922c-ad5f8c2e9de9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:11 user nova-compute[74805]: INFO nova.compute.manager [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Took 6.36 seconds to spawn the instance on the hypervisor.
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.compute.manager [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.objects.instance [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'trusted_certs' on Instance uuid e5004557-00fa-4824-9233-343c2261588d {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4118b410-366f-4ca1-84ce-072c5fc76365]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4877c182-d335-4f5a-88e1-d92f0d8400c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 2b1e540c-6226-445a-bd45-5b7b8807e2b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 0de78a8a-d66a-4703-a044-89c2f2006860 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance d63f3726-27df-455f-bda0-3ddca95b70d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance e5004557-00fa-4824-9233-343c2261588d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 51e0a627-f95e-4347-92a7-4a218413e884 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance e9d8b785-83eb-4e78-9ce5-c2da589ee4f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 45c66453-2f83-476b-a03b-6bdbb01d1849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 4fc66c41-efcf-4014-bedb-3955aed09eba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 13449149-a938-41ff-964f-16f96614bf3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance b3800420-c3dd-4c51-a500-e405031e9a34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.objects.base [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Object Instance<e5004557-00fa-4824-9233-343c2261588d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:21:11 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5db4aa8-c8e7-4dd5-8623-6adf27332366]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG os_brick.utils [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Updating existing volume attachment record: dc2033b7-e31f-40f6-974b-06cfd1fbed16 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:21:11 user nova-compute[74805]: INFO nova.compute.manager [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Took 7.33 seconds to build instance.
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.192s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-430e32e6-fe27-4a8f-81c9-47c5b5a33a4a tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "b3800420-c3dd-4c51-a500-e405031e9a34" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.485s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Cannot resize image /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.objects.instance [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'migration_context' on Instance uuid e5004557-00fa-4824-9233-343c2261588d {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.objects.base [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Object Instance<e5004557-00fa-4824-9233-343c2261588d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:17:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1146298859',display_name='tempest-AttachVolumeTestJSON-server-1146298859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1146298859',id=15,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcDGmoSL9n6BzrErqwQE4CV+qAoPf9h8eN4+5EDz04bsyjTTZ4Sit9JWjEhWommytKEKkL3SeMOXxTqRGtePTLcAr9xdzbbxAAil9ruYGUIPqhf/tGyrXvLN/cCYSgOhg==',key_name='tempest-keypair-2130424993',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:17:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='b7ba201faadb461882c823f9bd895af9',ramdisk_id='',reservation_id='r-g45utcp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-17326548',owner_user_name='tempest-AttachVolumeTestJSON-17326548-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:19:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50fe72dfe19f4c9792c4733f14b2d464',uuid=e5004557-00fa-4824-9233-343c2261588d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "address": "fa:16:3e:c8:0f:b4", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96104fe5-a8", "ovs_interfaceid": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Converting VIF {"id": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "address": "fa:16:3e:c8:0f:b4", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96104fe5-a8", "ovs_interfaceid": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:0f:b4,bridge_name='br-int',has_traffic_filtering=True,id=96104fe5-a8a5-445d-9c2a-6631a15e4349,network=Network(5b2973a0-643c-4d30-a6cd-3d1391fe2cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96104fe5-a8') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG os_vif [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:0f:b4,bridge_name='br-int',has_traffic_filtering=True,id=96104fe5-a8a5-445d-9c2a-6631a15e4349,network=Network(5b2973a0-643c-4d30-a6cd-3d1391fe2cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96104fe5-a8') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a34ea466-36fd-5891-908e-afd1b72cd053', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:21:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96104fe5-a8, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:21:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96104fe5-a8, col_values=(('qos', UUID('5b7a2702-3392-4baf-9b3f-ae6bd4b5a75a')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:21:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96104fe5-a8, col_values=(('external_ids', {'iface-id': '96104fe5-a8a5-445d-9c2a-6631a15e4349', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:0f:b4', 'vm-uuid': 'e5004557-00fa-4824-9233-343c2261588d'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:21:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:12 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:21:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:21:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:12 user nova-compute[74805]: INFO os_vif [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:0f:b4,bridge_name='br-int',has_traffic_filtering=True,id=96104fe5-a8a5-445d-9c2a-6631a15e4349,network=Network(5b2973a0-643c-4d30-a6cd-3d1391fe2cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96104fe5-a8')
Nov 15 04:21:12 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:21:12 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:21:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.720s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:13 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:21:13 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:21:13 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:21:13 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Rebuilding the list of instances to heal {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 04:21:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-2b1e540c-6226-445a-bd45-5b7b8807e2b9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:21:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-2b1e540c-6226-445a-bd45-5b7b8807e2b9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:21:13 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:21:13 user nova-compute[74805]: DEBUG nova.objects.instance [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lazy-loading 'info_cache' on Instance uuid 2b1e540c-6226-445a-bd45-5b7b8807e2b9 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:21:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:13 user nova-compute[74805]: DEBUG nova.compute.manager [req-ceb9c147-2faf-43e5-9a7c-811f8f467a6e req-cea5b981-f660-4d4c-9be9-8dda18b8bffc service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Received event network-vif-plugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:21:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ceb9c147-2faf-43e5-9a7c-811f8f467a6e req-cea5b981-f660-4d4c-9be9-8dda18b8bffc service nova] Acquiring lock "e5004557-00fa-4824-9233-343c2261588d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ceb9c147-2faf-43e5-9a7c-811f8f467a6e req-cea5b981-f660-4d4c-9be9-8dda18b8bffc service nova] Lock "e5004557-00fa-4824-9233-343c2261588d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ceb9c147-2faf-43e5-9a7c-811f8f467a6e req-cea5b981-f660-4d4c-9be9-8dda18b8bffc service nova] Lock "e5004557-00fa-4824-9233-343c2261588d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:13 user nova-compute[74805]: DEBUG nova.compute.manager [req-ceb9c147-2faf-43e5-9a7c-811f8f467a6e req-cea5b981-f660-4d4c-9be9-8dda18b8bffc service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] No waiting events found dispatching network-vif-plugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:21:13 user nova-compute[74805]: WARNING nova.compute.manager [req-ceb9c147-2faf-43e5-9a7c-811f8f467a6e req-cea5b981-f660-4d4c-9be9-8dda18b8bffc service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Received unexpected event network-vif-plugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 for instance with vm_state stopped and task_state powering-on.
Nov 15 04:21:13 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Updating instance_info_cache with network_info: [{"id": "29f069d7-6837-470c-a8b7-5cb6225bba4e", "address": "fa:16:3e:d3:55:85", "network": {"id": "d6c12b22-58d0-4d38-aa41-0e08de44bb3a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1369824742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dc7dbc597f4befb565dcff5a92db74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f069d7-68", "ovs_interfaceid": "29f069d7-6837-470c-a8b7-5cb6225bba4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:21:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-2b1e540c-6226-445a-bd45-5b7b8807e2b9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:21:13 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:21:13 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:21:13 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:21:13 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:21:13 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:14 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance e9d8b785-83eb-4e78-9ce5-c2da589ee4f7 is timed out.
Nov 15 04:21:14 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Successfully detached device sdc from instance e9d8b785-83eb-4e78-9ce5-c2da589ee4f7 from the live domain config.
Nov 15 04:21:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ESZawdMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:21:14 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:21:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.008s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7b0431-9c23-4b2c-976e-df0332f455f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:21:14 user nova-compute[74805]: No targets found.
Nov 15 04:21:14 user nova-compute[74805]: iSNS:
Nov 15 04:21:14 user nova-compute[74805]: No targets found.
Nov 15 04:21:14 user nova-compute[74805]: STATIC:
Nov 15 04:21:14 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4
Nov 15 04:21:14 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:21:14 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:21:14 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7
Nov 15 04:21:14 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:21:14 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:21:14 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683
Nov 15 04:21:14 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:21:14 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:21:14 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf
Nov 15 04:21:14 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:21:14 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:21:14 user nova-compute[74805]: FIRMWARE:
Nov 15 04:21:14 user nova-compute[74805]: No targets found.
Nov 15 04:21:14 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:21:14 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:21:14 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[614a7395-bc97-44ea-9638-0cb13c4012b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[374dd8a0-af04-4afb-8bbc-6ac7f20bb59b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:21:14 user nova-compute[74805]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:21:14 user nova-compute[74805]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 (non-flash)
Nov 15 04:21:14 user nova-compute[74805]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:21:14 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:21:14 user nova-compute[74805]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:21:14 user nova-compute[74805]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 (non-flash)
Nov 15 04:21:14 user nova-compute[74805]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:21:14 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c14cc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683'): ({'sde'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Removing single pathed devices sde {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7a4065-03b3-4b92-99a6-c9ecc8187c52]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a673239-d547-44bd-8c7c-9bea8dec6d1f]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Flushing IO for device /dev/sde {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7c96aa-08ed-478d-bd23-45651f17230a]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[634f20b8-23c8-4703-949d-715b9466419f]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] SCSI volumes sde have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6d33dc-1809-4040-8a4a-0911951d36bf]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:21:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:15 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e77ae1-8205-4926-a461-a99d1bc502bb]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:15 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683, portal: 172.16.0.220,3260]
Nov 15 04:21:15 user nova-compute[74805]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683, portal: 172.16.0.220,3260] successful.
Nov 15 04:21:15 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:21:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71279626-07d2-4779-bcd0-21df594b4683 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:15 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3942f9-0786-40c5-a53a-515bbb111c2f]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:15 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:21:15 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:21:15 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] <== disconnect_volume: return (332ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:21:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:21:15 user nova-compute[74805]: DEBUG nova.compute.manager [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:21:15 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: e5004557-00fa-4824-9233-343c2261588d] Instance rebooted successfully.
Nov 15 04:21:15 user nova-compute[74805]: DEBUG nova.compute.manager [None req-535cd0e8-e282-4402-ac83-1a5284d628d8 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:21:15 user nova-compute[74805]: DEBUG nova.compute.manager [req-c3184a4b-e683-428a-b424-cb1beed6f575 req-78d75d66-e2d5-4c5d-b77c-6fd38a71df9a service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Received event network-vif-plugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:21:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c3184a4b-e683-428a-b424-cb1beed6f575 req-78d75d66-e2d5-4c5d-b77c-6fd38a71df9a service nova] Acquiring lock "e5004557-00fa-4824-9233-343c2261588d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c3184a4b-e683-428a-b424-cb1beed6f575 req-78d75d66-e2d5-4c5d-b77c-6fd38a71df9a service nova] Lock "e5004557-00fa-4824-9233-343c2261588d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c3184a4b-e683-428a-b424-cb1beed6f575 req-78d75d66-e2d5-4c5d-b77c-6fd38a71df9a service nova] Lock "e5004557-00fa-4824-9233-343c2261588d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:15 user nova-compute[74805]: DEBUG nova.compute.manager [req-c3184a4b-e683-428a-b424-cb1beed6f575 req-78d75d66-e2d5-4c5d-b77c-6fd38a71df9a service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] No waiting events found dispatching network-vif-plugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:21:15 user nova-compute[74805]: WARNING nova.compute.manager [req-c3184a4b-e683-428a-b424-cb1beed6f575 req-78d75d66-e2d5-4c5d-b77c-6fd38a71df9a service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Received unexpected event network-vif-plugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 for instance with vm_state stopped and task_state powering-on.
Nov 15 04:21:15 user nova-compute[74805]: DEBUG nova.objects.instance [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lazy-loading 'flavor' on Instance uuid e9d8b785-83eb-4e78-9ce5-c2da589ee4f7 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8cabf47d-c81b-4288-93cc-b9ad4ce1ec5f tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.752s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "f329eddf-6a3b-4f05-9353-1b1e475ba420" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:21:16 user nova-compute[74805]: INFO nova.compute.claims [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Claim successful on node user
Nov 15 04:21:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fZINnbzk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:21:16 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:21:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:21:16 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:21:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:21:16 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff8aef8-cb99-4bab-8dc3-1fc9f0c3cd7e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:21:16 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a3e6bc-ae34-4c84-bc2a-78384222666b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe] added
Nov 15 04:21:16 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9770ef9-db00-473f-a93d-930969990d9b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e91d0ae-5b78-49d6-a62c-e4e0c4b11140]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fZINnbzk {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fZINnbzk" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[60900a85-71dd-4d82-b00c-f935ff6922af]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fZINnbzk'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.038s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[314364d3-27c2-4d82-af22-674eddda8c16]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.563s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dbc595-a2b6-4836-9783-8864f44376a4]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:21:16 user nova-compute[74805]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:21:16 user nova-compute[74805]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:21:16 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:21:16 user nova-compute[74805]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:21:16 user nova-compute[74805]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:21:16 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG nova.network.neutron [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c47d3e-f5cd-4964-9fa5-cf5a10306d12]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe, portal: 172.16.0.220,3260]
Nov 15 04:21:16 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe, portal: 172.16.0.220,3260] successful.
Nov 15 04:21:16 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:21:16 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7551cb93-8040-482a-89f3-ee140eb4bc42]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31a1d0e-3e39-4c1a-b661-e0b720bb7603]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:21:16 user nova-compute[74805]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:21:16 user nova-compute[74805]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:21:16 user nova-compute[74805]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe (non-flash)
Nov 15 04:21:16 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:21:16 user nova-compute[74805]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:21:16 user nova-compute[74805]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:21:16 user nova-compute[74805]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe (non-flash)
Nov 15 04:21:16 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG nova.policy [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eac59db39ba64883a64ab3133eaf1972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddde64bc93cc40f189e1d0b6d948cd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9432cc1e-8eaf-4806-80ad-4f59a4d3fd10]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:16 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: None {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:21:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:17 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:21:17 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:21:17 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Creating image(s)
Nov 15 04:21:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "/opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "/opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "/opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "7008c873508ef073ab013283f274b38cfa538726" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "7008c873508ef073ab013283f274b38cfa538726" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-de2908a8-4ce9-4f66-9bf3-ade5b9b2814c tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Acquiring lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-de2908a8-4ce9-4f66-9bf3-ade5b9b2814c tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-de2908a8-4ce9-4f66-9bf3-ade5b9b2814c tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Acquiring lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-de2908a8-4ce9-4f66-9bf3-ade5b9b2814c tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-de2908a8-4ce9-4f66-9bf3-ade5b9b2814c tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7008c873508ef073ab013283f274b38cfa538726.part --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:17 user nova-compute[74805]: INFO nova.compute.manager [None req-de2908a8-4ce9-4f66-9bf3-ade5b9b2814c tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Terminating instance
Nov 15 04:21:17 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:21:17 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fZINnbzk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:21:17 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:21:17 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '26530346263663138', 'path': '/dev/sde'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:21:17 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530346263663138', 'path': '/dev/sde'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:21:17 user nova-compute[74805]: DEBUG nova.compute.manager [None req-de2908a8-4ce9-4f66-9bf3-ade5b9b2814c tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:21:17 user nova-compute[74805]: DEBUG nova.objects.instance [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lazy-loading 'flavor' on Instance uuid 45c66453-2f83-476b-a03b-6bdbb01d1849 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:21:18 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:21:18 user nova-compute[74805]:   <source dev="/dev/sde"/>
Nov 15 04:21:18 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:21:18 user nova-compute[74805]:   <serial>0953f066-9498-486a-9549-9bac2a67defe</serial>
Nov 15 04:21:18 user nova-compute[74805]: </disk>
Nov 15 04:21:18 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7008c873508ef073ab013283f274b38cfa538726.part --force-share --output=json" returned: 0 in 0.208s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG nova.virt.images [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] 38334ba6-47ff-4a7a-a765-26a71d072dae was qcow2, converting to raw {{(pid=74805) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG nova.privsep.utils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74805) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7008c873508ef073ab013283f274b38cfa538726.part /opt/stack/data/nova/instances/_base/7008c873508ef073ab013283f274b38cfa538726.converted {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG nova.network.neutron [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Successfully created port: a8a0db92-660b-4fc3-b68c-9e6a37aa85db {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG nova.compute.manager [req-b5071828-957f-4383-92eb-c18eb745b2a4 req-6722f4ea-8d8c-41b0-943e-c223513ba4a1 service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Received event network-vif-unplugged-111f5423-0048-423b-8c88-c90bee78aca7 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5071828-957f-4383-92eb-c18eb745b2a4 req-6722f4ea-8d8c-41b0-943e-c223513ba4a1 service nova] Acquiring lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5071828-957f-4383-92eb-c18eb745b2a4 req-6722f4ea-8d8c-41b0-943e-c223513ba4a1 service nova] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b5071828-957f-4383-92eb-c18eb745b2a4 req-6722f4ea-8d8c-41b0-943e-c223513ba4a1 service nova] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG nova.compute.manager [req-b5071828-957f-4383-92eb-c18eb745b2a4 req-6722f4ea-8d8c-41b0-943e-c223513ba4a1 service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] No waiting events found dispatching network-vif-unplugged-111f5423-0048-423b-8c88-c90bee78aca7 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG nova.compute.manager [req-b5071828-957f-4383-92eb-c18eb745b2a4 req-6722f4ea-8d8c-41b0-943e-c223513ba4a1 service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Received event network-vif-unplugged-111f5423-0048-423b-8c88-c90bee78aca7 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7008c873508ef073ab013283f274b38cfa538726.part /opt/stack/data/nova/instances/_base/7008c873508ef073ab013283f274b38cfa538726.converted" returned: 0 in 0.258s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7008c873508ef073ab013283f274b38cfa538726.converted --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] No VIF found with MAC fa:16:3e:9c:8d:32, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7008c873508ef073ab013283f274b38cfa538726.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "7008c873508ef073ab013283f274b38cfa538726" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.529s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7008c873508ef073ab013283f274b38cfa538726 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c8d702b-3952-4480-81ae-fde7c577dbcb tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "45c66453-2f83-476b-a03b-6bdbb01d1849" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.365s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7008c873508ef073ab013283f274b38cfa538726 --force-share --output=json" returned: 0 in 0.183s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "7008c873508ef073ab013283f274b38cfa538726" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "7008c873508ef073ab013283f274b38cfa538726" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7008c873508ef073ab013283f274b38cfa538726 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:18 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Instance destroyed successfully.
Nov 15 04:21:18 user nova-compute[74805]: DEBUG nova.objects.instance [None req-de2908a8-4ce9-4f66-9bf3-ade5b9b2814c tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lazy-loading 'resources' on Instance uuid e9d8b785-83eb-4e78-9ce5-c2da589ee4f7 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-de2908a8-4ce9-4f66-9bf3-ade5b9b2814c tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:18:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-915287280',display_name='tempest-AttachSCSIVolumeTestJSON-server-915287280',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-915287280',id=18,image_ref='195bcb67-cd88-4ded-b158-0e24352e08be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFD5i1i1yveyxpiaX8PksNVlp91pZygn4IabGoQOLFVbvXlvKg0XH9949bTmFOt0dsZkp9KGSaMX4JrbOizNjyGxIBonv523/tF/YdN4ZBU306UTnfJNCa4fbAUBiQb3fg==',key_name='tempest-keypair-242428025',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:19:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d4585c1a0b4141ff943c8f470c2487fb',ramdisk_id='',reservation_id='r-sax65km6',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='195bcb67-cd88-4ded-b158-0e24352e08be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1335683627',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1335683627-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:19:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55561d62cd3e48b9823d0aa9f6f84510',uuid=e9d8b785-83eb-4e78-9ce5-c2da589ee4f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "111f5423-0048-423b-8c88-c90bee78aca7", "address": "fa:16:3e:3b:a8:eb", "network": {"id": "0e964c0c-5222-4076-add0-1a305e30ab63", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1931209247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4585c1a0b4141ff943c8f470c2487fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f5423-00", "ovs_interfaceid": "111f5423-0048-423b-8c88-c90bee78aca7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-de2908a8-4ce9-4f66-9bf3-ade5b9b2814c tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Converting VIF {"id": "111f5423-0048-423b-8c88-c90bee78aca7", "address": "fa:16:3e:3b:a8:eb", "network": {"id": "0e964c0c-5222-4076-add0-1a305e30ab63", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1931209247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4585c1a0b4141ff943c8f470c2487fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f5423-00", "ovs_interfaceid": "111f5423-0048-423b-8c88-c90bee78aca7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-de2908a8-4ce9-4f66-9bf3-ade5b9b2814c tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:a8:eb,bridge_name='br-int',has_traffic_filtering=True,id=111f5423-0048-423b-8c88-c90bee78aca7,network=Network(0e964c0c-5222-4076-add0-1a305e30ab63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap111f5423-00') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG os_vif [None req-de2908a8-4ce9-4f66-9bf3-ade5b9b2814c tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:a8:eb,bridge_name='br-int',has_traffic_filtering=True,id=111f5423-0048-423b-8c88-c90bee78aca7,network=Network(0e964c0c-5222-4076-add0-1a305e30ab63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap111f5423-00') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap111f5423-00, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c86deab2-ebbf-4ecd-85e6-182dc80b3f1a) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:21:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:21:18 user nova-compute[74805]: INFO os_vif [None req-de2908a8-4ce9-4f66-9bf3-ade5b9b2814c tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:a8:eb,bridge_name='br-int',has_traffic_filtering=True,id=111f5423-0048-423b-8c88-c90bee78aca7,network=Network(0e964c0c-5222-4076-add0-1a305e30ab63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap111f5423-00')
Nov 15 04:21:18 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-de2908a8-4ce9-4f66-9bf3-ade5b9b2814c tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Deleting instance files /opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7_del
Nov 15 04:21:18 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-de2908a8-4ce9-4f66-9bf3-ade5b9b2814c tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Deletion of /opt/stack/data/nova/instances/e9d8b785-83eb-4e78-9ce5-c2da589ee4f7_del complete
Nov 15 04:21:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7008c873508ef073ab013283f274b38cfa538726 --force-share --output=json" returned: 0 in 0.264s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7008c873508ef073ab013283f274b38cfa538726,backing_fmt=raw /opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.network.neutron [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Successfully updated port: a8a0db92-660b-4fc3-b68c-9e6a37aa85db {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7008c873508ef073ab013283f274b38cfa538726,backing_fmt=raw /opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420/disk 1073741824" returned: 0 in 0.085s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "7008c873508ef073ab013283f274b38cfa538726" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.354s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7008c873508ef073ab013283f274b38cfa538726 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "refresh_cache-f329eddf-6a3b-4f05-9353-1b1e475ba420" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquired lock "refresh_cache-f329eddf-6a3b-4f05-9353-1b1e475ba420" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.network.neutron [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.compute.manager [req-beef537a-0c8b-4fad-86bc-ceaef31cc616 req-17b021a9-8498-4dbf-a539-1ced2f94924a service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Received event network-changed-a8a0db92-660b-4fc3-b68c-9e6a37aa85db {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.compute.manager [req-beef537a-0c8b-4fad-86bc-ceaef31cc616 req-17b021a9-8498-4dbf-a539-1ced2f94924a service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Refreshing instance network info cache due to event network-changed-a8a0db92-660b-4fc3-b68c-9e6a37aa85db. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-beef537a-0c8b-4fad-86bc-ceaef31cc616 req-17b021a9-8498-4dbf-a539-1ced2f94924a service nova] Acquiring lock "refresh_cache-f329eddf-6a3b-4f05-9353-1b1e475ba420" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:21:19 user nova-compute[74805]: INFO nova.compute.manager [None req-de2908a8-4ce9-4f66-9bf3-ade5b9b2814c tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 15 04:21:19 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-de2908a8-4ce9-4f66-9bf3-ade5b9b2814c tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.network.neutron [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7008c873508ef073ab013283f274b38cfa538726 --force-share --output=json" returned: 0 in 0.183s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Cannot resize image /opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Ensure instance console log exists: /opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Acquiring lock "45c66453-2f83-476b-a03b-6bdbb01d1849" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "45c66453-2f83-476b-a03b-6bdbb01d1849" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.network.neutron [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Updating instance_info_cache with network_info: [{"id": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "address": "fa:16:3e:44:06:9f", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a0db92-66", "ovs_interfaceid": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:21:19 user nova-compute[74805]: INFO nova.compute.manager [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Detaching volume 0953f066-9498-486a-9549-9bac2a67defe
Nov 15 04:21:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Releasing lock "refresh_cache-f329eddf-6a3b-4f05-9353-1b1e475ba420" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Instance network_info: |[{"id": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "address": "fa:16:3e:44:06:9f", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a0db92-66", "ovs_interfaceid": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-beef537a-0c8b-4fad-86bc-ceaef31cc616 req-17b021a9-8498-4dbf-a539-1ced2f94924a service nova] Acquired lock "refresh_cache-f329eddf-6a3b-4f05-9353-1b1e475ba420" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.network.neutron [req-beef537a-0c8b-4fad-86bc-ceaef31cc616 req-17b021a9-8498-4dbf-a539-1ced2f94924a service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Refreshing network info cache for port a8a0db92-660b-4fc3-b68c-9e6a37aa85db {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Start _get_guest_xml network_info=[{"id": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "address": "fa:16:3e:44:06:9f", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a0db92-66", "ovs_interfaceid": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:21:13Z,direct_url=<?>,disk_format='qcow2',id=38334ba6-47ff-4a7a-a765-26a71d072dae,min_disk=0,min_ram=0,name='tempest-scenario-img--501914770',owner='ddde64bc93cc40f189e1d0b6d948cd0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:21:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': '38334ba6-47ff-4a7a-a765-26a71d072dae'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:19 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:21:19 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:21:13Z,direct_url=<?>,disk_format='qcow2',id=38334ba6-47ff-4a7a-a765-26a71d072dae,min_disk=0,min_ram=0,name='tempest-scenario-img--501914770',owner='ddde64bc93cc40f189e1d0b6d948cd0a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:21:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:21:19 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2023098510',display_name='tempest-TestMinimumBasicScenario-server-2023098510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2023098510',id=23,image_ref='38334ba6-47ff-4a7a-a765-26a71d072dae',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZK5HyIPCfmmC2fyBThsopmpypMefbIERGm03Bk45iT3dPJEBS3XRAlHU1kIW47VvaeablEsgUPPMWy/COwPg/1l9Pfwo6SaCaSs2oJMjmP45+Lmgk6Y727q/ux4EfcZw==',key_name='tempest-TestMinimumBasicScenario-868758740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ddde64bc93cc40f189e1d0b6d948cd0a',ramdisk_id='',reservation_id='r-jvhaw2dm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='38334ba6-47ff-4a7a-a765-26a71d072dae',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-342422642',owner_user_name='tempest-TestMinimumBasicScenario-342422642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:21:17Z,user_data=None,user_id='eac59db39ba64883a64ab3133eaf1972',uuid=f329eddf-6a3b-4f05-9353-1b1e475ba420,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "address": "fa:16:3e:44:06:9f", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a0db92-66", "ovs_interfaceid": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Converting VIF {"id": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "address": "fa:16:3e:44:06:9f", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a0db92-66", "ovs_interfaceid": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:06:9f,bridge_name='br-int',has_traffic_filtering=True,id=a8a0db92-660b-4fc3-b68c-9e6a37aa85db,network=Network(8408f959-0c0d-4a22-afa0-b51304c254ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a0db92-66') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG nova.objects.instance [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lazy-loading 'pci_devices' on Instance uuid f329eddf-6a3b-4f05-9353-1b1e475ba420 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:21:20 user nova-compute[74805]: INFO nova.virt.block_device [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Attempting to driver detach volume 0953f066-9498-486a-9549-9bac2a67defe from mountpoint /dev/vdb
Nov 15 04:21:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:21:20 user nova-compute[74805]:   <uuid>f329eddf-6a3b-4f05-9353-1b1e475ba420</uuid>
Nov 15 04:21:20 user nova-compute[74805]:   <name>instance-00000017</name>
Nov 15 04:21:20 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:21:20 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:21:20 user nova-compute[74805]:   <metadata>
Nov 15 04:21:20 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:21:20 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:21:20 user nova-compute[74805]:       <nova:name>tempest-TestMinimumBasicScenario-server-2023098510</nova:name>
Nov 15 04:21:20 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:21:19</nova:creationTime>
Nov 15 04:21:20 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:21:20 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:21:20 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:21:20 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:21:20 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:21:20 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:21:20 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:21:20 user nova-compute[74805]:       <nova:owner>
Nov 15 04:21:20 user nova-compute[74805]:         <nova:user uuid="eac59db39ba64883a64ab3133eaf1972">tempest-TestMinimumBasicScenario-342422642-project-member</nova:user>
Nov 15 04:21:20 user nova-compute[74805]:         <nova:project uuid="ddde64bc93cc40f189e1d0b6d948cd0a">tempest-TestMinimumBasicScenario-342422642</nova:project>
Nov 15 04:21:20 user nova-compute[74805]:       </nova:owner>
Nov 15 04:21:20 user nova-compute[74805]:       <nova:root type="image" uuid="38334ba6-47ff-4a7a-a765-26a71d072dae"/>
Nov 15 04:21:20 user nova-compute[74805]:       <nova:ports>
Nov 15 04:21:20 user nova-compute[74805]:         <nova:port uuid="a8a0db92-660b-4fc3-b68c-9e6a37aa85db">
Nov 15 04:21:20 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 04:21:20 user nova-compute[74805]:         </nova:port>
Nov 15 04:21:20 user nova-compute[74805]:       </nova:ports>
Nov 15 04:21:20 user nova-compute[74805]:     </nova:instance>
Nov 15 04:21:20 user nova-compute[74805]:   </metadata>
Nov 15 04:21:20 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:21:20 user nova-compute[74805]:     <system>
Nov 15 04:21:20 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:21:20 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:21:20 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:21:20 user nova-compute[74805]:       <entry name="serial">f329eddf-6a3b-4f05-9353-1b1e475ba420</entry>
Nov 15 04:21:20 user nova-compute[74805]:       <entry name="uuid">f329eddf-6a3b-4f05-9353-1b1e475ba420</entry>
Nov 15 04:21:20 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:21:20 user nova-compute[74805]:     </system>
Nov 15 04:21:20 user nova-compute[74805]:   </sysinfo>
Nov 15 04:21:20 user nova-compute[74805]:   <os>
Nov 15 04:21:20 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:21:20 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:21:20 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:21:20 user nova-compute[74805]:   </os>
Nov 15 04:21:20 user nova-compute[74805]:   <features>
Nov 15 04:21:20 user nova-compute[74805]:     <acpi/>
Nov 15 04:21:20 user nova-compute[74805]:     <apic/>
Nov 15 04:21:20 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:21:20 user nova-compute[74805]:   </features>
Nov 15 04:21:20 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:21:20 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:21:20 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:21:20 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:21:20 user nova-compute[74805]:   </clock>
Nov 15 04:21:20 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:21:20 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:21:20 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:21:20 user nova-compute[74805]:   </cpu>
Nov 15 04:21:20 user nova-compute[74805]:   <devices>
Nov 15 04:21:20 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:21:20 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:21:20 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420/disk"/>
Nov 15 04:21:20 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:21:20 user nova-compute[74805]:     </disk>
Nov 15 04:21:20 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:21:20 user nova-compute[74805]:       <mac address="fa:16:3e:44:06:9f"/>
Nov 15 04:21:20 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:21:20 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:21:20 user nova-compute[74805]:       <target dev="tapa8a0db92-66"/>
Nov 15 04:21:20 user nova-compute[74805]:     </interface>
Nov 15 04:21:20 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:21:20 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420/console.log" append="off"/>
Nov 15 04:21:20 user nova-compute[74805]:     </serial>
Nov 15 04:21:20 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:21:20 user nova-compute[74805]:     <video>
Nov 15 04:21:20 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:21:20 user nova-compute[74805]:     </video>
Nov 15 04:21:20 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:21:20 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:21:20 user nova-compute[74805]:     </rng>
Nov 15 04:21:20 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:21:20 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:21:20 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:21:20 user nova-compute[74805]:     </memballoon>
Nov 15 04:21:20 user nova-compute[74805]:   </devices>
Nov 15 04:21:20 user nova-compute[74805]: </domain>
Nov 15 04:21:20 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2023098510',display_name='tempest-TestMinimumBasicScenario-server-2023098510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2023098510',id=23,image_ref='38334ba6-47ff-4a7a-a765-26a71d072dae',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZK5HyIPCfmmC2fyBThsopmpypMefbIERGm03Bk45iT3dPJEBS3XRAlHU1kIW47VvaeablEsgUPPMWy/COwPg/1l9Pfwo6SaCaSs2oJMjmP45+Lmgk6Y727q/ux4EfcZw==',key_name='tempest-TestMinimumBasicScenario-868758740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ddde64bc93cc40f189e1d0b6d948cd0a',ramdisk_id='',reservation_id='r-jvhaw2dm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='38334ba6-47ff-4a7a-a765-26a71d072dae',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-342422642',owner_user_name='tempest-TestMinimumBasicScenario-342422642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:21:17Z,user_data=None,user_id='eac59db39ba64883a64ab3133eaf1972',uuid=f329eddf-6a3b-4f05-9353-1b1e475ba420,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "address": "fa:16:3e:44:06:9f", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a0db92-66", "ovs_interfaceid": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Converting VIF {"id": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "address": "fa:16:3e:44:06:9f", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a0db92-66", "ovs_interfaceid": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:06:9f,bridge_name='br-int',has_traffic_filtering=True,id=a8a0db92-660b-4fc3-b68c-9e6a37aa85db,network=Network(8408f959-0c0d-4a22-afa0-b51304c254ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a0db92-66') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG os_vif [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:06:9f,bridge_name='br-int',has_traffic_filtering=True,id=a8a0db92-660b-4fc3-b68c-9e6a37aa85db,network=Network(8408f959-0c0d-4a22-afa0-b51304c254ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a0db92-66') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '292796a0-c45f-56d3-be0c-b8714002b68a', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8a0db92-66, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8a0db92-66, col_values=(('qos', UUID('493de683-65ab-4577-a387-4867bca88818')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8a0db92-66, col_values=(('external_ids', {'iface-id': 'a8a0db92-660b-4fc3-b68c-9e6a37aa85db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:06:9f', 'vm-uuid': 'f329eddf-6a3b-4f05-9353-1b1e475ba420'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:20 user nova-compute[74805]: INFO os_vif [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:06:9f,bridge_name='br-int',has_traffic_filtering=True,id=a8a0db92-660b-4fc3-b68c-9e6a37aa85db,network=Network(8408f959-0c0d-4a22-afa0-b51304c254ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a0db92-66')
Nov 15 04:21:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Attempting to detach device vdb from instance 45c66453-2f83-476b-a03b-6bdbb01d1849 from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:21:20 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:21:20 user nova-compute[74805]:   <source dev="/dev/sde"/>
Nov 15 04:21:20 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:21:20 user nova-compute[74805]:   <serial>0953f066-9498-486a-9549-9bac2a67defe</serial>
Nov 15 04:21:20 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:21:20 user nova-compute[74805]: </disk>
Nov 15 04:21:20 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:21:20 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Successfully detached device vdb from instance 45c66453-2f83-476b-a03b-6bdbb01d1849 from the persistent domain config.
Nov 15 04:21:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 45c66453-2f83-476b-a03b-6bdbb01d1849 from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:21:20 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:21:20 user nova-compute[74805]:   <source dev="/dev/sde"/>
Nov 15 04:21:20 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:21:20 user nova-compute[74805]:   <serial>0953f066-9498-486a-9549-9bac2a67defe</serial>
Nov 15 04:21:20 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:21:20 user nova-compute[74805]: </disk>
Nov 15 04:21:20 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] No VIF found with MAC fa:16:3e:44:06:9f, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cf020394-8235-464a-95c6-813839c2007a tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Acquiring lock "0de78a8a-d66a-4703-a044-89c2f2006860" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cf020394-8235-464a-95c6-813839c2007a tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "0de78a8a-d66a-4703-a044-89c2f2006860" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cf020394-8235-464a-95c6-813839c2007a tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Acquiring lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cf020394-8235-464a-95c6-813839c2007a tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cf020394-8235-464a-95c6-813839c2007a tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:20 user nova-compute[74805]: INFO nova.compute.manager [None req-cf020394-8235-464a-95c6-813839c2007a tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Terminating instance
Nov 15 04:21:20 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cf020394-8235-464a-95c6-813839c2007a tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG nova.compute.manager [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Received event network-vif-plugged-111f5423-0048-423b-8c88-c90bee78aca7 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] Acquiring lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG nova.compute.manager [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] No waiting events found dispatching network-vif-plugged-111f5423-0048-423b-8c88-c90bee78aca7 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:21:20 user nova-compute[74805]: WARNING nova.compute.manager [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Received unexpected event network-vif-plugged-111f5423-0048-423b-8c88-c90bee78aca7 for instance with vm_state active and task_state deleting.
Nov 15 04:21:20 user nova-compute[74805]: DEBUG nova.compute.manager [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Received event network-vif-plugged-111f5423-0048-423b-8c88-c90bee78aca7 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] Acquiring lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG nova.compute.manager [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] No waiting events found dispatching network-vif-plugged-111f5423-0048-423b-8c88-c90bee78aca7 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:21:20 user nova-compute[74805]: WARNING nova.compute.manager [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Received unexpected event network-vif-plugged-111f5423-0048-423b-8c88-c90bee78aca7 for instance with vm_state active and task_state deleting.
Nov 15 04:21:20 user nova-compute[74805]: DEBUG nova.compute.manager [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Received event network-vif-plugged-111f5423-0048-423b-8c88-c90bee78aca7 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] Acquiring lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG nova.compute.manager [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] No waiting events found dispatching network-vif-plugged-111f5423-0048-423b-8c88-c90bee78aca7 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:21:20 user nova-compute[74805]: WARNING nova.compute.manager [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Received unexpected event network-vif-plugged-111f5423-0048-423b-8c88-c90bee78aca7 for instance with vm_state active and task_state deleting.
Nov 15 04:21:20 user nova-compute[74805]: DEBUG nova.compute.manager [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Received event network-vif-unplugged-111f5423-0048-423b-8c88-c90bee78aca7 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] Acquiring lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG nova.compute.manager [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] No waiting events found dispatching network-vif-unplugged-111f5423-0048-423b-8c88-c90bee78aca7 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG nova.compute.manager [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Received event network-vif-unplugged-111f5423-0048-423b-8c88-c90bee78aca7 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG nova.compute.manager [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Received event network-vif-plugged-111f5423-0048-423b-8c88-c90bee78aca7 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] Acquiring lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG nova.compute.manager [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] No waiting events found dispatching network-vif-plugged-111f5423-0048-423b-8c88-c90bee78aca7 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:21:20 user nova-compute[74805]: WARNING nova.compute.manager [req-5c1c1c0a-c128-4774-9770-c430b28dfa9d req-6c10bd30-6cbc-416d-8f28-c1cfb0e50de8 service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Received unexpected event network-vif-plugged-111f5423-0048-423b-8c88-c90bee78aca7 for instance with vm_state active and task_state deleting.
Nov 15 04:21:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:21:20 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Took 1.29 seconds to deallocate network for instance.
Nov 15 04:21:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-de2908a8-4ce9-4f66-9bf3-ade5b9b2814c tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-de2908a8-4ce9-4f66-9bf3-ade5b9b2814c tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG nova.network.neutron [req-beef537a-0c8b-4fad-86bc-ceaef31cc616 req-17b021a9-8498-4dbf-a539-1ced2f94924a service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Updated VIF entry in instance network info cache for port a8a0db92-660b-4fc3-b68c-9e6a37aa85db. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG nova.network.neutron [req-beef537a-0c8b-4fad-86bc-ceaef31cc616 req-17b021a9-8498-4dbf-a539-1ced2f94924a service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Updating instance_info_cache with network_info: [{"id": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "address": "fa:16:3e:44:06:9f", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a0db92-66", "ovs_interfaceid": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:21:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-beef537a-0c8b-4fad-86bc-ceaef31cc616 req-17b021a9-8498-4dbf-a539-1ced2f94924a service nova] Releasing lock "refresh_cache-f329eddf-6a3b-4f05-9353-1b1e475ba420" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:21:21 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-de2908a8-4ce9-4f66-9bf3-ade5b9b2814c tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:21:21 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-de2908a8-4ce9-4f66-9bf3-ade5b9b2814c tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:21:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-de2908a8-4ce9-4f66-9bf3-ade5b9b2814c tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.499s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:21 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-de2908a8-4ce9-4f66-9bf3-ade5b9b2814c tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Deleted allocations for instance e9d8b785-83eb-4e78-9ce5-c2da589ee4f7
Nov 15 04:21:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 45c66453-2f83-476b-a03b-6bdbb01d1849 {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:21:21 user nova-compute[74805]: DEBUG nova.compute.manager [req-d67e776a-e8a8-4a97-b1a8-2eba79b4ddae req-4476fdfe-5544-4519-ae60-8e1ee156151d service nova] [instance: e9d8b785-83eb-4e78-9ce5-c2da589ee4f7] Received event network-vif-deleted-111f5423-0048-423b-8c88-c90bee78aca7 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:21:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-de2908a8-4ce9-4f66-9bf3-ade5b9b2814c tempest-AttachSCSIVolumeTestJSON-1335683627 tempest-AttachSCSIVolumeTestJSON-1335683627-project-member] Lock "e9d8b785-83eb-4e78-9ce5-c2da589ee4f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.110s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:21 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Instance destroyed successfully.
Nov 15 04:21:21 user nova-compute[74805]: DEBUG nova.objects.instance [None req-cf020394-8235-464a-95c6-813839c2007a tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lazy-loading 'resources' on Instance uuid 0de78a8a-d66a-4703-a044-89c2f2006860 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:21:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-cf020394-8235-464a-95c6-813839c2007a tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-245989285',display_name='tempest-ServerStableDeviceRescueTest-server-245989285',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-245989285',id=5,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE2W8hpxsH+Gx6uZHNfH48qELq4dB6yQZcCESM+knrhVIpfQxBPyOS7IitFzr8Zvm+MZl66RxoPJJ44CmxBQaN/PxK9MK0YRtI4voa1XFvjw53ch4lAnIci9EzvGLMftA==',key_name='tempest-keypair-1768731695',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:18:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc936c67de2046ff82115c5ebdb8c844',ramdisk_id='',reservation_id='r-ztm7khyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1093147709',owner_user_name='tempest-ServerStableDeviceRescueTest-1093147709-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:20:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2cddbf10a1342f3a29972aecfb8f67d',uuid=0de78a8a-d66a-4703-a044-89c2f2006860,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f426f7d-ce70-41ba-affa-652a4f62a571", "address": "fa:16:3e:74:98:ab", "network": {"id": "e6f9095e-b477-4654-9fb7-7322e7bb3b9d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1108878484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc936c67de2046ff82115c5ebdb8c844", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f426f7d-ce", "ovs_interfaceid": "9f426f7d-ce70-41ba-affa-652a4f62a571", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:21:21 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-cf020394-8235-464a-95c6-813839c2007a tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Converting VIF {"id": "9f426f7d-ce70-41ba-affa-652a4f62a571", "address": "fa:16:3e:74:98:ab", "network": {"id": "e6f9095e-b477-4654-9fb7-7322e7bb3b9d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1108878484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc936c67de2046ff82115c5ebdb8c844", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f426f7d-ce", "ovs_interfaceid": "9f426f7d-ce70-41ba-affa-652a4f62a571", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:21:21 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-cf020394-8235-464a-95c6-813839c2007a tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:98:ab,bridge_name='br-int',has_traffic_filtering=True,id=9f426f7d-ce70-41ba-affa-652a4f62a571,network=Network(e6f9095e-b477-4654-9fb7-7322e7bb3b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f426f7d-ce') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:21:21 user nova-compute[74805]: DEBUG os_vif [None req-cf020394-8235-464a-95c6-813839c2007a tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:98:ab,bridge_name='br-int',has_traffic_filtering=True,id=9f426f7d-ce70-41ba-affa-652a4f62a571,network=Network(e6f9095e-b477-4654-9fb7-7322e7bb3b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f426f7d-ce') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:21:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f426f7d-ce, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:21:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:21:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cb1c0377-c065-4cec-a2ea-ff9192f22f52) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:21:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:21:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:21 user nova-compute[74805]: INFO os_vif [None req-cf020394-8235-464a-95c6-813839c2007a tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:98:ab,bridge_name='br-int',has_traffic_filtering=True,id=9f426f7d-ce70-41ba-affa-652a4f62a571,network=Network(e6f9095e-b477-4654-9fb7-7322e7bb3b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f426f7d-ce')
Nov 15 04:21:21 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-cf020394-8235-464a-95c6-813839c2007a tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Deleting instance files /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860_del
Nov 15 04:21:21 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-cf020394-8235-464a-95c6-813839c2007a tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Deletion of /opt/stack/data/nova/instances/0de78a8a-d66a-4703-a044-89c2f2006860_del complete
Nov 15 04:21:21 user nova-compute[74805]: INFO nova.compute.manager [None req-cf020394-8235-464a-95c6-813839c2007a tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Took 1.43 seconds to destroy the instance on the hypervisor.
Nov 15 04:21:21 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-cf020394-8235-464a-95c6-813839c2007a tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:21:21 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:21:21 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:21:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-46adc939-9954-4098-8def-23d3c13a0e42 req-8287e945-8ae3-4f73-940b-d60e9b93bde2 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Received event network-vif-unplugged-9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:21:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-46adc939-9954-4098-8def-23d3c13a0e42 req-8287e945-8ae3-4f73-940b-d60e9b93bde2 service nova] Acquiring lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-46adc939-9954-4098-8def-23d3c13a0e42 req-8287e945-8ae3-4f73-940b-d60e9b93bde2 service nova] Lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-46adc939-9954-4098-8def-23d3c13a0e42 req-8287e945-8ae3-4f73-940b-d60e9b93bde2 service nova] Lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-46adc939-9954-4098-8def-23d3c13a0e42 req-8287e945-8ae3-4f73-940b-d60e9b93bde2 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] No waiting events found dispatching network-vif-unplugged-9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:21:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-46adc939-9954-4098-8def-23d3c13a0e42 req-8287e945-8ae3-4f73-940b-d60e9b93bde2 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Received event network-vif-unplugged-9f426f7d-ce70-41ba-affa-652a4f62a571 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:21:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-46adc939-9954-4098-8def-23d3c13a0e42 req-8287e945-8ae3-4f73-940b-d60e9b93bde2 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Received event network-vif-plugged-9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:21:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-46adc939-9954-4098-8def-23d3c13a0e42 req-8287e945-8ae3-4f73-940b-d60e9b93bde2 service nova] Acquiring lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-46adc939-9954-4098-8def-23d3c13a0e42 req-8287e945-8ae3-4f73-940b-d60e9b93bde2 service nova] Lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-46adc939-9954-4098-8def-23d3c13a0e42 req-8287e945-8ae3-4f73-940b-d60e9b93bde2 service nova] Lock "0de78a8a-d66a-4703-a044-89c2f2006860-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-46adc939-9954-4098-8def-23d3c13a0e42 req-8287e945-8ae3-4f73-940b-d60e9b93bde2 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] No waiting events found dispatching network-vif-plugged-9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:21:22 user nova-compute[74805]: WARNING nova.compute.manager [req-46adc939-9954-4098-8def-23d3c13a0e42 req-8287e945-8ae3-4f73-940b-d60e9b93bde2 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Received unexpected event network-vif-plugged-9f426f7d-ce70-41ba-affa-652a4f62a571 for instance with vm_state active and task_state deleting.
Nov 15 04:21:22 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:21:22 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Took 0.90 seconds to deallocate network for instance.
Nov 15 04:21:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cf020394-8235-464a-95c6-813839c2007a tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cf020394-8235-464a-95c6-813839c2007a tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:23 user nova-compute[74805]: DEBUG nova.compute.manager [req-a1140ba8-0f5c-4f85-be05-696b70efee27 req-f9290796-8917-4860-9b57-cedffc08dd86 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Received event network-vif-plugged-a8a0db92-660b-4fc3-b68c-9e6a37aa85db {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:21:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-a1140ba8-0f5c-4f85-be05-696b70efee27 req-f9290796-8917-4860-9b57-cedffc08dd86 service nova] Acquiring lock "f329eddf-6a3b-4f05-9353-1b1e475ba420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-a1140ba8-0f5c-4f85-be05-696b70efee27 req-f9290796-8917-4860-9b57-cedffc08dd86 service nova] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-a1140ba8-0f5c-4f85-be05-696b70efee27 req-f9290796-8917-4860-9b57-cedffc08dd86 service nova] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:23 user nova-compute[74805]: DEBUG nova.compute.manager [req-a1140ba8-0f5c-4f85-be05-696b70efee27 req-f9290796-8917-4860-9b57-cedffc08dd86 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] No waiting events found dispatching network-vif-plugged-a8a0db92-660b-4fc3-b68c-9e6a37aa85db {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:21:23 user nova-compute[74805]: WARNING nova.compute.manager [req-a1140ba8-0f5c-4f85-be05-696b70efee27 req-f9290796-8917-4860-9b57-cedffc08dd86 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Received unexpected event network-vif-plugged-a8a0db92-660b-4fc3-b68c-9e6a37aa85db for instance with vm_state building and task_state spawning.
Nov 15 04:21:23 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cf020394-8235-464a-95c6-813839c2007a tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:21:23 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cf020394-8235-464a-95c6-813839c2007a tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:21:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cf020394-8235-464a-95c6-813839c2007a tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.859s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:23 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-cf020394-8235-464a-95c6-813839c2007a tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Deleted allocations for instance 0de78a8a-d66a-4703-a044-89c2f2006860
Nov 15 04:21:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cf020394-8235-464a-95c6-813839c2007a tempest-ServerStableDeviceRescueTest-1093147709 tempest-ServerStableDeviceRescueTest-1093147709-project-member] Lock "0de78a8a-d66a-4703-a044-89c2f2006860" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.395s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-2cbd4e9b-d4fa-4ee5-bace-266fa474ac03 req-1764cb96-cf5b-4cd8-a726-a19d95ff2e62 service nova] [instance: 0de78a8a-d66a-4703-a044-89c2f2006860] Received event network-vif-deleted-9f426f7d-ce70-41ba-affa-652a4f62a571 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:21:24 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:21:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:21:24 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Instance spawned successfully.
Nov 15 04:21:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:21:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:21:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:21:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:21:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:21:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:21:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:21:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:24 user nova-compute[74805]: INFO nova.compute.manager [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Took 7.91 seconds to spawn the instance on the hypervisor.
Nov 15 04:21:24 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:21:25 user nova-compute[74805]: INFO nova.compute.manager [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Took 8.86 seconds to build instance.
Nov 15 04:21:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0c5bce5d-b69e-4255-aa0a-0251e1f223d6 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.992s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:25 user nova-compute[74805]: DEBUG nova.compute.manager [req-b219eaad-5a1a-400c-bf8d-d83535422d99 req-754c2d6d-8968-41c5-9816-57c1b7211500 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Received event network-vif-plugged-a8a0db92-660b-4fc3-b68c-9e6a37aa85db {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:21:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b219eaad-5a1a-400c-bf8d-d83535422d99 req-754c2d6d-8968-41c5-9816-57c1b7211500 service nova] Acquiring lock "f329eddf-6a3b-4f05-9353-1b1e475ba420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b219eaad-5a1a-400c-bf8d-d83535422d99 req-754c2d6d-8968-41c5-9816-57c1b7211500 service nova] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b219eaad-5a1a-400c-bf8d-d83535422d99 req-754c2d6d-8968-41c5-9816-57c1b7211500 service nova] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:25 user nova-compute[74805]: DEBUG nova.compute.manager [req-b219eaad-5a1a-400c-bf8d-d83535422d99 req-754c2d6d-8968-41c5-9816-57c1b7211500 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] No waiting events found dispatching network-vif-plugged-a8a0db92-660b-4fc3-b68c-9e6a37aa85db {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:21:25 user nova-compute[74805]: WARNING nova.compute.manager [req-b219eaad-5a1a-400c-bf8d-d83535422d99 req-754c2d6d-8968-41c5-9816-57c1b7211500 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Received unexpected event network-vif-plugged-a8a0db92-660b-4fc3-b68c-9e6a37aa85db for instance with vm_state active and task_state None.
Nov 15 04:21:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b6ac6722-64cb-44a7-8c1d-12381a08abfd tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Acquiring lock "4fc66c41-efcf-4014-bedb-3955aed09eba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b6ac6722-64cb-44a7-8c1d-12381a08abfd tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Lock "4fc66c41-efcf-4014-bedb-3955aed09eba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b6ac6722-64cb-44a7-8c1d-12381a08abfd tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Acquiring lock "4fc66c41-efcf-4014-bedb-3955aed09eba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b6ac6722-64cb-44a7-8c1d-12381a08abfd tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Lock "4fc66c41-efcf-4014-bedb-3955aed09eba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b6ac6722-64cb-44a7-8c1d-12381a08abfd tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Lock "4fc66c41-efcf-4014-bedb-3955aed09eba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:40 user nova-compute[74805]: INFO nova.compute.manager [None req-b6ac6722-64cb-44a7-8c1d-12381a08abfd tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Terminating instance
Nov 15 04:21:40 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b6ac6722-64cb-44a7-8c1d-12381a08abfd tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:40 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Instance destroyed successfully.
Nov 15 04:21:40 user nova-compute[74805]: DEBUG nova.objects.instance [None req-b6ac6722-64cb-44a7-8c1d-12381a08abfd tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Lazy-loading 'resources' on Instance uuid 4fc66c41-efcf-4014-bedb-3955aed09eba {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-b6ac6722-64cb-44a7-8c1d-12381a08abfd tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:19:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1826505767',display_name='tempest-VolumesActionsTest-instance-1826505767',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1826505767',id=20,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:19:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf6b46f53769498ba5dc7974fa5557d9',ramdisk_id='',reservation_id='r-rrp1l4s4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1935850684',owner_user_name='tempest-VolumesActionsTest-1935850684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:19:52Z,user_data=None,user_id='30932c0fbe064cfb8e58632a94a0df5c',uuid=4fc66c41-efcf-4014-bedb-3955aed09eba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1484f8c9-4a63-494a-8710-6c6aa1ac355b", "address": "fa:16:3e:77:a9:2a", "network": {"id": "2137d20f-a0a2-4592-97ad-b12decfc2226", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1742182403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf6b46f53769498ba5dc7974fa5557d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1484f8c9-4a", "ovs_interfaceid": "1484f8c9-4a63-494a-8710-6c6aa1ac355b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-b6ac6722-64cb-44a7-8c1d-12381a08abfd tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Converting VIF {"id": "1484f8c9-4a63-494a-8710-6c6aa1ac355b", "address": "fa:16:3e:77:a9:2a", "network": {"id": "2137d20f-a0a2-4592-97ad-b12decfc2226", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1742182403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf6b46f53769498ba5dc7974fa5557d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1484f8c9-4a", "ovs_interfaceid": "1484f8c9-4a63-494a-8710-6c6aa1ac355b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-b6ac6722-64cb-44a7-8c1d-12381a08abfd tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:a9:2a,bridge_name='br-int',has_traffic_filtering=True,id=1484f8c9-4a63-494a-8710-6c6aa1ac355b,network=Network(2137d20f-a0a2-4592-97ad-b12decfc2226),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1484f8c9-4a') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG os_vif [None req-b6ac6722-64cb-44a7-8c1d-12381a08abfd tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:a9:2a,bridge_name='br-int',has_traffic_filtering=True,id=1484f8c9-4a63-494a-8710-6c6aa1ac355b,network=Network(2137d20f-a0a2-4592-97ad-b12decfc2226),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1484f8c9-4a') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1484f8c9-4a, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=518af0a5-56c7-4560-893e-6c554b0b4a4a) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:40 user nova-compute[74805]: INFO os_vif [None req-b6ac6722-64cb-44a7-8c1d-12381a08abfd tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:a9:2a,bridge_name='br-int',has_traffic_filtering=True,id=1484f8c9-4a63-494a-8710-6c6aa1ac355b,network=Network(2137d20f-a0a2-4592-97ad-b12decfc2226),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1484f8c9-4a')
Nov 15 04:21:40 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-b6ac6722-64cb-44a7-8c1d-12381a08abfd tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Deleting instance files /opt/stack/data/nova/instances/4fc66c41-efcf-4014-bedb-3955aed09eba_del
Nov 15 04:21:40 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-b6ac6722-64cb-44a7-8c1d-12381a08abfd tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Deletion of /opt/stack/data/nova/instances/4fc66c41-efcf-4014-bedb-3955aed09eba_del complete
Nov 15 04:21:40 user nova-compute[74805]: DEBUG nova.compute.manager [req-6a5042e7-3f69-409d-a872-5c11ba5e3ccd req-e7b0c97c-eb58-4d35-819f-5d2300c63152 service nova] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Received event network-vif-unplugged-1484f8c9-4a63-494a-8710-6c6aa1ac355b {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6a5042e7-3f69-409d-a872-5c11ba5e3ccd req-e7b0c97c-eb58-4d35-819f-5d2300c63152 service nova] Acquiring lock "4fc66c41-efcf-4014-bedb-3955aed09eba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6a5042e7-3f69-409d-a872-5c11ba5e3ccd req-e7b0c97c-eb58-4d35-819f-5d2300c63152 service nova] Lock "4fc66c41-efcf-4014-bedb-3955aed09eba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6a5042e7-3f69-409d-a872-5c11ba5e3ccd req-e7b0c97c-eb58-4d35-819f-5d2300c63152 service nova] Lock "4fc66c41-efcf-4014-bedb-3955aed09eba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG nova.compute.manager [req-6a5042e7-3f69-409d-a872-5c11ba5e3ccd req-e7b0c97c-eb58-4d35-819f-5d2300c63152 service nova] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] No waiting events found dispatching network-vif-unplugged-1484f8c9-4a63-494a-8710-6c6aa1ac355b {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG nova.compute.manager [req-6a5042e7-3f69-409d-a872-5c11ba5e3ccd req-e7b0c97c-eb58-4d35-819f-5d2300c63152 service nova] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Received event network-vif-unplugged-1484f8c9-4a63-494a-8710-6c6aa1ac355b for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:21:40 user nova-compute[74805]: INFO nova.compute.manager [None req-b6ac6722-64cb-44a7-8c1d-12381a08abfd tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 15 04:21:40 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-b6ac6722-64cb-44a7-8c1d-12381a08abfd tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:21:40 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:41 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 45c66453-2f83-476b-a03b-6bdbb01d1849 is timed out.
Nov 15 04:21:41 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Successfully detached device vdb from instance 45c66453-2f83-476b-a03b-6bdbb01d1849 from the live domain config.
Nov 15 04:21:41 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fZINnbzk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:21:41 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:21:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[db812e97-e04e-4620-9c65-819e2d571c40]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:21:41 user nova-compute[74805]: No targets found.
Nov 15 04:21:41 user nova-compute[74805]: iSNS:
Nov 15 04:21:41 user nova-compute[74805]: No targets found.
Nov 15 04:21:41 user nova-compute[74805]: STATIC:
Nov 15 04:21:41 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4
Nov 15 04:21:41 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:21:41 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:21:41 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7
Nov 15 04:21:41 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:21:41 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:21:41 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe
Nov 15 04:21:41 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:21:41 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:21:41 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf
Nov 15 04:21:41 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:21:41 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:21:41 user nova-compute[74805]: FIRMWARE:
Nov 15 04:21:41 user nova-compute[74805]: No targets found.
Nov 15 04:21:41 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:21:41 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:21:41 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee7afcb-cddc-466e-a5ce-430ef2774ba1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[81eb441e-cdea-4512-a0c6-3525aed2b74e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:21:41 user nova-compute[74805]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:21:41 user nova-compute[74805]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:21:41 user nova-compute[74805]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe (non-flash)
Nov 15 04:21:41 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:21:41 user nova-compute[74805]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:21:41 user nova-compute[74805]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:21:41 user nova-compute[74805]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe (non-flash)
Nov 15 04:21:41 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c670e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe'): ({'sde'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Removing single pathed devices sde {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:41 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Took 0.59 seconds to deallocate network for instance.
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cf3252-78b5-46f8-89a8-3cfa412c0aa4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24c8e9c-af1e-42a5-a1e3-11d418754f1a]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Flushing IO for device /dev/sde {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[503bd62e-da4f-4472-9f97-6c569149509b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b6ac6722-64cb-44a7-8c1d-12381a08abfd tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b6ac6722-64cb-44a7-8c1d-12381a08abfd tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[169c4aeb-9bb4-4972-b89e-847f4affccb7]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] SCSI volumes sde have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f40e96-0de7-48f5-bbc9-de87d8b1b39a]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b4ae89-df75-4bb6-8aa6-759c3a9b432b]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe, portal: 172.16.0.220,3260]
Nov 15 04:21:41 user nova-compute[74805]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe, portal: 172.16.0.220,3260] successful.
Nov 15 04:21:41 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0953f066-9498-486a-9549-9bac2a67defe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[925e8eef-6202-43f5-a709-1e06ba603099]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] <== disconnect_volume: return (324ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-b6ac6722-64cb-44a7-8c1d-12381a08abfd tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-b6ac6722-64cb-44a7-8c1d-12381a08abfd tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b6ac6722-64cb-44a7-8c1d-12381a08abfd tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:41 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-b6ac6722-64cb-44a7-8c1d-12381a08abfd tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Deleted allocations for instance 4fc66c41-efcf-4014-bedb-3955aed09eba
Nov 15 04:21:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b6ac6722-64cb-44a7-8c1d-12381a08abfd tempest-VolumesActionsTest-1935850684 tempest-VolumesActionsTest-1935850684-project-member] Lock "4fc66c41-efcf-4014-bedb-3955aed09eba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.826s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:42 user nova-compute[74805]: DEBUG nova.objects.instance [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lazy-loading 'flavor' on Instance uuid 45c66453-2f83-476b-a03b-6bdbb01d1849 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:21:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-280b945d-8c74-4a89-8a40-e0fe6de44130 tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "45c66453-2f83-476b-a03b-6bdbb01d1849" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.429s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:42 user nova-compute[74805]: DEBUG nova.compute.manager [req-44e4537d-6731-471c-8ec9-0138fa15af51 req-ecb01ae9-1ba7-4e02-95e3-b46ad7a1da14 service nova] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Received event network-vif-plugged-1484f8c9-4a63-494a-8710-6c6aa1ac355b {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:21:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-44e4537d-6731-471c-8ec9-0138fa15af51 req-ecb01ae9-1ba7-4e02-95e3-b46ad7a1da14 service nova] Acquiring lock "4fc66c41-efcf-4014-bedb-3955aed09eba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:21:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-44e4537d-6731-471c-8ec9-0138fa15af51 req-ecb01ae9-1ba7-4e02-95e3-b46ad7a1da14 service nova] Lock "4fc66c41-efcf-4014-bedb-3955aed09eba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:21:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-44e4537d-6731-471c-8ec9-0138fa15af51 req-ecb01ae9-1ba7-4e02-95e3-b46ad7a1da14 service nova] Lock "4fc66c41-efcf-4014-bedb-3955aed09eba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:21:42 user nova-compute[74805]: DEBUG nova.compute.manager [req-44e4537d-6731-471c-8ec9-0138fa15af51 req-ecb01ae9-1ba7-4e02-95e3-b46ad7a1da14 service nova] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] No waiting events found dispatching network-vif-plugged-1484f8c9-4a63-494a-8710-6c6aa1ac355b {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:21:42 user nova-compute[74805]: WARNING nova.compute.manager [req-44e4537d-6731-471c-8ec9-0138fa15af51 req-ecb01ae9-1ba7-4e02-95e3-b46ad7a1da14 service nova] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Received unexpected event network-vif-plugged-1484f8c9-4a63-494a-8710-6c6aa1ac355b for instance with vm_state deleted and task_state None.
Nov 15 04:21:42 user nova-compute[74805]: DEBUG nova.compute.manager [req-44e4537d-6731-471c-8ec9-0138fa15af51 req-ecb01ae9-1ba7-4e02-95e3-b46ad7a1da14 service nova] [instance: 4fc66c41-efcf-4014-bedb-3955aed09eba] Received event network-vif-deleted-1484f8c9-4a63-494a-8710-6c6aa1ac355b {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:21:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:54 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:21:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:04 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:22:05 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:22:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:22:06 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:22:06 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:22:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:06 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:22:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449149-a938-41ff-964f-16f96614bf3e/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449149-a938-41ff-964f-16f96614bf3e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449149-a938-41ff-964f-16f96614bf3e/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449149-a938-41ff-964f-16f96614bf3e/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:22:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3800420-c3dd-4c51-a500-e405031e9a34/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3800420-c3dd-4c51-a500-e405031e9a34/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3800420-c3dd-4c51-a500-e405031e9a34/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3800420-c3dd-4c51-a500-e405031e9a34/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:22:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:22:09 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:22:09 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:22:09 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=7439MB free_disk=25.257198333740234GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:22:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 2b1e540c-6226-445a-bd45-5b7b8807e2b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:22:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance d63f3726-27df-455f-bda0-3ddca95b70d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:22:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance e5004557-00fa-4824-9233-343c2261588d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:22:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 51e0a627-f95e-4347-92a7-4a218413e884 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:22:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:22:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 45c66453-2f83-476b-a03b-6bdbb01d1849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:22:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 13449149-a938-41ff-964f-16f96614bf3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:22:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance b3800420-c3dd-4c51-a500-e405031e9a34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:22:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance f329eddf-6a3b-4f05-9353-1b1e475ba420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:22:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:22:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:22:10 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:22:10 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:22:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:22:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.502s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Acquiring lock "a1ddc84e-c9e1-4284-8782-7973417486d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "a1ddc84e-c9e1-4284-8782-7973417486d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:11 user nova-compute[74805]: DEBUG nova.compute.manager [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:22:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:22:11 user nova-compute[74805]: INFO nova.compute.claims [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Claim successful on node user
Nov 15 04:22:11 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:22:11 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:22:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:11 user nova-compute[74805]: DEBUG nova.compute.manager [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:22:11 user nova-compute[74805]: DEBUG nova.compute.manager [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:22:11 user nova-compute[74805]: DEBUG nova.network.neutron [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:22:12 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:22:12 user nova-compute[74805]: DEBUG nova.policy [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e816730fe634ef08d520fd01186b10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13324230e774496aa688ef50d872cb1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:22:12 user nova-compute[74805]: DEBUG nova.compute.manager [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:22:12 user nova-compute[74805]: DEBUG nova.compute.manager [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:22:12 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:22:12 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Creating image(s)
Nov 15 04:22:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Acquiring lock "/opt/stack/data/nova/instances/a1ddc84e-c9e1-4284-8782-7973417486d8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "/opt/stack/data/nova/instances/a1ddc84e-c9e1-4284-8782-7973417486d8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "/opt/stack/data/nova/instances/a1ddc84e-c9e1-4284-8782-7973417486d8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.194s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:12 user nova-compute[74805]: DEBUG nova.network.neutron [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Successfully created port: f5cc7efb-fb8e-453c-b34c-a6df55603359 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:22:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.192s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/a1ddc84e-c9e1-4284-8782-7973417486d8/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/a1ddc84e-c9e1-4284-8782-7973417486d8/disk 1073741824" returned: 0 in 0.048s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.171s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:12 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a1ddc84e-c9e1-4284-8782-7973417486d8/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:22:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ddc84e-c9e1-4284-8782-7973417486d8/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ddc84e-c9e1-4284-8782-7973417486d8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Cannot resize image /opt/stack/data/nova/instances/a1ddc84e-c9e1-4284-8782-7973417486d8/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Ensure instance console log exists: /opt/stack/data/nova/instances/a1ddc84e-c9e1-4284-8782-7973417486d8/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.network.neutron [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Successfully updated port: f5cc7efb-fb8e-453c-b34c-a6df55603359 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Acquiring lock "refresh_cache-a1ddc84e-c9e1-4284-8782-7973417486d8" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Acquired lock "refresh_cache-a1ddc84e-c9e1-4284-8782-7973417486d8" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.network.neutron [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.compute.manager [req-1cdc24bf-e5f9-4b1e-9783-cc02b816e703 req-52eb417c-84c1-4647-b604-ec650b11b754 service nova] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Received event network-changed-f5cc7efb-fb8e-453c-b34c-a6df55603359 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.compute.manager [req-1cdc24bf-e5f9-4b1e-9783-cc02b816e703 req-52eb417c-84c1-4647-b604-ec650b11b754 service nova] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Refreshing instance network info cache due to event network-changed-f5cc7efb-fb8e-453c-b34c-a6df55603359. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1cdc24bf-e5f9-4b1e-9783-cc02b816e703 req-52eb417c-84c1-4647-b604-ec650b11b754 service nova] Acquiring lock "refresh_cache-a1ddc84e-c9e1-4284-8782-7973417486d8" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.network.neutron [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.network.neutron [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Updating instance_info_cache with network_info: [{"id": "f5cc7efb-fb8e-453c-b34c-a6df55603359", "address": "fa:16:3e:d5:48:2c", "network": {"id": "8a59b0de-c0e7-442f-90fa-ccb85294d3f7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640403300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13324230e774496aa688ef50d872cb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5cc7efb-fb", "ovs_interfaceid": "f5cc7efb-fb8e-453c-b34c-a6df55603359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Releasing lock "refresh_cache-a1ddc84e-c9e1-4284-8782-7973417486d8" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.compute.manager [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Instance network_info: |[{"id": "f5cc7efb-fb8e-453c-b34c-a6df55603359", "address": "fa:16:3e:d5:48:2c", "network": {"id": "8a59b0de-c0e7-442f-90fa-ccb85294d3f7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640403300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13324230e774496aa688ef50d872cb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5cc7efb-fb", "ovs_interfaceid": "f5cc7efb-fb8e-453c-b34c-a6df55603359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1cdc24bf-e5f9-4b1e-9783-cc02b816e703 req-52eb417c-84c1-4647-b604-ec650b11b754 service nova] Acquired lock "refresh_cache-a1ddc84e-c9e1-4284-8782-7973417486d8" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.network.neutron [req-1cdc24bf-e5f9-4b1e-9783-cc02b816e703 req-52eb417c-84c1-4647-b604-ec650b11b754 service nova] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Refreshing network info cache for port f5cc7efb-fb8e-453c-b34c-a6df55603359 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Start _get_guest_xml network_info=[{"id": "f5cc7efb-fb8e-453c-b34c-a6df55603359", "address": "fa:16:3e:d5:48:2c", "network": {"id": "8a59b0de-c0e7-442f-90fa-ccb85294d3f7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640403300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13324230e774496aa688ef50d872cb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5cc7efb-fb", "ovs_interfaceid": "f5cc7efb-fb8e-453c-b34c-a6df55603359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:22:13 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:22:13 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:22:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:22:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-654881351',display_name='tempest-VolumesAdminNegativeTest-server-654881351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-654881351',id=24,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13324230e774496aa688ef50d872cb1f',ramdisk_id='',reservation_id='r-s5o1a6nr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-77980530',owner_user_name='tempest-VolumesAdminNegativeTest-77980530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:22:12Z,user_data=None,user_id='3e816730fe634ef08d520fd01186b10e',uuid=a1ddc84e-c9e1-4284-8782-7973417486d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5cc7efb-fb8e-453c-b34c-a6df55603359", "address": "fa:16:3e:d5:48:2c", "network": {"id": "8a59b0de-c0e7-442f-90fa-ccb85294d3f7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640403300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13324230e774496aa688ef50d872cb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5cc7efb-fb", "ovs_interfaceid": "f5cc7efb-fb8e-453c-b34c-a6df55603359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Converting VIF {"id": "f5cc7efb-fb8e-453c-b34c-a6df55603359", "address": "fa:16:3e:d5:48:2c", "network": {"id": "8a59b0de-c0e7-442f-90fa-ccb85294d3f7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640403300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13324230e774496aa688ef50d872cb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5cc7efb-fb", "ovs_interfaceid": "f5cc7efb-fb8e-453c-b34c-a6df55603359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:48:2c,bridge_name='br-int',has_traffic_filtering=True,id=f5cc7efb-fb8e-453c-b34c-a6df55603359,network=Network(8a59b0de-c0e7-442f-90fa-ccb85294d3f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5cc7efb-fb') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.objects.instance [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lazy-loading 'pci_devices' on Instance uuid a1ddc84e-c9e1-4284-8782-7973417486d8 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:22:13 user nova-compute[74805]:   <uuid>a1ddc84e-c9e1-4284-8782-7973417486d8</uuid>
Nov 15 04:22:13 user nova-compute[74805]:   <name>instance-00000018</name>
Nov 15 04:22:13 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:22:13 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:22:13 user nova-compute[74805]:   <metadata>
Nov 15 04:22:13 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:22:13 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:22:13 user nova-compute[74805]:       <nova:name>tempest-VolumesAdminNegativeTest-server-654881351</nova:name>
Nov 15 04:22:13 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:22:13</nova:creationTime>
Nov 15 04:22:13 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:22:13 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:22:13 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:22:13 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:22:13 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:22:13 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:22:13 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:22:13 user nova-compute[74805]:       <nova:owner>
Nov 15 04:22:13 user nova-compute[74805]:         <nova:user uuid="3e816730fe634ef08d520fd01186b10e">tempest-VolumesAdminNegativeTest-77980530-project-member</nova:user>
Nov 15 04:22:13 user nova-compute[74805]:         <nova:project uuid="13324230e774496aa688ef50d872cb1f">tempest-VolumesAdminNegativeTest-77980530</nova:project>
Nov 15 04:22:13 user nova-compute[74805]:       </nova:owner>
Nov 15 04:22:13 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:22:13 user nova-compute[74805]:       <nova:ports>
Nov 15 04:22:13 user nova-compute[74805]:         <nova:port uuid="f5cc7efb-fb8e-453c-b34c-a6df55603359">
Nov 15 04:22:13 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 04:22:13 user nova-compute[74805]:         </nova:port>
Nov 15 04:22:13 user nova-compute[74805]:       </nova:ports>
Nov 15 04:22:13 user nova-compute[74805]:     </nova:instance>
Nov 15 04:22:13 user nova-compute[74805]:   </metadata>
Nov 15 04:22:13 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:22:13 user nova-compute[74805]:     <system>
Nov 15 04:22:13 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:22:13 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:22:13 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:22:13 user nova-compute[74805]:       <entry name="serial">a1ddc84e-c9e1-4284-8782-7973417486d8</entry>
Nov 15 04:22:13 user nova-compute[74805]:       <entry name="uuid">a1ddc84e-c9e1-4284-8782-7973417486d8</entry>
Nov 15 04:22:13 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:22:13 user nova-compute[74805]:     </system>
Nov 15 04:22:13 user nova-compute[74805]:   </sysinfo>
Nov 15 04:22:13 user nova-compute[74805]:   <os>
Nov 15 04:22:13 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:22:13 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:22:13 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:22:13 user nova-compute[74805]:   </os>
Nov 15 04:22:13 user nova-compute[74805]:   <features>
Nov 15 04:22:13 user nova-compute[74805]:     <acpi/>
Nov 15 04:22:13 user nova-compute[74805]:     <apic/>
Nov 15 04:22:13 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:22:13 user nova-compute[74805]:   </features>
Nov 15 04:22:13 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:22:13 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:22:13 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:22:13 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:22:13 user nova-compute[74805]:   </clock>
Nov 15 04:22:13 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:22:13 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:22:13 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:22:13 user nova-compute[74805]:   </cpu>
Nov 15 04:22:13 user nova-compute[74805]:   <devices>
Nov 15 04:22:13 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:22:13 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:22:13 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/a1ddc84e-c9e1-4284-8782-7973417486d8/disk"/>
Nov 15 04:22:13 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:22:13 user nova-compute[74805]:     </disk>
Nov 15 04:22:13 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:22:13 user nova-compute[74805]:       <mac address="fa:16:3e:d5:48:2c"/>
Nov 15 04:22:13 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:22:13 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:22:13 user nova-compute[74805]:       <target dev="tapf5cc7efb-fb"/>
Nov 15 04:22:13 user nova-compute[74805]:     </interface>
Nov 15 04:22:13 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:22:13 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/a1ddc84e-c9e1-4284-8782-7973417486d8/console.log" append="off"/>
Nov 15 04:22:13 user nova-compute[74805]:     </serial>
Nov 15 04:22:13 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:22:13 user nova-compute[74805]:     <video>
Nov 15 04:22:13 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:22:13 user nova-compute[74805]:     </video>
Nov 15 04:22:13 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:22:13 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:22:13 user nova-compute[74805]:     </rng>
Nov 15 04:22:13 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:22:13 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:22:13 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:22:13 user nova-compute[74805]:     </memballoon>
Nov 15 04:22:13 user nova-compute[74805]:   </devices>
Nov 15 04:22:13 user nova-compute[74805]: </domain>
Nov 15 04:22:13 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:22:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-654881351',display_name='tempest-VolumesAdminNegativeTest-server-654881351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-654881351',id=24,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13324230e774496aa688ef50d872cb1f',ramdisk_id='',reservation_id='r-s5o1a6nr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-77980530',owner_user_name='tempest-VolumesAdminNegativeTest-77980530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:22:12Z,user_data=None,user_id='3e816730fe634ef08d520fd01186b10e',uuid=a1ddc84e-c9e1-4284-8782-7973417486d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5cc7efb-fb8e-453c-b34c-a6df55603359", "address": "fa:16:3e:d5:48:2c", "network": {"id": "8a59b0de-c0e7-442f-90fa-ccb85294d3f7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640403300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13324230e774496aa688ef50d872cb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5cc7efb-fb", "ovs_interfaceid": "f5cc7efb-fb8e-453c-b34c-a6df55603359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Converting VIF {"id": "f5cc7efb-fb8e-453c-b34c-a6df55603359", "address": "fa:16:3e:d5:48:2c", "network": {"id": "8a59b0de-c0e7-442f-90fa-ccb85294d3f7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640403300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13324230e774496aa688ef50d872cb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5cc7efb-fb", "ovs_interfaceid": "f5cc7efb-fb8e-453c-b34c-a6df55603359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:48:2c,bridge_name='br-int',has_traffic_filtering=True,id=f5cc7efb-fb8e-453c-b34c-a6df55603359,network=Network(8a59b0de-c0e7-442f-90fa-ccb85294d3f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5cc7efb-fb') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG os_vif [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:48:2c,bridge_name='br-int',has_traffic_filtering=True,id=f5cc7efb-fb8e-453c-b34c-a6df55603359,network=Network(8a59b0de-c0e7-442f-90fa-ccb85294d3f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5cc7efb-fb') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d4fc04b-4666-5de8-adbd-348bbd105029', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5cc7efb-fb, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5cc7efb-fb, col_values=(('qos', UUID('2b8e45d2-26e1-489f-90cd-e20c471948f9')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5cc7efb-fb, col_values=(('external_ids', {'iface-id': 'f5cc7efb-fb8e-453c-b34c-a6df55603359', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:48:2c', 'vm-uuid': 'a1ddc84e-c9e1-4284-8782-7973417486d8'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:13 user nova-compute[74805]: INFO os_vif [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:48:2c,bridge_name='br-int',has_traffic_filtering=True,id=f5cc7efb-fb8e-453c-b34c-a6df55603359,network=Network(8a59b0de-c0e7-442f-90fa-ccb85294d3f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5cc7efb-fb')
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:22:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] No VIF found with MAC fa:16:3e:d5:48:2c, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:22:14 user nova-compute[74805]: DEBUG nova.network.neutron [req-1cdc24bf-e5f9-4b1e-9783-cc02b816e703 req-52eb417c-84c1-4647-b604-ec650b11b754 service nova] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Updated VIF entry in instance network info cache for port f5cc7efb-fb8e-453c-b34c-a6df55603359. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:22:14 user nova-compute[74805]: DEBUG nova.network.neutron [req-1cdc24bf-e5f9-4b1e-9783-cc02b816e703 req-52eb417c-84c1-4647-b604-ec650b11b754 service nova] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Updating instance_info_cache with network_info: [{"id": "f5cc7efb-fb8e-453c-b34c-a6df55603359", "address": "fa:16:3e:d5:48:2c", "network": {"id": "8a59b0de-c0e7-442f-90fa-ccb85294d3f7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640403300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13324230e774496aa688ef50d872cb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5cc7efb-fb", "ovs_interfaceid": "f5cc7efb-fb8e-453c-b34c-a6df55603359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:22:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1cdc24bf-e5f9-4b1e-9783-cc02b816e703 req-52eb417c-84c1-4647-b604-ec650b11b754 service nova] Releasing lock "refresh_cache-a1ddc84e-c9e1-4284-8782-7973417486d8" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:22:14 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Updating instance_info_cache with network_info: [{"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:22:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:22:14 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:22:14 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:22:14 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:22:14 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:22:14 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:22:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:15 user nova-compute[74805]: DEBUG nova.compute.manager [req-3d750c49-f4d3-4ca1-8575-529348077e5f req-2dd522ac-e68d-4dff-bc5a-78302a270af8 service nova] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Received event network-vif-plugged-f5cc7efb-fb8e-453c-b34c-a6df55603359 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:22:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3d750c49-f4d3-4ca1-8575-529348077e5f req-2dd522ac-e68d-4dff-bc5a-78302a270af8 service nova] Acquiring lock "a1ddc84e-c9e1-4284-8782-7973417486d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3d750c49-f4d3-4ca1-8575-529348077e5f req-2dd522ac-e68d-4dff-bc5a-78302a270af8 service nova] Lock "a1ddc84e-c9e1-4284-8782-7973417486d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3d750c49-f4d3-4ca1-8575-529348077e5f req-2dd522ac-e68d-4dff-bc5a-78302a270af8 service nova] Lock "a1ddc84e-c9e1-4284-8782-7973417486d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:15 user nova-compute[74805]: DEBUG nova.compute.manager [req-3d750c49-f4d3-4ca1-8575-529348077e5f req-2dd522ac-e68d-4dff-bc5a-78302a270af8 service nova] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] No waiting events found dispatching network-vif-plugged-f5cc7efb-fb8e-453c-b34c-a6df55603359 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:22:15 user nova-compute[74805]: WARNING nova.compute.manager [req-3d750c49-f4d3-4ca1-8575-529348077e5f req-2dd522ac-e68d-4dff-bc5a-78302a270af8 service nova] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Received unexpected event network-vif-plugged-f5cc7efb-fb8e-453c-b34c-a6df55603359 for instance with vm_state building and task_state spawning.
Nov 15 04:22:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:17 user nova-compute[74805]: DEBUG nova.compute.manager [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:22:17 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:22:17 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Instance spawned successfully.
Nov 15 04:22:17 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:22:17 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:22:17 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:22:17 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:22:17 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:22:17 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:22:17 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:22:17 user nova-compute[74805]: DEBUG nova.compute.manager [req-31661f1c-8733-43c1-9998-bf2cc579bb0d req-1fc3500e-9598-4a65-a8b0-c34ba1803c38 service nova] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Received event network-vif-plugged-f5cc7efb-fb8e-453c-b34c-a6df55603359 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:22:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-31661f1c-8733-43c1-9998-bf2cc579bb0d req-1fc3500e-9598-4a65-a8b0-c34ba1803c38 service nova] Acquiring lock "a1ddc84e-c9e1-4284-8782-7973417486d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-31661f1c-8733-43c1-9998-bf2cc579bb0d req-1fc3500e-9598-4a65-a8b0-c34ba1803c38 service nova] Lock "a1ddc84e-c9e1-4284-8782-7973417486d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-31661f1c-8733-43c1-9998-bf2cc579bb0d req-1fc3500e-9598-4a65-a8b0-c34ba1803c38 service nova] Lock "a1ddc84e-c9e1-4284-8782-7973417486d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:17 user nova-compute[74805]: DEBUG nova.compute.manager [req-31661f1c-8733-43c1-9998-bf2cc579bb0d req-1fc3500e-9598-4a65-a8b0-c34ba1803c38 service nova] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] No waiting events found dispatching network-vif-plugged-f5cc7efb-fb8e-453c-b34c-a6df55603359 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:22:17 user nova-compute[74805]: WARNING nova.compute.manager [req-31661f1c-8733-43c1-9998-bf2cc579bb0d req-1fc3500e-9598-4a65-a8b0-c34ba1803c38 service nova] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Received unexpected event network-vif-plugged-f5cc7efb-fb8e-453c-b34c-a6df55603359 for instance with vm_state building and task_state spawning.
Nov 15 04:22:17 user nova-compute[74805]: INFO nova.compute.manager [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 15 04:22:17 user nova-compute[74805]: DEBUG nova.compute.manager [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:22:17 user nova-compute[74805]: INFO nova.compute.manager [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Took 6.11 seconds to build instance.
Nov 15 04:22:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8009f4f2-fe77-485b-8e8f-0cef15bde58e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "a1ddc84e-c9e1-4284-8782-7973417486d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.198s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "4a2d5475-04a4-414d-9ce9-d5204494f898" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "4a2d5475-04a4-414d-9ce9-d5204494f898" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:22:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:27 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:22:27 user nova-compute[74805]: INFO nova.compute.claims [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Claim successful on node user
Nov 15 04:22:27 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:22:27 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:22:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.459s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:22:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:22:27 user nova-compute[74805]: DEBUG nova.network.neutron [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:22:27 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:22:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:22:27 user nova-compute[74805]: DEBUG nova.policy [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2876983d30794d8db191857d2f420f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e01874e82ed4ae08813343751506eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:22:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:22:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:22:27 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Creating image(s)
Nov 15 04:22:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "/opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "/opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.185s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.182s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk 1073741824" returned: 0 in 0.056s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.182s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:28 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:22:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:28 user nova-compute[74805]: DEBUG nova.network.neutron [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Successfully created port: 90a9632d-7041-430e-a0f4-0b8ec60eb332 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:22:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:28 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Cannot resize image /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:22:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:22:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Ensure instance console log exists: /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:22:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.network.neutron [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Successfully updated port: 90a9632d-7041-430e-a0f4-0b8ec60eb332 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "refresh_cache-4a2d5475-04a4-414d-9ce9-d5204494f898" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquired lock "refresh_cache-4a2d5475-04a4-414d-9ce9-d5204494f898" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.network.neutron [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.compute.manager [req-d9731699-344c-436a-b407-3a603a21f150 req-13a6688f-af49-4004-915e-06883745132c service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Received event network-changed-90a9632d-7041-430e-a0f4-0b8ec60eb332 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.compute.manager [req-d9731699-344c-436a-b407-3a603a21f150 req-13a6688f-af49-4004-915e-06883745132c service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Refreshing instance network info cache due to event network-changed-90a9632d-7041-430e-a0f4-0b8ec60eb332. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d9731699-344c-436a-b407-3a603a21f150 req-13a6688f-af49-4004-915e-06883745132c service nova] Acquiring lock "refresh_cache-4a2d5475-04a4-414d-9ce9-d5204494f898" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.network.neutron [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.network.neutron [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Updating instance_info_cache with network_info: [{"id": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "address": "fa:16:3e:61:a1:b6", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a9632d-70", "ovs_interfaceid": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Releasing lock "refresh_cache-4a2d5475-04a4-414d-9ce9-d5204494f898" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.compute.manager [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Instance network_info: |[{"id": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "address": "fa:16:3e:61:a1:b6", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a9632d-70", "ovs_interfaceid": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d9731699-344c-436a-b407-3a603a21f150 req-13a6688f-af49-4004-915e-06883745132c service nova] Acquired lock "refresh_cache-4a2d5475-04a4-414d-9ce9-d5204494f898" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.network.neutron [req-d9731699-344c-436a-b407-3a603a21f150 req-13a6688f-af49-4004-915e-06883745132c service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Refreshing network info cache for port 90a9632d-7041-430e-a0f4-0b8ec60eb332 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Start _get_guest_xml network_info=[{"id": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "address": "fa:16:3e:61:a1:b6", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a9632d-70", "ovs_interfaceid": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:22:29 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:22:29 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-918598282',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-918598282',id=25,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMymrvqIzYGxGC8fgN4EdQbJ0JI3rZYj1T8Y5E6V+FSJeCmAYkDYrYJ8BCpQMPV7261ZAXmjrXyft6H81pTvLfoVVhh1tKM5UtLUU619sjSGelYRZRrJtmj2R7elo05DA==',key_name='tempest-keypair-1201355498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e01874e82ed4ae08813343751506eeb',ramdisk_id='',reservation_id='r-0vg8si2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2114494734',owner_user_name='tempest-AttachVolumeShelveTestJSON-2114494734-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2876983d30794d8db191857d2f420f7d',uuid=4a2d5475-04a4-414d-9ce9-d5204494f898,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "address": "fa:16:3e:61:a1:b6", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a9632d-70", "ovs_interfaceid": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Converting VIF {"id": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "address": "fa:16:3e:61:a1:b6", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a9632d-70", "ovs_interfaceid": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:a1:b6,bridge_name='br-int',has_traffic_filtering=True,id=90a9632d-7041-430e-a0f4-0b8ec60eb332,network=Network(5febf498-f447-4e3b-a484-320124bd0158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a9632d-70') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.objects.instance [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a2d5475-04a4-414d-9ce9-d5204494f898 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:22:29 user nova-compute[74805]:   <uuid>4a2d5475-04a4-414d-9ce9-d5204494f898</uuid>
Nov 15 04:22:29 user nova-compute[74805]:   <name>instance-00000019</name>
Nov 15 04:22:29 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:22:29 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:22:29 user nova-compute[74805]:   <metadata>
Nov 15 04:22:29 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:22:29 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:22:29 user nova-compute[74805]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-918598282</nova:name>
Nov 15 04:22:29 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:22:29</nova:creationTime>
Nov 15 04:22:29 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:22:29 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:22:29 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:22:29 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:22:29 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:22:29 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:22:29 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:22:29 user nova-compute[74805]:       <nova:owner>
Nov 15 04:22:29 user nova-compute[74805]:         <nova:user uuid="2876983d30794d8db191857d2f420f7d">tempest-AttachVolumeShelveTestJSON-2114494734-project-member</nova:user>
Nov 15 04:22:29 user nova-compute[74805]:         <nova:project uuid="5e01874e82ed4ae08813343751506eeb">tempest-AttachVolumeShelveTestJSON-2114494734</nova:project>
Nov 15 04:22:29 user nova-compute[74805]:       </nova:owner>
Nov 15 04:22:29 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:22:29 user nova-compute[74805]:       <nova:ports>
Nov 15 04:22:29 user nova-compute[74805]:         <nova:port uuid="90a9632d-7041-430e-a0f4-0b8ec60eb332">
Nov 15 04:22:29 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 04:22:29 user nova-compute[74805]:         </nova:port>
Nov 15 04:22:29 user nova-compute[74805]:       </nova:ports>
Nov 15 04:22:29 user nova-compute[74805]:     </nova:instance>
Nov 15 04:22:29 user nova-compute[74805]:   </metadata>
Nov 15 04:22:29 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:22:29 user nova-compute[74805]:     <system>
Nov 15 04:22:29 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:22:29 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:22:29 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:22:29 user nova-compute[74805]:       <entry name="serial">4a2d5475-04a4-414d-9ce9-d5204494f898</entry>
Nov 15 04:22:29 user nova-compute[74805]:       <entry name="uuid">4a2d5475-04a4-414d-9ce9-d5204494f898</entry>
Nov 15 04:22:29 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:22:29 user nova-compute[74805]:     </system>
Nov 15 04:22:29 user nova-compute[74805]:   </sysinfo>
Nov 15 04:22:29 user nova-compute[74805]:   <os>
Nov 15 04:22:29 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:22:29 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:22:29 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:22:29 user nova-compute[74805]:   </os>
Nov 15 04:22:29 user nova-compute[74805]:   <features>
Nov 15 04:22:29 user nova-compute[74805]:     <acpi/>
Nov 15 04:22:29 user nova-compute[74805]:     <apic/>
Nov 15 04:22:29 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:22:29 user nova-compute[74805]:   </features>
Nov 15 04:22:29 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:22:29 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:22:29 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:22:29 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:22:29 user nova-compute[74805]:   </clock>
Nov 15 04:22:29 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:22:29 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:22:29 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:22:29 user nova-compute[74805]:   </cpu>
Nov 15 04:22:29 user nova-compute[74805]:   <devices>
Nov 15 04:22:29 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:22:29 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:22:29 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk"/>
Nov 15 04:22:29 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:22:29 user nova-compute[74805]:     </disk>
Nov 15 04:22:29 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:22:29 user nova-compute[74805]:       <mac address="fa:16:3e:61:a1:b6"/>
Nov 15 04:22:29 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:22:29 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:22:29 user nova-compute[74805]:       <target dev="tap90a9632d-70"/>
Nov 15 04:22:29 user nova-compute[74805]:     </interface>
Nov 15 04:22:29 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:22:29 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/console.log" append="off"/>
Nov 15 04:22:29 user nova-compute[74805]:     </serial>
Nov 15 04:22:29 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:22:29 user nova-compute[74805]:     <video>
Nov 15 04:22:29 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:22:29 user nova-compute[74805]:     </video>
Nov 15 04:22:29 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:22:29 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:22:29 user nova-compute[74805]:     </rng>
Nov 15 04:22:29 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:22:29 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:22:29 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:22:29 user nova-compute[74805]:     </memballoon>
Nov 15 04:22:29 user nova-compute[74805]:   </devices>
Nov 15 04:22:29 user nova-compute[74805]: </domain>
Nov 15 04:22:29 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-918598282',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-918598282',id=25,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMymrvqIzYGxGC8fgN4EdQbJ0JI3rZYj1T8Y5E6V+FSJeCmAYkDYrYJ8BCpQMPV7261ZAXmjrXyft6H81pTvLfoVVhh1tKM5UtLUU619sjSGelYRZRrJtmj2R7elo05DA==',key_name='tempest-keypair-1201355498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e01874e82ed4ae08813343751506eeb',ramdisk_id='',reservation_id='r-0vg8si2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2114494734',owner_user_name='tempest-AttachVolumeShelveTestJSON-2114494734-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2876983d30794d8db191857d2f420f7d',uuid=4a2d5475-04a4-414d-9ce9-d5204494f898,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "address": "fa:16:3e:61:a1:b6", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a9632d-70", "ovs_interfaceid": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Converting VIF {"id": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "address": "fa:16:3e:61:a1:b6", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a9632d-70", "ovs_interfaceid": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:a1:b6,bridge_name='br-int',has_traffic_filtering=True,id=90a9632d-7041-430e-a0f4-0b8ec60eb332,network=Network(5febf498-f447-4e3b-a484-320124bd0158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a9632d-70') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG os_vif [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:a1:b6,bridge_name='br-int',has_traffic_filtering=True,id=90a9632d-7041-430e-a0f4-0b8ec60eb332,network=Network(5febf498-f447-4e3b-a484-320124bd0158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a9632d-70') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ddc45eb-2e82-59f8-aa7a-a188eebcd6d0', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90a9632d-70, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90a9632d-70, col_values=(('qos', UUID('8636bac8-a6f2-4d23-aafe-e8b919b77dbf')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90a9632d-70, col_values=(('external_ids', {'iface-id': '90a9632d-7041-430e-a0f4-0b8ec60eb332', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:a1:b6', 'vm-uuid': '4a2d5475-04a4-414d-9ce9-d5204494f898'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:29 user nova-compute[74805]: INFO os_vif [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:a1:b6,bridge_name='br-int',has_traffic_filtering=True,id=90a9632d-7041-430e-a0f4-0b8ec60eb332,network=Network(5febf498-f447-4e3b-a484-320124bd0158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a9632d-70')
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:22:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] No VIF found with MAC fa:16:3e:61:a1:b6, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:22:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:30 user nova-compute[74805]: DEBUG nova.network.neutron [req-d9731699-344c-436a-b407-3a603a21f150 req-13a6688f-af49-4004-915e-06883745132c service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Updated VIF entry in instance network info cache for port 90a9632d-7041-430e-a0f4-0b8ec60eb332. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:22:30 user nova-compute[74805]: DEBUG nova.network.neutron [req-d9731699-344c-436a-b407-3a603a21f150 req-13a6688f-af49-4004-915e-06883745132c service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Updating instance_info_cache with network_info: [{"id": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "address": "fa:16:3e:61:a1:b6", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a9632d-70", "ovs_interfaceid": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:22:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d9731699-344c-436a-b407-3a603a21f150 req-13a6688f-af49-4004-915e-06883745132c service nova] Releasing lock "refresh_cache-4a2d5475-04a4-414d-9ce9-d5204494f898" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:22:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:31 user nova-compute[74805]: DEBUG nova.compute.manager [req-b9a380ef-59fd-4f58-a2ea-70d94662f008 req-3ca86e6a-6d79-4bd3-a15b-746f0e0f58f7 service nova] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Received event network-changed-3e95edf0-c248-41b6-b111-8411047ab446 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:22:31 user nova-compute[74805]: DEBUG nova.compute.manager [req-b9a380ef-59fd-4f58-a2ea-70d94662f008 req-3ca86e6a-6d79-4bd3-a15b-746f0e0f58f7 service nova] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Refreshing instance network info cache due to event network-changed-3e95edf0-c248-41b6-b111-8411047ab446. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:22:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b9a380ef-59fd-4f58-a2ea-70d94662f008 req-3ca86e6a-6d79-4bd3-a15b-746f0e0f58f7 service nova] Acquiring lock "refresh_cache-13449149-a938-41ff-964f-16f96614bf3e" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:22:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b9a380ef-59fd-4f58-a2ea-70d94662f008 req-3ca86e6a-6d79-4bd3-a15b-746f0e0f58f7 service nova] Acquired lock "refresh_cache-13449149-a938-41ff-964f-16f96614bf3e" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:22:31 user nova-compute[74805]: DEBUG nova.network.neutron [req-b9a380ef-59fd-4f58-a2ea-70d94662f008 req-3ca86e6a-6d79-4bd3-a15b-746f0e0f58f7 service nova] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Refreshing network info cache for port 3e95edf0-c248-41b6-b111-8411047ab446 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:22:31 user nova-compute[74805]: DEBUG nova.compute.manager [req-940c0a4b-d9fb-44cf-8939-99a1b15c5c3a req-b8101a6a-9987-4c39-80c4-9ca2b69b24a0 service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Received event network-vif-plugged-90a9632d-7041-430e-a0f4-0b8ec60eb332 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:22:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-940c0a4b-d9fb-44cf-8939-99a1b15c5c3a req-b8101a6a-9987-4c39-80c4-9ca2b69b24a0 service nova] Acquiring lock "4a2d5475-04a4-414d-9ce9-d5204494f898-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-940c0a4b-d9fb-44cf-8939-99a1b15c5c3a req-b8101a6a-9987-4c39-80c4-9ca2b69b24a0 service nova] Lock "4a2d5475-04a4-414d-9ce9-d5204494f898-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-940c0a4b-d9fb-44cf-8939-99a1b15c5c3a req-b8101a6a-9987-4c39-80c4-9ca2b69b24a0 service nova] Lock "4a2d5475-04a4-414d-9ce9-d5204494f898-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:31 user nova-compute[74805]: DEBUG nova.compute.manager [req-940c0a4b-d9fb-44cf-8939-99a1b15c5c3a req-b8101a6a-9987-4c39-80c4-9ca2b69b24a0 service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] No waiting events found dispatching network-vif-plugged-90a9632d-7041-430e-a0f4-0b8ec60eb332 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:22:31 user nova-compute[74805]: WARNING nova.compute.manager [req-940c0a4b-d9fb-44cf-8939-99a1b15c5c3a req-b8101a6a-9987-4c39-80c4-9ca2b69b24a0 service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Received unexpected event network-vif-plugged-90a9632d-7041-430e-a0f4-0b8ec60eb332 for instance with vm_state building and task_state spawning.
Nov 15 04:22:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:32 user nova-compute[74805]: DEBUG nova.network.neutron [req-b9a380ef-59fd-4f58-a2ea-70d94662f008 req-3ca86e6a-6d79-4bd3-a15b-746f0e0f58f7 service nova] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Updated VIF entry in instance network info cache for port 3e95edf0-c248-41b6-b111-8411047ab446. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:22:32 user nova-compute[74805]: DEBUG nova.network.neutron [req-b9a380ef-59fd-4f58-a2ea-70d94662f008 req-3ca86e6a-6d79-4bd3-a15b-746f0e0f58f7 service nova] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Updating instance_info_cache with network_info: [{"id": "3e95edf0-c248-41b6-b111-8411047ab446", "address": "fa:16:3e:a0:c7:07", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e95edf0-c2", "ovs_interfaceid": "3e95edf0-c248-41b6-b111-8411047ab446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:22:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b9a380ef-59fd-4f58-a2ea-70d94662f008 req-3ca86e6a-6d79-4bd3-a15b-746f0e0f58f7 service nova] Releasing lock "refresh_cache-13449149-a938-41ff-964f-16f96614bf3e" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:22:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "13449149-a938-41ff-964f-16f96614bf3e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "13449149-a938-41ff-964f-16f96614bf3e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:32 user nova-compute[74805]: DEBUG nova.objects.instance [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lazy-loading 'flavor' on Instance uuid 13449149-a938-41ff-964f-16f96614bf3e {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "13449149-a938-41ff-964f-16f96614bf3e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "13449149-a938-41ff-964f-16f96614bf3e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "13449149-a938-41ff-964f-16f96614bf3e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:33 user nova-compute[74805]: INFO nova.compute.manager [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Attaching volume 07893542-f9ab-4a1d-b5f3-c6ef73a53132 to /dev/vdb
Nov 15 04:22:33 user nova-compute[74805]: DEBUG os_brick.utils [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b72148-c396-4dac-b32f-b2f41bfe2254]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e0bd7f-e4c7-4d6e-825f-3ee292467d95]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb4a5f7-c289-4019-81dd-265e9c5104b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a638f65-1d0f-4e56-9074-d3ba57d0e287]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:22:33 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:22:33 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[80becc4c-c770-40d6-bc1c-76e26d0a840e]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG os_brick.utils [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Updating existing volume attachment record: 26fd3eab-757e-4a1d-ae20-10b4273c4c6b {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG nova.compute.manager [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:22:33 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Instance spawned successfully.
Nov 15 04:22:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:22:33 user nova-compute[74805]: INFO nova.compute.manager [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Took 5.56 seconds to spawn the instance on the hypervisor.
Nov 15 04:22:33 user nova-compute[74805]: DEBUG nova.compute.manager [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:22:33 user nova-compute[74805]: INFO nova.compute.manager [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Took 6.37 seconds to build instance.
Nov 15 04:22:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5cbf8bb6-201a-4069-ad6f-a3f894aadce1 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "4a2d5475-04a4-414d-9ce9-d5204494f898" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.512s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG nova.compute.manager [req-bd2fb324-cd3c-4a01-8e41-08f71a2f82a8 req-f6b6b640-0337-41e4-a8c7-650863e5aa27 service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Received event network-vif-plugged-90a9632d-7041-430e-a0f4-0b8ec60eb332 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bd2fb324-cd3c-4a01-8e41-08f71a2f82a8 req-f6b6b640-0337-41e4-a8c7-650863e5aa27 service nova] Acquiring lock "4a2d5475-04a4-414d-9ce9-d5204494f898-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bd2fb324-cd3c-4a01-8e41-08f71a2f82a8 req-f6b6b640-0337-41e4-a8c7-650863e5aa27 service nova] Lock "4a2d5475-04a4-414d-9ce9-d5204494f898-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bd2fb324-cd3c-4a01-8e41-08f71a2f82a8 req-f6b6b640-0337-41e4-a8c7-650863e5aa27 service nova] Lock "4a2d5475-04a4-414d-9ce9-d5204494f898-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:33 user nova-compute[74805]: DEBUG nova.compute.manager [req-bd2fb324-cd3c-4a01-8e41-08f71a2f82a8 req-f6b6b640-0337-41e4-a8c7-650863e5aa27 service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] No waiting events found dispatching network-vif-plugged-90a9632d-7041-430e-a0f4-0b8ec60eb332 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:22:33 user nova-compute[74805]: WARNING nova.compute.manager [req-bd2fb324-cd3c-4a01-8e41-08f71a2f82a8 req-f6b6b640-0337-41e4-a8c7-650863e5aa27 service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Received unexpected event network-vif-plugged-90a9632d-7041-430e-a0f4-0b8ec60eb332 for instance with vm_state active and task_state None.
Nov 15 04:22:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RzKhkgqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:22:40 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:22:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:22:40 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:22:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:22:40 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56c2c29-f0e4-4ffa-89ae-bbfb27a5f6ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:22:40 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc68cb19-0125-4bd2-962a-55092cf749e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132] added
Nov 15 04:22:40 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8318ad0-ae47-487f-98a2-094c1a12d7e4]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4206e4-7403-401d-9a9f-56c4bd7b265c]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RzKhkgqB {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RzKhkgqB" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cef00d-f961-4619-b553-b673250077c3]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RzKhkgqB'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0c22ba-3d49-403c-afc2-74dd408232a1]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cc9578-bba5-457b-9f86-51d4a37346f2]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:22:40 user nova-compute[74805]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:22:40 user nova-compute[74805]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:22:40 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:22:40 user nova-compute[74805]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:22:40 user nova-compute[74805]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:22:40 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d1d7ab-9d00-48fe-a3eb-25649e67455a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132, portal: 172.16.0.220,3260]
Nov 15 04:22:40 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132, portal: 172.16.0.220,3260] successful.
Nov 15 04:22:40 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbb13bd-3929-4895-b98b-0f9e453dd468]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a09d03-5073-4659-9ef6-4451d8ad5dcf]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:22:40 user nova-compute[74805]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:22:40 user nova-compute[74805]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:22:40 user nova-compute[74805]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 (non-flash)
Nov 15 04:22:40 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:22:40 user nova-compute[74805]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:22:40 user nova-compute[74805]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:22:40 user nova-compute[74805]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 (non-flash)
Nov 15 04:22:40 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22f7dd9-9213-4ce6-b3d1-1e054985bf6e]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:22:40 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: None {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:22:41 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:22:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RzKhkgqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:22:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:22:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '26137396339633463', 'path': '/dev/sde'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:22:41 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137396339633463', 'path': '/dev/sde'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:22:41 user nova-compute[74805]: DEBUG nova.objects.instance [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lazy-loading 'flavor' on Instance uuid 13449149-a938-41ff-964f-16f96614bf3e {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:22:41 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:22:41 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:22:41 user nova-compute[74805]:   <source dev="/dev/sde"/>
Nov 15 04:22:41 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:22:41 user nova-compute[74805]:   <serial>07893542-f9ab-4a1d-b5f3-c6ef73a53132</serial>
Nov 15 04:22:41 user nova-compute[74805]: </disk>
Nov 15 04:22:41 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:22:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:22:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:22:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] No VIF found with MAC fa:16:3e:a0:c7:07, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:22:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2bfd4fd8-2ea0-4099-b214-639cff40a28f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "13449149-a938-41ff-964f-16f96614bf3e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.327s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "13449149-a938-41ff-964f-16f96614bf3e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "13449149-a938-41ff-964f-16f96614bf3e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:43 user nova-compute[74805]: INFO nova.compute.manager [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Detaching volume 07893542-f9ab-4a1d-b5f3-c6ef73a53132
Nov 15 04:22:43 user nova-compute[74805]: INFO nova.virt.block_device [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Attempting to driver detach volume 07893542-f9ab-4a1d-b5f3-c6ef73a53132 from mountpoint /dev/vdb
Nov 15 04:22:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Attempting to detach device vdb from instance 13449149-a938-41ff-964f-16f96614bf3e from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:22:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:22:43 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:22:43 user nova-compute[74805]:   <source dev="/dev/sde"/>
Nov 15 04:22:43 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:22:43 user nova-compute[74805]:   <serial>07893542-f9ab-4a1d-b5f3-c6ef73a53132</serial>
Nov 15 04:22:43 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:22:43 user nova-compute[74805]: </disk>
Nov 15 04:22:43 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:22:43 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Successfully detached device vdb from instance 13449149-a938-41ff-964f-16f96614bf3e from the persistent domain config.
Nov 15 04:22:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 13449149-a938-41ff-964f-16f96614bf3e from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:22:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:22:43 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:22:43 user nova-compute[74805]:   <source dev="/dev/sde"/>
Nov 15 04:22:43 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:22:43 user nova-compute[74805]:   <serial>07893542-f9ab-4a1d-b5f3-c6ef73a53132</serial>
Nov 15 04:22:43 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:22:43 user nova-compute[74805]: </disk>
Nov 15 04:22:43 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:22:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 13449149-a938-41ff-964f-16f96614bf3e {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:22:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a47229c5-70f6-4f33-942d-bda5ef5aba72 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Acquiring lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a47229c5-70f6-4f33-942d-bda5ef5aba72 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a47229c5-70f6-4f33-942d-bda5ef5aba72 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Acquiring lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a47229c5-70f6-4f33-942d-bda5ef5aba72 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a47229c5-70f6-4f33-942d-bda5ef5aba72 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:44 user nova-compute[74805]: INFO nova.compute.manager [None req-a47229c5-70f6-4f33-942d-bda5ef5aba72 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Terminating instance
Nov 15 04:22:44 user nova-compute[74805]: DEBUG nova.compute.manager [None req-a47229c5-70f6-4f33-942d-bda5ef5aba72 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:22:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-50efc66f-cd2e-4529-9f73-e81417136ff0 req-60012bc6-bdc7-4869-8ecc-7ecf56ffd367 service nova] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Received event network-vif-unplugged-29f069d7-6837-470c-a8b7-5cb6225bba4e {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-50efc66f-cd2e-4529-9f73-e81417136ff0 req-60012bc6-bdc7-4869-8ecc-7ecf56ffd367 service nova] Acquiring lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-50efc66f-cd2e-4529-9f73-e81417136ff0 req-60012bc6-bdc7-4869-8ecc-7ecf56ffd367 service nova] Lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-50efc66f-cd2e-4529-9f73-e81417136ff0 req-60012bc6-bdc7-4869-8ecc-7ecf56ffd367 service nova] Lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-50efc66f-cd2e-4529-9f73-e81417136ff0 req-60012bc6-bdc7-4869-8ecc-7ecf56ffd367 service nova] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] No waiting events found dispatching network-vif-unplugged-29f069d7-6837-470c-a8b7-5cb6225bba4e {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-50efc66f-cd2e-4529-9f73-e81417136ff0 req-60012bc6-bdc7-4869-8ecc-7ecf56ffd367 service nova] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Received event network-vif-unplugged-29f069d7-6837-470c-a8b7-5cb6225bba4e for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:45 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Instance destroyed successfully.
Nov 15 04:22:45 user nova-compute[74805]: DEBUG nova.objects.instance [None req-a47229c5-70f6-4f33-942d-bda5ef5aba72 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lazy-loading 'resources' on Instance uuid 2b1e540c-6226-445a-bd45-5b7b8807e2b9 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-a47229c5-70f6-4f33-942d-bda5ef5aba72 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-470413441',display_name='tempest-ServersNegativeTestJSON-server-470413441',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-470413441',id=1,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:14:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18dc7dbc597f4befb565dcff5a92db74',ramdisk_id='',reservation_id='r-yao67dn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2049948325',owner_user_name='tempest-ServersNegativeTestJSON-2049948325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:14:24Z,user_data=None,user_id='6db3bb1be1914a19afb67cac89f0a35e',uuid=2b1e540c-6226-445a-bd45-5b7b8807e2b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29f069d7-6837-470c-a8b7-5cb6225bba4e", "address": "fa:16:3e:d3:55:85", "network": {"id": "d6c12b22-58d0-4d38-aa41-0e08de44bb3a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1369824742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dc7dbc597f4befb565dcff5a92db74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f069d7-68", "ovs_interfaceid": "29f069d7-6837-470c-a8b7-5cb6225bba4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-a47229c5-70f6-4f33-942d-bda5ef5aba72 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Converting VIF {"id": "29f069d7-6837-470c-a8b7-5cb6225bba4e", "address": "fa:16:3e:d3:55:85", "network": {"id": "d6c12b22-58d0-4d38-aa41-0e08de44bb3a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1369824742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dc7dbc597f4befb565dcff5a92db74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f069d7-68", "ovs_interfaceid": "29f069d7-6837-470c-a8b7-5cb6225bba4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-a47229c5-70f6-4f33-942d-bda5ef5aba72 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:55:85,bridge_name='br-int',has_traffic_filtering=True,id=29f069d7-6837-470c-a8b7-5cb6225bba4e,network=Network(d6c12b22-58d0-4d38-aa41-0e08de44bb3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29f069d7-68') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG os_vif [None req-a47229c5-70f6-4f33-942d-bda5ef5aba72 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:55:85,bridge_name='br-int',has_traffic_filtering=True,id=29f069d7-6837-470c-a8b7-5cb6225bba4e,network=Network(d6c12b22-58d0-4d38-aa41-0e08de44bb3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29f069d7-68') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29f069d7-68, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af68ec31-2348-46da-b077-73f94d37ab13) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:22:45 user nova-compute[74805]: INFO os_vif [None req-a47229c5-70f6-4f33-942d-bda5ef5aba72 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:55:85,bridge_name='br-int',has_traffic_filtering=True,id=29f069d7-6837-470c-a8b7-5cb6225bba4e,network=Network(d6c12b22-58d0-4d38-aa41-0e08de44bb3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29f069d7-68')
Nov 15 04:22:45 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-a47229c5-70f6-4f33-942d-bda5ef5aba72 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Deleting instance files /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9_del
Nov 15 04:22:45 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-a47229c5-70f6-4f33-942d-bda5ef5aba72 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Deletion of /opt/stack/data/nova/instances/2b1e540c-6226-445a-bd45-5b7b8807e2b9_del complete
Nov 15 04:22:45 user nova-compute[74805]: INFO nova.compute.manager [None req-a47229c5-70f6-4f33-942d-bda5ef5aba72 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 15 04:22:45 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-a47229c5-70f6-4f33-942d-bda5ef5aba72 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:22:45 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:22:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquiring lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquiring lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:46 user nova-compute[74805]: INFO nova.compute.manager [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Terminating instance
Nov 15 04:22:46 user nova-compute[74805]: DEBUG nova.compute.manager [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:22:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:47 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Instance destroyed successfully.
Nov 15 04:22:47 user nova-compute[74805]: DEBUG nova.objects.instance [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lazy-loading 'resources' on Instance uuid 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2010307012',display_name='tempest-ServerActionsTestOtherB-server-2010307012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2010307012',id=3,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN2t8TNG6ZVHF/Uf5V+OtupNhI5/tplcqGEarq2oKWoGX9vvIofLCSj5BmzwvNfOMIgQ6qY6HA1c0ScmczPixk4TIDvFHJbrnEyQ0asmj0Ggpy7B5hD2wopJrs+94VPUA==',key_name='tempest-keypair-149654948',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:20:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e12b863b6ed49f3a03f95c105881e5e',ramdisk_id='',reservation_id='r-zfce7v2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-997020636',owner_user_name='tempest-ServerActionsTestOtherB-997020636-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:20:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6253a7981e834ef4979d177a04e8eaf8',uuid=39ab9e2c-5856-4fe6-aa2c-42f9ac52632c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Converting VIF {"id": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "address": "fa:16:3e:28:e7:d1", "network": {"id": "90f83e19-1c70-437a-9f75-cbbca516eb51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-954710649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e12b863b6ed49f3a03f95c105881e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdff360-1f", "ovs_interfaceid": "2bdff360-1f21-4ce8-9c04-a5115a3316b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:e7:d1,bridge_name='br-int',has_traffic_filtering=True,id=2bdff360-1f21-4ce8-9c04-a5115a3316b2,network=Network(90f83e19-1c70-437a-9f75-cbbca516eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdff360-1f') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG os_vif [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:e7:d1,bridge_name='br-int',has_traffic_filtering=True,id=2bdff360-1f21-4ce8-9c04-a5115a3316b2,network=Network(90f83e19-1c70-437a-9f75-cbbca516eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdff360-1f') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2bdff360-1f, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=229f4f20-3b86-44a6-9fef-d0b702f243c2) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:47 user nova-compute[74805]: INFO os_vif [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:e7:d1,bridge_name='br-int',has_traffic_filtering=True,id=2bdff360-1f21-4ce8-9c04-a5115a3316b2,network=Network(90f83e19-1c70-437a-9f75-cbbca516eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdff360-1f')
Nov 15 04:22:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'biAZqcTu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:22:47 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:22:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a27e2c-8945-45ea-bd15-123284746377]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:22:47 user nova-compute[74805]: No targets found.
Nov 15 04:22:47 user nova-compute[74805]: iSNS:
Nov 15 04:22:47 user nova-compute[74805]: No targets found.
Nov 15 04:22:47 user nova-compute[74805]: STATIC:
Nov 15 04:22:47 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4
Nov 15 04:22:47 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:22:47 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:22:47 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7
Nov 15 04:22:47 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:22:47 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:22:47 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132
Nov 15 04:22:47 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:22:47 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:22:47 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf
Nov 15 04:22:47 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:22:47 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:22:47 user nova-compute[74805]: FIRMWARE:
Nov 15 04:22:47 user nova-compute[74805]: No targets found.
Nov 15 04:22:47 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:22:47 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:22:47 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:22:47 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Took 1.39 seconds to deallocate network for instance.
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fa9583-e23e-4e77-b8d6-9cd32c539861]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c0a2b7-3dff-4dc8-aa7d-66b2b43fddcd]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:22:47 user nova-compute[74805]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:22:47 user nova-compute[74805]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:22:47 user nova-compute[74805]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 (non-flash)
Nov 15 04:22:47 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 (non-flash)
Nov 15 04:22:47 user nova-compute[74805]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:22:47 user nova-compute[74805]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:22:47 user nova-compute[74805]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 (non-flash)
Nov 15 04:22:47 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c69d2d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4'): ({'sdb'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Removing single pathed devices sdb {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a47229c5-70f6-4f33-942d-bda5ef5aba72 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a47229c5-70f6-4f33-942d-bda5ef5aba72 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bbf2d0-a815-4d55-943a-77aea2aa573b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4378b901-2db5-4627-be33-d37d0d9f047c]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Flushing IO for device /dev/sdb {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.029s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[24585ea9-b73c-4201-9f38-826fb18533ca]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG nova.compute.manager [req-2030f2c2-ff33-401b-8283-4bbf0c36f3d5 req-504c7b42-9c1d-4780-b965-fed451ea0ac4 service nova] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Received event network-vif-plugged-29f069d7-6837-470c-a8b7-5cb6225bba4e {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2030f2c2-ff33-401b-8283-4bbf0c36f3d5 req-504c7b42-9c1d-4780-b965-fed451ea0ac4 service nova] Acquiring lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2030f2c2-ff33-401b-8283-4bbf0c36f3d5 req-504c7b42-9c1d-4780-b965-fed451ea0ac4 service nova] Lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2030f2c2-ff33-401b-8283-4bbf0c36f3d5 req-504c7b42-9c1d-4780-b965-fed451ea0ac4 service nova] Lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG nova.compute.manager [req-2030f2c2-ff33-401b-8283-4bbf0c36f3d5 req-504c7b42-9c1d-4780-b965-fed451ea0ac4 service nova] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] No waiting events found dispatching network-vif-plugged-29f069d7-6837-470c-a8b7-5cb6225bba4e {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:22:47 user nova-compute[74805]: WARNING nova.compute.manager [req-2030f2c2-ff33-401b-8283-4bbf0c36f3d5 req-504c7b42-9c1d-4780-b965-fed451ea0ac4 service nova] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Received unexpected event network-vif-plugged-29f069d7-6837-470c-a8b7-5cb6225bba4e for instance with vm_state deleted and task_state None.
Nov 15 04:22:47 user nova-compute[74805]: DEBUG nova.compute.manager [req-2030f2c2-ff33-401b-8283-4bbf0c36f3d5 req-504c7b42-9c1d-4780-b965-fed451ea0ac4 service nova] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Received event network-vif-plugged-29f069d7-6837-470c-a8b7-5cb6225bba4e {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2030f2c2-ff33-401b-8283-4bbf0c36f3d5 req-504c7b42-9c1d-4780-b965-fed451ea0ac4 service nova] Acquiring lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2030f2c2-ff33-401b-8283-4bbf0c36f3d5 req-504c7b42-9c1d-4780-b965-fed451ea0ac4 service nova] Lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2030f2c2-ff33-401b-8283-4bbf0c36f3d5 req-504c7b42-9c1d-4780-b965-fed451ea0ac4 service nova] Lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG nova.compute.manager [req-2030f2c2-ff33-401b-8283-4bbf0c36f3d5 req-504c7b42-9c1d-4780-b965-fed451ea0ac4 service nova] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] No waiting events found dispatching network-vif-plugged-29f069d7-6837-470c-a8b7-5cb6225bba4e {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:22:47 user nova-compute[74805]: WARNING nova.compute.manager [req-2030f2c2-ff33-401b-8283-4bbf0c36f3d5 req-504c7b42-9c1d-4780-b965-fed451ea0ac4 service nova] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Received unexpected event network-vif-plugged-29f069d7-6837-470c-a8b7-5cb6225bba4e for instance with vm_state deleted and task_state None.
Nov 15 04:22:47 user nova-compute[74805]: DEBUG nova.compute.manager [req-2030f2c2-ff33-401b-8283-4bbf0c36f3d5 req-504c7b42-9c1d-4780-b965-fed451ea0ac4 service nova] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Received event network-vif-plugged-29f069d7-6837-470c-a8b7-5cb6225bba4e {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2030f2c2-ff33-401b-8283-4bbf0c36f3d5 req-504c7b42-9c1d-4780-b965-fed451ea0ac4 service nova] Acquiring lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2030f2c2-ff33-401b-8283-4bbf0c36f3d5 req-504c7b42-9c1d-4780-b965-fed451ea0ac4 service nova] Lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2030f2c2-ff33-401b-8283-4bbf0c36f3d5 req-504c7b42-9c1d-4780-b965-fed451ea0ac4 service nova] Lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG nova.compute.manager [req-2030f2c2-ff33-401b-8283-4bbf0c36f3d5 req-504c7b42-9c1d-4780-b965-fed451ea0ac4 service nova] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] No waiting events found dispatching network-vif-plugged-29f069d7-6837-470c-a8b7-5cb6225bba4e {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:22:47 user nova-compute[74805]: WARNING nova.compute.manager [req-2030f2c2-ff33-401b-8283-4bbf0c36f3d5 req-504c7b42-9c1d-4780-b965-fed451ea0ac4 service nova] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Received unexpected event network-vif-plugged-29f069d7-6837-470c-a8b7-5cb6225bba4e for instance with vm_state deleted and task_state None.
Nov 15 04:22:47 user nova-compute[74805]: DEBUG nova.compute.manager [req-2030f2c2-ff33-401b-8283-4bbf0c36f3d5 req-504c7b42-9c1d-4780-b965-fed451ea0ac4 service nova] [instance: 2b1e540c-6226-445a-bd45-5b7b8807e2b9] Received event network-vif-deleted-29f069d7-6837-470c-a8b7-5cb6225bba4e {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG nova.compute.manager [req-2030f2c2-ff33-401b-8283-4bbf0c36f3d5 req-504c7b42-9c1d-4780-b965-fed451ea0ac4 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Received event network-vif-unplugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2030f2c2-ff33-401b-8283-4bbf0c36f3d5 req-504c7b42-9c1d-4780-b965-fed451ea0ac4 service nova] Acquiring lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2030f2c2-ff33-401b-8283-4bbf0c36f3d5 req-504c7b42-9c1d-4780-b965-fed451ea0ac4 service nova] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2030f2c2-ff33-401b-8283-4bbf0c36f3d5 req-504c7b42-9c1d-4780-b965-fed451ea0ac4 service nova] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG nova.compute.manager [req-2030f2c2-ff33-401b-8283-4bbf0c36f3d5 req-504c7b42-9c1d-4780-b965-fed451ea0ac4 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] No waiting events found dispatching network-vif-unplugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG nova.compute.manager [req-2030f2c2-ff33-401b-8283-4bbf0c36f3d5 req-504c7b42-9c1d-4780-b965-fed451ea0ac4 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Received event network-vif-unplugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b263be26-9194-496d-bf81-beb97d1a0fea]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f80ab9-e633-43bc-b137-862c82a70570]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a8411f-290b-4233-a8fb-650e5e69787c]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4, portal: 172.16.0.220,3260]
Nov 15 04:22:47 user nova-compute[74805]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4, portal: 172.16.0.220,3260] successful.
Nov 15 04:22:47 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3112d5-dcc8-4e6d-9601-30bc0d3243c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8ec765-14e7-4b8a-b816-ebf9c6fd41d6]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] <== disconnect_volume: return (378ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:22:47 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Deleting instance files /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c_del
Nov 15 04:22:47 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Deletion of /opt/stack/data/nova/instances/39ab9e2c-5856-4fe6-aa2c-42f9ac52632c_del complete
Nov 15 04:22:47 user nova-compute[74805]: INFO nova.compute.manager [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-a47229c5-70f6-4f33-942d-bda5ef5aba72 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-a47229c5-70f6-4f33-942d-bda5ef5aba72 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a47229c5-70f6-4f33-942d-bda5ef5aba72 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.463s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:47 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-a47229c5-70f6-4f33-942d-bda5ef5aba72 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Deleted allocations for instance 2b1e540c-6226-445a-bd45-5b7b8807e2b9
Nov 15 04:22:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a47229c5-70f6-4f33-942d-bda5ef5aba72 tempest-ServersNegativeTestJSON-2049948325 tempest-ServersNegativeTestJSON-2049948325-project-member] Lock "2b1e540c-6226-445a-bd45-5b7b8807e2b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.040s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:48 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:22:48 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Took 1.27 seconds to deallocate network for instance.
Nov 15 04:22:49 user nova-compute[74805]: DEBUG nova.compute.manager [req-d6dd99e6-7ee2-44a6-9027-7e9583cce3ee req-347ccecc-b1f9-4fc5-82cd-6528489c2042 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Received event network-vif-plugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:22:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d6dd99e6-7ee2-44a6-9027-7e9583cce3ee req-347ccecc-b1f9-4fc5-82cd-6528489c2042 service nova] Acquiring lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d6dd99e6-7ee2-44a6-9027-7e9583cce3ee req-347ccecc-b1f9-4fc5-82cd-6528489c2042 service nova] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d6dd99e6-7ee2-44a6-9027-7e9583cce3ee req-347ccecc-b1f9-4fc5-82cd-6528489c2042 service nova] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:49 user nova-compute[74805]: DEBUG nova.compute.manager [req-d6dd99e6-7ee2-44a6-9027-7e9583cce3ee req-347ccecc-b1f9-4fc5-82cd-6528489c2042 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] No waiting events found dispatching network-vif-plugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:22:49 user nova-compute[74805]: WARNING nova.compute.manager [req-d6dd99e6-7ee2-44a6-9027-7e9583cce3ee req-347ccecc-b1f9-4fc5-82cd-6528489c2042 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Received unexpected event network-vif-plugged-2bdff360-1f21-4ce8-9c04-a5115a3316b2 for instance with vm_state active and task_state deleting.
Nov 15 04:22:49 user nova-compute[74805]: DEBUG nova.compute.manager [req-d6dd99e6-7ee2-44a6-9027-7e9583cce3ee req-347ccecc-b1f9-4fc5-82cd-6528489c2042 service nova] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Received event network-vif-deleted-2bdff360-1f21-4ce8-9c04-a5115a3316b2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:22:49 user nova-compute[74805]: INFO nova.compute.manager [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] [instance: 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c] Took 0.81 seconds to detach 1 volumes for instance.
Nov 15 04:22:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:50 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:22:50 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:22:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:50 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Deleted allocations for instance 39ab9e2c-5856-4fe6-aa2c-42f9ac52632c
Nov 15 04:22:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9442f1b8-b581-46d2-b92e-f674ee3e4a81 tempest-ServerActionsTestOtherB-997020636 tempest-ServerActionsTestOtherB-997020636-project-member] Lock "39ab9e2c-5856-4fe6-aa2c-42f9ac52632c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.057s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "51e0a627-f95e-4347-92a7-4a218413e884" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "51e0a627-f95e-4347-92a7-4a218413e884" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:51 user nova-compute[74805]: INFO nova.compute.manager [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Detaching volume c514702d-74f1-4d8a-892b-2b6750ac4eaf
Nov 15 04:22:51 user nova-compute[74805]: INFO nova.virt.block_device [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Attempting to driver detach volume c514702d-74f1-4d8a-892b-2b6750ac4eaf from mountpoint /dev/vdb
Nov 15 04:22:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Attempting to detach device vdb from instance 51e0a627-f95e-4347-92a7-4a218413e884 from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:22:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:22:51 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:22:51 user nova-compute[74805]:   <source dev="/dev/sdc"/>
Nov 15 04:22:51 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:22:51 user nova-compute[74805]:   <serial>c514702d-74f1-4d8a-892b-2b6750ac4eaf</serial>
Nov 15 04:22:51 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 04:22:51 user nova-compute[74805]: </disk>
Nov 15 04:22:51 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:22:51 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Successfully detached device vdb from instance 51e0a627-f95e-4347-92a7-4a218413e884 from the persistent domain config.
Nov 15 04:22:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 51e0a627-f95e-4347-92a7-4a218413e884 from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:22:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:22:51 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:22:51 user nova-compute[74805]:   <source dev="/dev/sdc"/>
Nov 15 04:22:51 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:22:51 user nova-compute[74805]:   <serial>c514702d-74f1-4d8a-892b-2b6750ac4eaf</serial>
Nov 15 04:22:51 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 04:22:51 user nova-compute[74805]: </disk>
Nov 15 04:22:51 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:22:52 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 51e0a627-f95e-4347-92a7-4a218413e884 {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:22:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3aceedeb-fbc2-443e-90e5-5cbc74e7b832 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Acquiring lock "b3800420-c3dd-4c51-a500-e405031e9a34" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3aceedeb-fbc2-443e-90e5-5cbc74e7b832 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "b3800420-c3dd-4c51-a500-e405031e9a34" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3aceedeb-fbc2-443e-90e5-5cbc74e7b832 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Acquiring lock "b3800420-c3dd-4c51-a500-e405031e9a34-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3aceedeb-fbc2-443e-90e5-5cbc74e7b832 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "b3800420-c3dd-4c51-a500-e405031e9a34-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3aceedeb-fbc2-443e-90e5-5cbc74e7b832 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "b3800420-c3dd-4c51-a500-e405031e9a34-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:55 user nova-compute[74805]: INFO nova.compute.manager [None req-3aceedeb-fbc2-443e-90e5-5cbc74e7b832 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Terminating instance
Nov 15 04:22:55 user nova-compute[74805]: DEBUG nova.compute.manager [None req-3aceedeb-fbc2-443e-90e5-5cbc74e7b832 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG nova.compute.manager [req-d0e14bfb-0f0f-43a2-bc7d-cc4a7a0836f8 req-0410f64f-9e17-4b0c-a3a2-3a14300bb910 service nova] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Received event network-vif-unplugged-da918dfb-1b07-46d1-80a1-d2dac424f931 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d0e14bfb-0f0f-43a2-bc7d-cc4a7a0836f8 req-0410f64f-9e17-4b0c-a3a2-3a14300bb910 service nova] Acquiring lock "b3800420-c3dd-4c51-a500-e405031e9a34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d0e14bfb-0f0f-43a2-bc7d-cc4a7a0836f8 req-0410f64f-9e17-4b0c-a3a2-3a14300bb910 service nova] Lock "b3800420-c3dd-4c51-a500-e405031e9a34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d0e14bfb-0f0f-43a2-bc7d-cc4a7a0836f8 req-0410f64f-9e17-4b0c-a3a2-3a14300bb910 service nova] Lock "b3800420-c3dd-4c51-a500-e405031e9a34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG nova.compute.manager [req-d0e14bfb-0f0f-43a2-bc7d-cc4a7a0836f8 req-0410f64f-9e17-4b0c-a3a2-3a14300bb910 service nova] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] No waiting events found dispatching network-vif-unplugged-da918dfb-1b07-46d1-80a1-d2dac424f931 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG nova.compute.manager [req-d0e14bfb-0f0f-43a2-bc7d-cc4a7a0836f8 req-0410f64f-9e17-4b0c-a3a2-3a14300bb910 service nova] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Received event network-vif-unplugged-da918dfb-1b07-46d1-80a1-d2dac424f931 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:22:55 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Instance destroyed successfully.
Nov 15 04:22:55 user nova-compute[74805]: DEBUG nova.objects.instance [None req-3aceedeb-fbc2-443e-90e5-5cbc74e7b832 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lazy-loading 'resources' on Instance uuid b3800420-c3dd-4c51-a500-e405031e9a34 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-3aceedeb-fbc2-443e-90e5-5cbc74e7b832 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-23575556',display_name='tempest-VolumesActionsTest-instance-23575556',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-23575556',id=22,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:21:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87c33c44f366409bbb2007dc83cc520a',ramdisk_id='',reservation_id='r-mwu3zxn6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1048271835',owner_user_name='tempest-VolumesActionsTest-1048271835-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:21:12Z,user_data=None,user_id='d93268af3cc4492bbdc20d26ad09cacc',uuid=b3800420-c3dd-4c51-a500-e405031e9a34,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da918dfb-1b07-46d1-80a1-d2dac424f931", "address": "fa:16:3e:33:1b:31", "network": {"id": "9094d1cf-3e56-409a-9fec-dfc97741820d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1184254201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c33c44f366409bbb2007dc83cc520a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda918dfb-1b", "ovs_interfaceid": "da918dfb-1b07-46d1-80a1-d2dac424f931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3aceedeb-fbc2-443e-90e5-5cbc74e7b832 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Converting VIF {"id": "da918dfb-1b07-46d1-80a1-d2dac424f931", "address": "fa:16:3e:33:1b:31", "network": {"id": "9094d1cf-3e56-409a-9fec-dfc97741820d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1184254201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87c33c44f366409bbb2007dc83cc520a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda918dfb-1b", "ovs_interfaceid": "da918dfb-1b07-46d1-80a1-d2dac424f931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3aceedeb-fbc2-443e-90e5-5cbc74e7b832 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:1b:31,bridge_name='br-int',has_traffic_filtering=True,id=da918dfb-1b07-46d1-80a1-d2dac424f931,network=Network(9094d1cf-3e56-409a-9fec-dfc97741820d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda918dfb-1b') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG os_vif [None req-3aceedeb-fbc2-443e-90e5-5cbc74e7b832 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:1b:31,bridge_name='br-int',has_traffic_filtering=True,id=da918dfb-1b07-46d1-80a1-d2dac424f931,network=Network(9094d1cf-3e56-409a-9fec-dfc97741820d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda918dfb-1b') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda918dfb-1b, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e90569ae-8a70-42b5-afff-20fdbfb9b00b) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:55 user nova-compute[74805]: INFO os_vif [None req-3aceedeb-fbc2-443e-90e5-5cbc74e7b832 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:1b:31,bridge_name='br-int',has_traffic_filtering=True,id=da918dfb-1b07-46d1-80a1-d2dac424f931,network=Network(9094d1cf-3e56-409a-9fec-dfc97741820d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda918dfb-1b')
Nov 15 04:22:55 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-3aceedeb-fbc2-443e-90e5-5cbc74e7b832 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Deleting instance files /opt/stack/data/nova/instances/b3800420-c3dd-4c51-a500-e405031e9a34_del
Nov 15 04:22:55 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-3aceedeb-fbc2-443e-90e5-5cbc74e7b832 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Deletion of /opt/stack/data/nova/instances/b3800420-c3dd-4c51-a500-e405031e9a34_del complete
Nov 15 04:22:55 user nova-compute[74805]: INFO nova.compute.manager [None req-3aceedeb-fbc2-443e-90e5-5cbc74e7b832 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 15 04:22:55 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-3aceedeb-fbc2-443e-90e5-5cbc74e7b832 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:22:55 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:22:56 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:22:56 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Took 0.41 seconds to deallocate network for instance.
Nov 15 04:22:56 user nova-compute[74805]: DEBUG nova.compute.manager [req-8d428368-d96a-4786-9262-e66048c02112 req-8518ba37-f4bf-42b8-8d07-0ebe0259b216 service nova] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Received event network-vif-deleted-da918dfb-1b07-46d1-80a1-d2dac424f931 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:22:56 user nova-compute[74805]: INFO nova.compute.manager [req-8d428368-d96a-4786-9262-e66048c02112 req-8518ba37-f4bf-42b8-8d07-0ebe0259b216 service nova] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Neutron deleted interface da918dfb-1b07-46d1-80a1-d2dac424f931; detaching it from the instance and deleting it from the info cache
Nov 15 04:22:56 user nova-compute[74805]: DEBUG nova.network.neutron [req-8d428368-d96a-4786-9262-e66048c02112 req-8518ba37-f4bf-42b8-8d07-0ebe0259b216 service nova] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:22:56 user nova-compute[74805]: DEBUG nova.compute.manager [req-8d428368-d96a-4786-9262-e66048c02112 req-8518ba37-f4bf-42b8-8d07-0ebe0259b216 service nova] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Detach interface failed, port_id=da918dfb-1b07-46d1-80a1-d2dac424f931, reason: Instance b3800420-c3dd-4c51-a500-e405031e9a34 could not be found. {{(pid=74805) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 04:22:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3aceedeb-fbc2-443e-90e5-5cbc74e7b832 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3aceedeb-fbc2-443e-90e5-5cbc74e7b832 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:56 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-3aceedeb-fbc2-443e-90e5-5cbc74e7b832 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:22:56 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-3aceedeb-fbc2-443e-90e5-5cbc74e7b832 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:22:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3aceedeb-fbc2-443e-90e5-5cbc74e7b832 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:56 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-3aceedeb-fbc2-443e-90e5-5cbc74e7b832 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Deleted allocations for instance b3800420-c3dd-4c51-a500-e405031e9a34
Nov 15 04:22:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3aceedeb-fbc2-443e-90e5-5cbc74e7b832 tempest-VolumesActionsTest-1048271835 tempest-VolumesActionsTest-1048271835-project-member] Lock "b3800420-c3dd-4c51-a500-e405031e9a34" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.756s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:57 user nova-compute[74805]: DEBUG nova.compute.manager [req-cc441ff2-abec-48b7-ad94-0ed18e4353bd req-0815ed8d-1e4b-492c-9456-a242f70cd849 service nova] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Received event network-vif-plugged-da918dfb-1b07-46d1-80a1-d2dac424f931 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:22:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-cc441ff2-abec-48b7-ad94-0ed18e4353bd req-0815ed8d-1e4b-492c-9456-a242f70cd849 service nova] Acquiring lock "b3800420-c3dd-4c51-a500-e405031e9a34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-cc441ff2-abec-48b7-ad94-0ed18e4353bd req-0815ed8d-1e4b-492c-9456-a242f70cd849 service nova] Lock "b3800420-c3dd-4c51-a500-e405031e9a34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-cc441ff2-abec-48b7-ad94-0ed18e4353bd req-0815ed8d-1e4b-492c-9456-a242f70cd849 service nova] Lock "b3800420-c3dd-4c51-a500-e405031e9a34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:22:57 user nova-compute[74805]: DEBUG nova.compute.manager [req-cc441ff2-abec-48b7-ad94-0ed18e4353bd req-0815ed8d-1e4b-492c-9456-a242f70cd849 service nova] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] No waiting events found dispatching network-vif-plugged-da918dfb-1b07-46d1-80a1-d2dac424f931 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:22:57 user nova-compute[74805]: WARNING nova.compute.manager [req-cc441ff2-abec-48b7-ad94-0ed18e4353bd req-0815ed8d-1e4b-492c-9456-a242f70cd849 service nova] [instance: b3800420-c3dd-4c51-a500-e405031e9a34] Received unexpected event network-vif-plugged-da918dfb-1b07-46d1-80a1-d2dac424f931 for instance with vm_state deleted and task_state None.
Nov 15 04:22:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:22:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "e5004557-00fa-4824-9233-343c2261588d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:22:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "e5004557-00fa-4824-9233-343c2261588d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:22:58 user nova-compute[74805]: INFO nova.compute.manager [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Detaching volume 944e52fb-ec1c-4673-a146-945688c4c4d7
Nov 15 04:22:58 user nova-compute[74805]: INFO nova.virt.block_device [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Attempting to driver detach volume 944e52fb-ec1c-4673-a146-945688c4c4d7 from mountpoint /dev/vdb
Nov 15 04:22:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Attempting to detach device vdb from instance e5004557-00fa-4824-9233-343c2261588d from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:22:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:22:58 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:22:58 user nova-compute[74805]:   <source dev="/dev/sdd"/>
Nov 15 04:22:58 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:22:58 user nova-compute[74805]:   <serial>944e52fb-ec1c-4673-a146-945688c4c4d7</serial>
Nov 15 04:22:58 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 04:22:58 user nova-compute[74805]: </disk>
Nov 15 04:22:58 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:22:58 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Successfully detached device vdb from instance e5004557-00fa-4824-9233-343c2261588d from the persistent domain config.
Nov 15 04:22:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e5004557-00fa-4824-9233-343c2261588d from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:22:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:22:58 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:22:58 user nova-compute[74805]:   <source dev="/dev/sdd"/>
Nov 15 04:22:58 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:22:58 user nova-compute[74805]:   <serial>944e52fb-ec1c-4673-a146-945688c4c4d7</serial>
Nov 15 04:22:58 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 04:22:58 user nova-compute[74805]: </disk>
Nov 15 04:22:58 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:22:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e5004557-00fa-4824-9233-343c2261588d {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:23:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:03 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 13449149-a938-41ff-964f-16f96614bf3e is timed out.
Nov 15 04:23:03 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Successfully detached device vdb from instance 13449149-a938-41ff-964f-16f96614bf3e from the live domain config.
Nov 15 04:23:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:23:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RzKhkgqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:23:03 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:23:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:23:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:23:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:03 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d08d80-6d26-4d49-b6d7-1eea98281d5c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:23:03 user nova-compute[74805]: No targets found.
Nov 15 04:23:03 user nova-compute[74805]: iSNS:
Nov 15 04:23:03 user nova-compute[74805]: No targets found.
Nov 15 04:23:03 user nova-compute[74805]: STATIC:
Nov 15 04:23:03 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7
Nov 15 04:23:03 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:23:03 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:23:03 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132
Nov 15 04:23:03 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:23:03 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:23:03 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf
Nov 15 04:23:03 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:23:03 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:23:03 user nova-compute[74805]: FIRMWARE:
Nov 15 04:23:03 user nova-compute[74805]: No targets found.
Nov 15 04:23:03 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:23:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:23:03 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:23:03 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:23:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:23:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:03 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6927ab7-917d-4eb8-bb2b-f580ae7ac059]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:03 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe2ee54-371d-4637-8cdb-e0a81a5e05e2]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:23:03 user nova-compute[74805]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:23:03 user nova-compute[74805]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 (non-flash)
Nov 15 04:23:03 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:23:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:23:03 user nova-compute[74805]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:23:03 user nova-compute[74805]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 (non-flash)
Nov 15 04:23:03 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:23:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c10a050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132'): ({'sde'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:23:03 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Removing single pathed devices sde {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:23:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:03 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[05459e10-6753-4873-ada4-024d476ee5d3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:04 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[06693f0f-80b1-4303-988d-e492c924252c]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:04 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Flushing IO for device /dev/sde {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:23:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:04 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c026656-e179-40b1-b6aa-78455f78a2ff]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:04 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:23:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:04 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce0e814-3a07-4a45-b84c-073a906b0bd1]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:04 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:23:04 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] SCSI volumes sde have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:23:04 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:23:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:04 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e93687-a2c8-439c-a93f-284e7b3ae106]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:04 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:23:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:04 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d66af5-3e73-4e26-8c3f-7967a2dc7ba9]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:04 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132, portal: 172.16.0.220,3260]
Nov 15 04:23:04 user nova-compute[74805]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132, portal: 172.16.0.220,3260] successful.
Nov 15 04:23:04 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:23:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07893542-f9ab-4a1d-b5f3-c6ef73a53132 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:04 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c1ad89-9faa-49cb-be5a-f8c71ccfa3ff]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:04 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:23:04 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:23:04 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] <== disconnect_volume: return (315ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:23:04 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:23:04 user nova-compute[74805]: DEBUG nova.objects.instance [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lazy-loading 'flavor' on Instance uuid 13449149-a938-41ff-964f-16f96614bf3e {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:23:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d375cdce-fb02-40b1-9d8f-eb00e3f153b4 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "13449149-a938-41ff-964f-16f96614bf3e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.721s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:05 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:23:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:06 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:23:07 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:23:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:07 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:23:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449149-a938-41ff-964f-16f96614bf3e/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449149-a938-41ff-964f-16f96614bf3e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449149-a938-41ff-964f-16f96614bf3e/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449149-a938-41ff-964f-16f96614bf3e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "f329eddf-6a3b-4f05-9353-1b1e475ba420" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG nova.objects.instance [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lazy-loading 'flavor' on Instance uuid f329eddf-6a3b-4f05-9353-1b1e475ba420 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "f329eddf-6a3b-4f05-9353-1b1e475ba420" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:08 user nova-compute[74805]: INFO nova.compute.manager [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Attaching volume 74b00fdf-abeb-4d05-bdc6-1a1f7146d076 to /dev/vdb
Nov 15 04:23:08 user nova-compute[74805]: DEBUG os_brick.utils [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c823196b-ea67-45f7-8ff2-c8eb0bea9d73]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[890825a7-2242-49fa-91f8-e954a683d243]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e212faad-ff89-44df-8111-2f69b37aa79f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8673404-097d-4697-ada2-8489bce984f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:23:08 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:23:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4532c8-3db5-4820-81c7-772e1d62f15c]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG os_brick.utils [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:23:08 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Updating existing volume attachment record: 6df79aca-5135-4cf6-ab23-b0cb390e19b2 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:23:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ddc84e-c9e1-4284-8782-7973417486d8/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ddc84e-c9e1-4284-8782-7973417486d8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ddc84e-c9e1-4284-8782-7973417486d8/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ddc84e-c9e1-4284-8782-7973417486d8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:10 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:23:10 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:23:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=7607MB free_disk=25.300498962402344GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:23:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance d63f3726-27df-455f-bda0-3ddca95b70d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:23:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance e5004557-00fa-4824-9233-343c2261588d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:23:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 51e0a627-f95e-4347-92a7-4a218413e884 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:23:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 45c66453-2f83-476b-a03b-6bdbb01d1849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:23:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 13449149-a938-41ff-964f-16f96614bf3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:23:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance f329eddf-6a3b-4f05-9353-1b1e475ba420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:23:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance a1ddc84e-c9e1-4284-8782-7973417486d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:23:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 4a2d5475-04a4-414d-9ce9-d5204494f898 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:23:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:23:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:23:11 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:23:11 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:23:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:23:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.385s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:12 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 51e0a627-f95e-4347-92a7-4a218413e884 is timed out.
Nov 15 04:23:12 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Successfully detached device vdb from instance 51e0a627-f95e-4347-92a7-4a218413e884 from the live domain config.
Nov 15 04:23:12 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBvotOfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:23:12 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:23:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[66eea920-74ff-4424-95ec-ff5120440596]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:23:12 user nova-compute[74805]: No targets found.
Nov 15 04:23:12 user nova-compute[74805]: iSNS:
Nov 15 04:23:12 user nova-compute[74805]: No targets found.
Nov 15 04:23:12 user nova-compute[74805]: STATIC:
Nov 15 04:23:12 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7
Nov 15 04:23:12 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:23:12 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:23:12 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf
Nov 15 04:23:12 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:23:12 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:23:12 user nova-compute[74805]: FIRMWARE:
Nov 15 04:23:12 user nova-compute[74805]: No targets found.
Nov 15 04:23:12 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:23:12 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:23:12 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[627e720b-3ca0-4cf2-9e3f-849d8cc39de5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[421f67df-5dc0-4294-b493-2239677939e5]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:23:12 user nova-compute[74805]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:23:12 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf (non-flash)
Nov 15 04:23:12 user nova-compute[74805]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:23:12 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c7af5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf'): ({'sdc'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Removing single pathed devices sdc {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f1a9dd-f061-4e96-9e9c-86f66551fc17]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f5313d-af08-4ab2-99e7-d6d059f5f2d5]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Flushing IO for device /dev/sdc {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-d63f3726-27df-455f-bda0-3ddca95b70d9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-d63f3726-27df-455f-bda0-3ddca95b70d9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7b0dd4-7b66-4dee-8201-07a66301842d]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f5502f-ba95-482d-896f-613a69c2396c]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5b15dc-9b9a-4de5-919b-b024dc4f59a6]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7569e3-bf85-4766-ab5a-29d80bc63236]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf, portal: 172.16.0.220,3260]
Nov 15 04:23:12 user nova-compute[74805]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf, portal: 172.16.0.220,3260] successful.
Nov 15 04:23:12 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c514702d-74f1-4d8a-892b-2b6750ac4eaf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd35fd7-f747-44dc-80be-d179f6906756]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] <== disconnect_volume: return (278ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Updating instance_info_cache with network_info: [{"id": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "address": "fa:16:3e:b1:3d:ff", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d0a11b6-25", "ovs_interfaceid": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-d63f3726-27df-455f-bda0-3ddca95b70d9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:23:12 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:23:13 user nova-compute[74805]: DEBUG nova.objects.instance [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lazy-loading 'flavor' on Instance uuid 51e0a627-f95e-4347-92a7-4a218413e884 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:23:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c0f1b954-d5a1-46d0-b9d3-0bd7f448c6ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "51e0a627-f95e-4347-92a7-4a218413e884" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.772s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:14 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:23:14 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:23:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:23:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JLtwoHDP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:23:14 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:23:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:23:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:23:14 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:23:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:23:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:23:14 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:23:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[77aae4f1-78c8-4eff-8d73-38d7440d57d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:23:14 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:23:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e43f9ac-cdf0-4161-8dec-06a84cf99db5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076] added
Nov 15 04:23:14 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:23:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f17dc1-6b89-4743-b66c-8de7e7147d32]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:23:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3e181d-618b-4098-8038-ae5d109d6def]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:23:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JLtwoHDP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JLtwoHDP" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5565d5-3618-4993-811b-3d0dcba26125]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JLtwoHDP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:23:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cf0dae-7a09-41dc-9b67-37642ad71b16]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7b8852-a42e-453f-8deb-d876fbe13ae8]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:23:15 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:23:15 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fafc5c8-9636-4c3f-aa27-4937d298af45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076, portal: 172.16.0.220,3260]
Nov 15 04:23:15 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076, portal: 172.16.0.220,3260] successful.
Nov 15 04:23:15 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[159b49db-a057-4dce-87ce-7c24748c3a4d]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1000a991-48ae-4398-bf27-8fa95fa15b25]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:23:15 user nova-compute[74805]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 (non-flash)
Nov 15 04:23:15 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:23:15 user nova-compute[74805]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 (non-flash)
Nov 15 04:23:15 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfed151-c3a4-4efb-9645-087a9655546c]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JLtwoHDP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:23:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23263353930666339', 'path': '/dev/sdb'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:23:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263353930666339', 'path': '/dev/sdb'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:23:16 user nova-compute[74805]: DEBUG nova.objects.instance [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lazy-loading 'flavor' on Instance uuid f329eddf-6a3b-4f05-9353-1b1e475ba420 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:23:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:23:16 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:23:16 user nova-compute[74805]:   <source dev="/dev/sdb"/>
Nov 15 04:23:16 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:23:16 user nova-compute[74805]:   <serial>74b00fdf-abeb-4d05-bdc6-1a1f7146d076</serial>
Nov 15 04:23:16 user nova-compute[74805]: </disk>
Nov 15 04:23:16 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:23:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:23:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:23:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] No VIF found with MAC fa:16:3e:44:06:9f, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:23:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-93612761-3800-4b2a-b863-219bbc1a86fd tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.031s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:18 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e5004557-00fa-4824-9233-343c2261588d is timed out.
Nov 15 04:23:18 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Successfully detached device vdb from instance e5004557-00fa-4824-9233-343c2261588d from the live domain config.
Nov 15 04:23:18 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHMBdyZI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:23:18 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:23:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14e1f8d-8a42-46cf-8471-f5f2e19abe07]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:23:18 user nova-compute[74805]: No targets found.
Nov 15 04:23:18 user nova-compute[74805]: iSNS:
Nov 15 04:23:18 user nova-compute[74805]: No targets found.
Nov 15 04:23:18 user nova-compute[74805]: STATIC:
Nov 15 04:23:18 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076
Nov 15 04:23:18 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:23:18 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:23:18 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7
Nov 15 04:23:18 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:23:18 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:23:18 user nova-compute[74805]: FIRMWARE:
Nov 15 04:23:18 user nova-compute[74805]: No targets found.
Nov 15 04:23:18 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:23:18 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:23:18 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19995fc-11a2-4caf-8e7a-9004b4c40867]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad627bc-1957-4a17-8d42-507fbc8083e4]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:23:18 user nova-compute[74805]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 (non-flash)
Nov 15 04:23:18 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 (non-flash)
Nov 15 04:23:18 user nova-compute[74805]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 (non-flash)
Nov 15 04:23:18 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c118820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7'): ({'sdd'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Removing single pathed devices sdd {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a93ebf5-8989-42e3-826e-5d71cc6399dd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[246362d1-51f5-4f83-b711-a0460dc02dc6]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Flushing IO for device /dev/sdd {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa2e858-4fb6-442a-8087-ec5d4b9413df]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9eb29b-fcef-4744-a047-f06ae91144f7]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] SCSI volumes sdd have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:23:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f0e22e-a30c-4d3d-b7af-cc4468994f26]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:23:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3c210c-002a-459c-85cd-91e6a29fa0bf]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7, portal: 172.16.0.220,3260]
Nov 15 04:23:19 user nova-compute[74805]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7, portal: 172.16.0.220,3260] successful.
Nov 15 04:23:19 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:23:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:944e52fb-ec1c-4673-a146-945688c4c4d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f11f01-4e12-465b-b971-566e3f9cecae]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:23:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:23:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] <== disconnect_volume: return (295ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:23:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:23:19 user nova-compute[74805]: DEBUG nova.compute.manager [req-247d7172-bd0d-4363-8111-9c53fc36f9e1 req-4559ad89-b800-45ed-bdf3-f0d5b019c1a3 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Received event network-changed-a8a0db92-660b-4fc3-b68c-9e6a37aa85db {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:23:19 user nova-compute[74805]: DEBUG nova.compute.manager [req-247d7172-bd0d-4363-8111-9c53fc36f9e1 req-4559ad89-b800-45ed-bdf3-f0d5b019c1a3 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Refreshing instance network info cache due to event network-changed-a8a0db92-660b-4fc3-b68c-9e6a37aa85db. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:23:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-247d7172-bd0d-4363-8111-9c53fc36f9e1 req-4559ad89-b800-45ed-bdf3-f0d5b019c1a3 service nova] Acquiring lock "refresh_cache-f329eddf-6a3b-4f05-9353-1b1e475ba420" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:23:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-247d7172-bd0d-4363-8111-9c53fc36f9e1 req-4559ad89-b800-45ed-bdf3-f0d5b019c1a3 service nova] Acquired lock "refresh_cache-f329eddf-6a3b-4f05-9353-1b1e475ba420" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:23:19 user nova-compute[74805]: DEBUG nova.network.neutron [req-247d7172-bd0d-4363-8111-9c53fc36f9e1 req-4559ad89-b800-45ed-bdf3-f0d5b019c1a3 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Refreshing network info cache for port a8a0db92-660b-4fc3-b68c-9e6a37aa85db {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:23:20 user nova-compute[74805]: DEBUG nova.network.neutron [req-247d7172-bd0d-4363-8111-9c53fc36f9e1 req-4559ad89-b800-45ed-bdf3-f0d5b019c1a3 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Updated VIF entry in instance network info cache for port a8a0db92-660b-4fc3-b68c-9e6a37aa85db. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:23:20 user nova-compute[74805]: DEBUG nova.network.neutron [req-247d7172-bd0d-4363-8111-9c53fc36f9e1 req-4559ad89-b800-45ed-bdf3-f0d5b019c1a3 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Updating instance_info_cache with network_info: [{"id": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "address": "fa:16:3e:44:06:9f", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a0db92-66", "ovs_interfaceid": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:23:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-247d7172-bd0d-4363-8111-9c53fc36f9e1 req-4559ad89-b800-45ed-bdf3-f0d5b019c1a3 service nova] Releasing lock "refresh_cache-f329eddf-6a3b-4f05-9353-1b1e475ba420" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:23:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:23:21 user nova-compute[74805]: DEBUG nova.objects.instance [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'flavor' on Instance uuid e5004557-00fa-4824-9233-343c2261588d {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:23:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c505cfd6-c78a-49b3-b610-296067399824 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "e5004557-00fa-4824-9233-343c2261588d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.428s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-774ca53f-ab00-4ab8-a82f-e1325bfa4d01 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "e5004557-00fa-4824-9233-343c2261588d" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-774ca53f-ab00-4ab8-a82f-e1325bfa4d01 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "e5004557-00fa-4824-9233-343c2261588d" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:22 user nova-compute[74805]: DEBUG nova.compute.manager [None req-774ca53f-ab00-4ab8-a82f-e1325bfa4d01 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:23:22 user nova-compute[74805]: DEBUG nova.compute.manager [None req-774ca53f-ab00-4ab8-a82f-e1325bfa4d01 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74805) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 15 04:23:22 user nova-compute[74805]: DEBUG nova.objects.instance [None req-774ca53f-ab00-4ab8-a82f-e1325bfa4d01 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'flavor' on Instance uuid e5004557-00fa-4824-9233-343c2261588d {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:23:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-3cba5f30-87e1-481a-a292-50211cb27f80 req-721d1089-678f-4f28-9915-cae9f8fc8cd4 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Received event network-changed-a8a0db92-660b-4fc3-b68c-9e6a37aa85db {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:23:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-3cba5f30-87e1-481a-a292-50211cb27f80 req-721d1089-678f-4f28-9915-cae9f8fc8cd4 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Refreshing instance network info cache due to event network-changed-a8a0db92-660b-4fc3-b68c-9e6a37aa85db. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:23:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3cba5f30-87e1-481a-a292-50211cb27f80 req-721d1089-678f-4f28-9915-cae9f8fc8cd4 service nova] Acquiring lock "refresh_cache-f329eddf-6a3b-4f05-9353-1b1e475ba420" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:23:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3cba5f30-87e1-481a-a292-50211cb27f80 req-721d1089-678f-4f28-9915-cae9f8fc8cd4 service nova] Acquired lock "refresh_cache-f329eddf-6a3b-4f05-9353-1b1e475ba420" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:23:22 user nova-compute[74805]: DEBUG nova.network.neutron [req-3cba5f30-87e1-481a-a292-50211cb27f80 req-721d1089-678f-4f28-9915-cae9f8fc8cd4 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Refreshing network info cache for port a8a0db92-660b-4fc3-b68c-9e6a37aa85db {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:23:22 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: e5004557-00fa-4824-9233-343c2261588d] Instance destroyed successfully.
Nov 15 04:23:22 user nova-compute[74805]: DEBUG nova.compute.manager [None req-774ca53f-ab00-4ab8-a82f-e1325bfa4d01 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:23:22 user nova-compute[74805]: DEBUG nova.network.neutron [req-3cba5f30-87e1-481a-a292-50211cb27f80 req-721d1089-678f-4f28-9915-cae9f8fc8cd4 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Updated VIF entry in instance network info cache for port a8a0db92-660b-4fc3-b68c-9e6a37aa85db. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:23:22 user nova-compute[74805]: DEBUG nova.network.neutron [req-3cba5f30-87e1-481a-a292-50211cb27f80 req-721d1089-678f-4f28-9915-cae9f8fc8cd4 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Updating instance_info_cache with network_info: [{"id": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "address": "fa:16:3e:44:06:9f", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a0db92-66", "ovs_interfaceid": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:23:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b1187f44-3be5-46e2-a084-3e1df28781e3 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "f329eddf-6a3b-4f05-9353-1b1e475ba420" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b1187f44-3be5-46e2-a084-3e1df28781e3 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:22 user nova-compute[74805]: INFO nova.compute.manager [None req-b1187f44-3be5-46e2-a084-3e1df28781e3 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Rebooting instance
Nov 15 04:23:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3cba5f30-87e1-481a-a292-50211cb27f80 req-721d1089-678f-4f28-9915-cae9f8fc8cd4 service nova] Releasing lock "refresh_cache-f329eddf-6a3b-4f05-9353-1b1e475ba420" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:23:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-774ca53f-ab00-4ab8-a82f-e1325bfa4d01 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "e5004557-00fa-4824-9233-343c2261588d" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.847s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b1187f44-3be5-46e2-a084-3e1df28781e3 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "refresh_cache-f329eddf-6a3b-4f05-9353-1b1e475ba420" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:23:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b1187f44-3be5-46e2-a084-3e1df28781e3 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquired lock "refresh_cache-f329eddf-6a3b-4f05-9353-1b1e475ba420" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:23:22 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b1187f44-3be5-46e2-a084-3e1df28781e3 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:23:23 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b1187f44-3be5-46e2-a084-3e1df28781e3 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Updating instance_info_cache with network_info: [{"id": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "address": "fa:16:3e:44:06:9f", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a0db92-66", "ovs_interfaceid": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:23:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b1187f44-3be5-46e2-a084-3e1df28781e3 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Releasing lock "refresh_cache-f329eddf-6a3b-4f05-9353-1b1e475ba420" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:23:23 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b1187f44-3be5-46e2-a084-3e1df28781e3 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:23:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-3ee67347-68b1-4dbc-8f06-930acd3bccc0 req-0f52c4d0-3236-4fab-8e78-6dd20416618c service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Received event network-vif-unplugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:23:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3ee67347-68b1-4dbc-8f06-930acd3bccc0 req-0f52c4d0-3236-4fab-8e78-6dd20416618c service nova] Acquiring lock "e5004557-00fa-4824-9233-343c2261588d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3ee67347-68b1-4dbc-8f06-930acd3bccc0 req-0f52c4d0-3236-4fab-8e78-6dd20416618c service nova] Lock "e5004557-00fa-4824-9233-343c2261588d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3ee67347-68b1-4dbc-8f06-930acd3bccc0 req-0f52c4d0-3236-4fab-8e78-6dd20416618c service nova] Lock "e5004557-00fa-4824-9233-343c2261588d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-3ee67347-68b1-4dbc-8f06-930acd3bccc0 req-0f52c4d0-3236-4fab-8e78-6dd20416618c service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] No waiting events found dispatching network-vif-unplugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:23:24 user nova-compute[74805]: WARNING nova.compute.manager [req-3ee67347-68b1-4dbc-8f06-930acd3bccc0 req-0f52c4d0-3236-4fab-8e78-6dd20416618c service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Received unexpected event network-vif-unplugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 for instance with vm_state stopped and task_state None.
Nov 15 04:23:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-3ee67347-68b1-4dbc-8f06-930acd3bccc0 req-0f52c4d0-3236-4fab-8e78-6dd20416618c service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Received event network-vif-plugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:23:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3ee67347-68b1-4dbc-8f06-930acd3bccc0 req-0f52c4d0-3236-4fab-8e78-6dd20416618c service nova] Acquiring lock "e5004557-00fa-4824-9233-343c2261588d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3ee67347-68b1-4dbc-8f06-930acd3bccc0 req-0f52c4d0-3236-4fab-8e78-6dd20416618c service nova] Lock "e5004557-00fa-4824-9233-343c2261588d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3ee67347-68b1-4dbc-8f06-930acd3bccc0 req-0f52c4d0-3236-4fab-8e78-6dd20416618c service nova] Lock "e5004557-00fa-4824-9233-343c2261588d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-3ee67347-68b1-4dbc-8f06-930acd3bccc0 req-0f52c4d0-3236-4fab-8e78-6dd20416618c service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] No waiting events found dispatching network-vif-plugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:23:24 user nova-compute[74805]: WARNING nova.compute.manager [req-3ee67347-68b1-4dbc-8f06-930acd3bccc0 req-0f52c4d0-3236-4fab-8e78-6dd20416618c service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Received unexpected event network-vif-plugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 for instance with vm_state stopped and task_state None.
Nov 15 04:23:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-65d84291-7ee2-42fb-b24d-f7acfef77858 req-2d614e0e-cb49-4712-b3a0-2e9f8b4ef92b service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Received event network-vif-unplugged-a8a0db92-660b-4fc3-b68c-9e6a37aa85db {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:23:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-65d84291-7ee2-42fb-b24d-f7acfef77858 req-2d614e0e-cb49-4712-b3a0-2e9f8b4ef92b service nova] Acquiring lock "f329eddf-6a3b-4f05-9353-1b1e475ba420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-65d84291-7ee2-42fb-b24d-f7acfef77858 req-2d614e0e-cb49-4712-b3a0-2e9f8b4ef92b service nova] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-65d84291-7ee2-42fb-b24d-f7acfef77858 req-2d614e0e-cb49-4712-b3a0-2e9f8b4ef92b service nova] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-65d84291-7ee2-42fb-b24d-f7acfef77858 req-2d614e0e-cb49-4712-b3a0-2e9f8b4ef92b service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] No waiting events found dispatching network-vif-unplugged-a8a0db92-660b-4fc3-b68c-9e6a37aa85db {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:23:26 user nova-compute[74805]: WARNING nova.compute.manager [req-65d84291-7ee2-42fb-b24d-f7acfef77858 req-2d614e0e-cb49-4712-b3a0-2e9f8b4ef92b service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Received unexpected event network-vif-unplugged-a8a0db92-660b-4fc3-b68c-9e6a37aa85db for instance with vm_state active and task_state reboot_started.
Nov 15 04:23:26 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-b1187f44-3be5-46e2-a084-3e1df28781e3 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Instance shutdown successfully.
Nov 15 04:23:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:28 user nova-compute[74805]: DEBUG nova.compute.manager [req-016c35ed-b5cd-4b01-9fed-91b6daee827f req-2e2feba8-26a7-40a5-8a6a-b1f63dbd4c5a service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Received event network-vif-plugged-a8a0db92-660b-4fc3-b68c-9e6a37aa85db {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:23:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-016c35ed-b5cd-4b01-9fed-91b6daee827f req-2e2feba8-26a7-40a5-8a6a-b1f63dbd4c5a service nova] Acquiring lock "f329eddf-6a3b-4f05-9353-1b1e475ba420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-016c35ed-b5cd-4b01-9fed-91b6daee827f req-2e2feba8-26a7-40a5-8a6a-b1f63dbd4c5a service nova] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-016c35ed-b5cd-4b01-9fed-91b6daee827f req-2e2feba8-26a7-40a5-8a6a-b1f63dbd4c5a service nova] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:28 user nova-compute[74805]: DEBUG nova.compute.manager [req-016c35ed-b5cd-4b01-9fed-91b6daee827f req-2e2feba8-26a7-40a5-8a6a-b1f63dbd4c5a service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] No waiting events found dispatching network-vif-plugged-a8a0db92-660b-4fc3-b68c-9e6a37aa85db {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:23:28 user nova-compute[74805]: WARNING nova.compute.manager [req-016c35ed-b5cd-4b01-9fed-91b6daee827f req-2e2feba8-26a7-40a5-8a6a-b1f63dbd4c5a service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Received unexpected event network-vif-plugged-a8a0db92-660b-4fc3-b68c-9e6a37aa85db for instance with vm_state active and task_state reboot_started.
Nov 15 04:23:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:30 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Instance running successfully.
Nov 15 04:23:30 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-b1187f44-3be5-46e2-a084-3e1df28781e3 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Instance soft rebooted successfully.
Nov 15 04:23:30 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b1187f44-3be5-46e2-a084-3e1df28781e3 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:23:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b1187f44-3be5-46e2-a084-3e1df28781e3 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.554s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-75292d6f-3c4d-4429-a715-ec096476034f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "13449149-a938-41ff-964f-16f96614bf3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-75292d6f-3c4d-4429-a715-ec096476034f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "13449149-a938-41ff-964f-16f96614bf3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-75292d6f-3c4d-4429-a715-ec096476034f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "13449149-a938-41ff-964f-16f96614bf3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-75292d6f-3c4d-4429-a715-ec096476034f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "13449149-a938-41ff-964f-16f96614bf3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-75292d6f-3c4d-4429-a715-ec096476034f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "13449149-a938-41ff-964f-16f96614bf3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:33 user nova-compute[74805]: INFO nova.compute.manager [None req-75292d6f-3c4d-4429-a715-ec096476034f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Terminating instance
Nov 15 04:23:33 user nova-compute[74805]: DEBUG nova.compute.manager [None req-75292d6f-3c4d-4429-a715-ec096476034f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:23:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:34 user nova-compute[74805]: DEBUG nova.compute.manager [req-41d3755a-b5ed-487e-a02a-c3b470cb0d7d req-a894dc31-d5b8-4b3e-8fc7-fa04edadc03e service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Received event network-vif-plugged-a8a0db92-660b-4fc3-b68c-9e6a37aa85db {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:23:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-41d3755a-b5ed-487e-a02a-c3b470cb0d7d req-a894dc31-d5b8-4b3e-8fc7-fa04edadc03e service nova] Acquiring lock "f329eddf-6a3b-4f05-9353-1b1e475ba420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-41d3755a-b5ed-487e-a02a-c3b470cb0d7d req-a894dc31-d5b8-4b3e-8fc7-fa04edadc03e service nova] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-41d3755a-b5ed-487e-a02a-c3b470cb0d7d req-a894dc31-d5b8-4b3e-8fc7-fa04edadc03e service nova] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:34 user nova-compute[74805]: DEBUG nova.compute.manager [req-41d3755a-b5ed-487e-a02a-c3b470cb0d7d req-a894dc31-d5b8-4b3e-8fc7-fa04edadc03e service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] No waiting events found dispatching network-vif-plugged-a8a0db92-660b-4fc3-b68c-9e6a37aa85db {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:23:34 user nova-compute[74805]: WARNING nova.compute.manager [req-41d3755a-b5ed-487e-a02a-c3b470cb0d7d req-a894dc31-d5b8-4b3e-8fc7-fa04edadc03e service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Received unexpected event network-vif-plugged-a8a0db92-660b-4fc3-b68c-9e6a37aa85db for instance with vm_state active and task_state None.
Nov 15 04:23:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:34 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Instance destroyed successfully.
Nov 15 04:23:34 user nova-compute[74805]: DEBUG nova.objects.instance [None req-75292d6f-3c4d-4429-a715-ec096476034f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lazy-loading 'resources' on Instance uuid 13449149-a938-41ff-964f-16f96614bf3e {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:23:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-75292d6f-3c4d-4429-a715-ec096476034f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:20:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-530332267',display_name='tempest-AttachVolumeNegativeTest-server-530332267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-530332267',id=21,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTxWZRiq55Yl4mR4Mkemlff8oLW47/FT3iMd8EvdbKjMEFtFNrgArIkiO1Qi57hSoyWzkn8HFBHnEBbcdHc+mDH+XosH8C7ysOcPUR/4onPgh1Jn8gNe7FcROspW/YYKA==',key_name='tempest-keypair-1386040961',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:20:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8280c6302b2e42998c7c436522c47e79',ramdisk_id='',reservation_id='r-wvan3hg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-6184130',owner_user_name='tempest-AttachVolumeNegativeTest-6184130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:20:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba1bcf1e429045129d379293cc490bde',uuid=13449149-a938-41ff-964f-16f96614bf3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e95edf0-c248-41b6-b111-8411047ab446", "address": "fa:16:3e:a0:c7:07", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e95edf0-c2", "ovs_interfaceid": "3e95edf0-c248-41b6-b111-8411047ab446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:23:34 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-75292d6f-3c4d-4429-a715-ec096476034f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Converting VIF {"id": "3e95edf0-c248-41b6-b111-8411047ab446", "address": "fa:16:3e:a0:c7:07", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e95edf0-c2", "ovs_interfaceid": "3e95edf0-c248-41b6-b111-8411047ab446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:23:34 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-75292d6f-3c4d-4429-a715-ec096476034f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:c7:07,bridge_name='br-int',has_traffic_filtering=True,id=3e95edf0-c248-41b6-b111-8411047ab446,network=Network(3454b4d8-1ff9-4f3c-9a93-499645affcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e95edf0-c2') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:23:34 user nova-compute[74805]: DEBUG os_vif [None req-75292d6f-3c4d-4429-a715-ec096476034f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:c7:07,bridge_name='br-int',has_traffic_filtering=True,id=3e95edf0-c248-41b6-b111-8411047ab446,network=Network(3454b4d8-1ff9-4f3c-9a93-499645affcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e95edf0-c2') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:23:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e95edf0-c2, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:23:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:23:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=79f56cec-102b-4e38-97d4-77675e95ce13) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:23:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:23:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:34 user nova-compute[74805]: INFO os_vif [None req-75292d6f-3c4d-4429-a715-ec096476034f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:c7:07,bridge_name='br-int',has_traffic_filtering=True,id=3e95edf0-c248-41b6-b111-8411047ab446,network=Network(3454b4d8-1ff9-4f3c-9a93-499645affcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e95edf0-c2')
Nov 15 04:23:34 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-75292d6f-3c4d-4429-a715-ec096476034f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Deleting instance files /opt/stack/data/nova/instances/13449149-a938-41ff-964f-16f96614bf3e_del
Nov 15 04:23:34 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-75292d6f-3c4d-4429-a715-ec096476034f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Deletion of /opt/stack/data/nova/instances/13449149-a938-41ff-964f-16f96614bf3e_del complete
Nov 15 04:23:34 user nova-compute[74805]: INFO nova.compute.manager [None req-75292d6f-3c4d-4429-a715-ec096476034f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 15 04:23:34 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-75292d6f-3c4d-4429-a715-ec096476034f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:23:34 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:23:34 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 13449149-a938-41ff-964f-16f96614bf3e] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:23:34 user nova-compute[74805]: DEBUG nova.compute.manager [req-28fe61c8-a318-4f3b-9f38-b956ec925d73 req-53a751a4-bc6a-4f47-9b40-1d99ed28bba2 service nova] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Received event network-vif-unplugged-3e95edf0-c248-41b6-b111-8411047ab446 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:23:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-28fe61c8-a318-4f3b-9f38-b956ec925d73 req-53a751a4-bc6a-4f47-9b40-1d99ed28bba2 service nova] Acquiring lock "13449149-a938-41ff-964f-16f96614bf3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-28fe61c8-a318-4f3b-9f38-b956ec925d73 req-53a751a4-bc6a-4f47-9b40-1d99ed28bba2 service nova] Lock "13449149-a938-41ff-964f-16f96614bf3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-28fe61c8-a318-4f3b-9f38-b956ec925d73 req-53a751a4-bc6a-4f47-9b40-1d99ed28bba2 service nova] Lock "13449149-a938-41ff-964f-16f96614bf3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:34 user nova-compute[74805]: DEBUG nova.compute.manager [req-28fe61c8-a318-4f3b-9f38-b956ec925d73 req-53a751a4-bc6a-4f47-9b40-1d99ed28bba2 service nova] [instance: 13449149-a938-41ff-964f-16f96614bf3e] No waiting events found dispatching network-vif-unplugged-3e95edf0-c248-41b6-b111-8411047ab446 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:23:34 user nova-compute[74805]: DEBUG nova.compute.manager [req-28fe61c8-a318-4f3b-9f38-b956ec925d73 req-53a751a4-bc6a-4f47-9b40-1d99ed28bba2 service nova] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Received event network-vif-unplugged-3e95edf0-c248-41b6-b111-8411047ab446 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:23:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:35 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:23:35 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Took 0.96 seconds to deallocate network for instance.
Nov 15 04:23:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-75292d6f-3c4d-4429-a715-ec096476034f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-75292d6f-3c4d-4429-a715-ec096476034f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:35 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-75292d6f-3c4d-4429-a715-ec096476034f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:23:35 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-75292d6f-3c4d-4429-a715-ec096476034f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:23:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-75292d6f-3c4d-4429-a715-ec096476034f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:36 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-75292d6f-3c4d-4429-a715-ec096476034f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Deleted allocations for instance 13449149-a938-41ff-964f-16f96614bf3e
Nov 15 04:23:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-75292d6f-3c4d-4429-a715-ec096476034f tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "13449149-a938-41ff-964f-16f96614bf3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.512s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:36 user nova-compute[74805]: DEBUG nova.compute.manager [req-2584b7b9-204c-4fda-8057-5b7a5cb398ae req-2983854c-f0fd-46f5-936d-a6efa7216591 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Received event network-vif-plugged-a8a0db92-660b-4fc3-b68c-9e6a37aa85db {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:23:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2584b7b9-204c-4fda-8057-5b7a5cb398ae req-2983854c-f0fd-46f5-936d-a6efa7216591 service nova] Acquiring lock "f329eddf-6a3b-4f05-9353-1b1e475ba420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2584b7b9-204c-4fda-8057-5b7a5cb398ae req-2983854c-f0fd-46f5-936d-a6efa7216591 service nova] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2584b7b9-204c-4fda-8057-5b7a5cb398ae req-2983854c-f0fd-46f5-936d-a6efa7216591 service nova] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:36 user nova-compute[74805]: DEBUG nova.compute.manager [req-2584b7b9-204c-4fda-8057-5b7a5cb398ae req-2983854c-f0fd-46f5-936d-a6efa7216591 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] No waiting events found dispatching network-vif-plugged-a8a0db92-660b-4fc3-b68c-9e6a37aa85db {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:23:36 user nova-compute[74805]: WARNING nova.compute.manager [req-2584b7b9-204c-4fda-8057-5b7a5cb398ae req-2983854c-f0fd-46f5-936d-a6efa7216591 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Received unexpected event network-vif-plugged-a8a0db92-660b-4fc3-b68c-9e6a37aa85db for instance with vm_state active and task_state None.
Nov 15 04:23:36 user nova-compute[74805]: DEBUG nova.compute.manager [req-2584b7b9-204c-4fda-8057-5b7a5cb398ae req-2983854c-f0fd-46f5-936d-a6efa7216591 service nova] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Received event network-vif-deleted-3e95edf0-c248-41b6-b111-8411047ab446 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:23:37 user nova-compute[74805]: DEBUG nova.compute.manager [req-e124a234-21fb-4575-9908-967520579e3e req-e0caa86b-2270-4158-9be8-6bb456658a0c service nova] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Received event network-vif-plugged-3e95edf0-c248-41b6-b111-8411047ab446 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:23:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e124a234-21fb-4575-9908-967520579e3e req-e0caa86b-2270-4158-9be8-6bb456658a0c service nova] Acquiring lock "13449149-a938-41ff-964f-16f96614bf3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e124a234-21fb-4575-9908-967520579e3e req-e0caa86b-2270-4158-9be8-6bb456658a0c service nova] Lock "13449149-a938-41ff-964f-16f96614bf3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e124a234-21fb-4575-9908-967520579e3e req-e0caa86b-2270-4158-9be8-6bb456658a0c service nova] Lock "13449149-a938-41ff-964f-16f96614bf3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:37 user nova-compute[74805]: DEBUG nova.compute.manager [req-e124a234-21fb-4575-9908-967520579e3e req-e0caa86b-2270-4158-9be8-6bb456658a0c service nova] [instance: 13449149-a938-41ff-964f-16f96614bf3e] No waiting events found dispatching network-vif-plugged-3e95edf0-c248-41b6-b111-8411047ab446 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:23:37 user nova-compute[74805]: WARNING nova.compute.manager [req-e124a234-21fb-4575-9908-967520579e3e req-e0caa86b-2270-4158-9be8-6bb456658a0c service nova] [instance: 13449149-a938-41ff-964f-16f96614bf3e] Received unexpected event network-vif-plugged-3e95edf0-c248-41b6-b111-8411047ab446 for instance with vm_state deleted and task_state None.
Nov 15 04:23:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Acquiring lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:40 user nova-compute[74805]: DEBUG nova.compute.manager [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:23:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:40 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:23:40 user nova-compute[74805]: INFO nova.compute.claims [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Claim successful on node user
Nov 15 04:23:40 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:23:40 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:23:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:40 user nova-compute[74805]: DEBUG nova.compute.manager [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:23:40 user nova-compute[74805]: DEBUG nova.compute.manager [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:23:40 user nova-compute[74805]: DEBUG nova.network.neutron [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:23:40 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:23:41 user nova-compute[74805]: DEBUG nova.compute.manager [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:23:41 user nova-compute[74805]: DEBUG nova.policy [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4de845d5de0a4cc880f29b4a522c81e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffec78f4baa84125864c0992ecfa6181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:23:41 user nova-compute[74805]: INFO nova.virt.block_device [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Booting with volume 44a3adea-ac4e-44f2-935b-9d9c28f70afb at /dev/vda
Nov 15 04:23:41 user nova-compute[74805]: DEBUG os_brick.utils [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:23:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:41 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee9542d-d393-4ccd-975c-47a4337bfbe1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:41 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[338cf7a6-81d1-48d2-a0d3-42dd5310ef3a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:41 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2a91b5-7486-431d-8b01-192daa2be1b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:41 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eded8fa-56e8-43ce-9dc4-bf182e26a64e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:23:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:23:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:23:41 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:23:41 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[50483bcc-8988-4877-9153-dbfa0856825e]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:23:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:23:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:23:41 user nova-compute[74805]: DEBUG os_brick.utils [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:23:41 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Updating existing volume attachment record: 97f58ad9-073d-40b5-85d2-ba746001d576 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:23:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1975acec-8ef1-466b-8f9e-d1060a4e30ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "51e0a627-f95e-4347-92a7-4a218413e884" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1975acec-8ef1-466b-8f9e-d1060a4e30ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "51e0a627-f95e-4347-92a7-4a218413e884" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1975acec-8ef1-466b-8f9e-d1060a4e30ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "51e0a627-f95e-4347-92a7-4a218413e884-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1975acec-8ef1-466b-8f9e-d1060a4e30ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "51e0a627-f95e-4347-92a7-4a218413e884-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1975acec-8ef1-466b-8f9e-d1060a4e30ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "51e0a627-f95e-4347-92a7-4a218413e884-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:41 user nova-compute[74805]: INFO nova.compute.manager [None req-1975acec-8ef1-466b-8f9e-d1060a4e30ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Terminating instance
Nov 15 04:23:41 user nova-compute[74805]: DEBUG nova.compute.manager [None req-1975acec-8ef1-466b-8f9e-d1060a4e30ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:23:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:42 user nova-compute[74805]: DEBUG nova.compute.manager [req-8d6b726c-d8da-4fef-b7f4-34d913d20cfc req-f6e69765-922f-4825-8e17-6c793ba4433b service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Received event network-vif-unplugged-62730abb-e77d-4e27-8e57-929086b708e3 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:23:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8d6b726c-d8da-4fef-b7f4-34d913d20cfc req-f6e69765-922f-4825-8e17-6c793ba4433b service nova] Acquiring lock "51e0a627-f95e-4347-92a7-4a218413e884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8d6b726c-d8da-4fef-b7f4-34d913d20cfc req-f6e69765-922f-4825-8e17-6c793ba4433b service nova] Lock "51e0a627-f95e-4347-92a7-4a218413e884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8d6b726c-d8da-4fef-b7f4-34d913d20cfc req-f6e69765-922f-4825-8e17-6c793ba4433b service nova] Lock "51e0a627-f95e-4347-92a7-4a218413e884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:42 user nova-compute[74805]: DEBUG nova.compute.manager [req-8d6b726c-d8da-4fef-b7f4-34d913d20cfc req-f6e69765-922f-4825-8e17-6c793ba4433b service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] No waiting events found dispatching network-vif-unplugged-62730abb-e77d-4e27-8e57-929086b708e3 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:23:42 user nova-compute[74805]: DEBUG nova.compute.manager [req-8d6b726c-d8da-4fef-b7f4-34d913d20cfc req-f6e69765-922f-4825-8e17-6c793ba4433b service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Received event network-vif-unplugged-62730abb-e77d-4e27-8e57-929086b708e3 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:23:42 user nova-compute[74805]: DEBUG nova.network.neutron [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Successfully created port: b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:23:42 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Instance destroyed successfully.
Nov 15 04:23:42 user nova-compute[74805]: DEBUG nova.objects.instance [None req-1975acec-8ef1-466b-8f9e-d1060a4e30ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lazy-loading 'resources' on Instance uuid 51e0a627-f95e-4347-92a7-4a218413e884 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:23:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-1975acec-8ef1-466b-8f9e-d1060a4e30ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T04:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1880386667',display_name='tempest-ServerActionsTestOtherA-server-250389162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1880386667',id=16,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNL2QOXLXk1x9TsxLURUmSVRJaTx/RlWkfU3Js5N8CQyrY9MmbOAU4o8C49ofySnmFHbhPtn/D/NU/tAJtyE07dTKcQEk2x0+rT7NunvFZegFW77bWCq6V++KJvKeWIEWg==',key_name='tempest-keypair-86981041',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:20:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6dcdb40f067540dab36661ea0586f1d5',ramdisk_id='',reservation_id='r-a6zdjf19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1623992712',owner_user_name='tempest-ServerActionsTestOtherA-1623992712-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:20:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b6a8eff61f4d6ba2e83d7939143112',uuid=51e0a627-f95e-4347-92a7-4a218413e884,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62730abb-e77d-4e27-8e57-929086b708e3", "address": "fa:16:3e:b0:20:4f", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62730abb-e7", "ovs_interfaceid": "62730abb-e77d-4e27-8e57-929086b708e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:23:42 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-1975acec-8ef1-466b-8f9e-d1060a4e30ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converting VIF {"id": "62730abb-e77d-4e27-8e57-929086b708e3", "address": "fa:16:3e:b0:20:4f", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62730abb-e7", "ovs_interfaceid": "62730abb-e77d-4e27-8e57-929086b708e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:23:42 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-1975acec-8ef1-466b-8f9e-d1060a4e30ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:20:4f,bridge_name='br-int',has_traffic_filtering=True,id=62730abb-e77d-4e27-8e57-929086b708e3,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62730abb-e7') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:23:42 user nova-compute[74805]: DEBUG os_vif [None req-1975acec-8ef1-466b-8f9e-d1060a4e30ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:20:4f,bridge_name='br-int',has_traffic_filtering=True,id=62730abb-e77d-4e27-8e57-929086b708e3,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62730abb-e7') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:23:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62730abb-e7, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:23:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:23:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cfdfc807-8115-409a-8185-dafddb420ffc) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:23:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:23:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:42 user nova-compute[74805]: INFO os_vif [None req-1975acec-8ef1-466b-8f9e-d1060a4e30ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:20:4f,bridge_name='br-int',has_traffic_filtering=True,id=62730abb-e77d-4e27-8e57-929086b708e3,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62730abb-e7')
Nov 15 04:23:42 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-1975acec-8ef1-466b-8f9e-d1060a4e30ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Deleting instance files /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884_del
Nov 15 04:23:42 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-1975acec-8ef1-466b-8f9e-d1060a4e30ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Deletion of /opt/stack/data/nova/instances/51e0a627-f95e-4347-92a7-4a218413e884_del complete
Nov 15 04:23:42 user nova-compute[74805]: INFO nova.compute.manager [None req-1975acec-8ef1-466b-8f9e-d1060a4e30ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 15 04:23:42 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-1975acec-8ef1-466b-8f9e-d1060a4e30ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:23:42 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:23:42 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:23:43 user nova-compute[74805]: DEBUG nova.network.neutron [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Successfully updated port: b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:23:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Acquiring lock "refresh_cache-bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:23:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Acquired lock "refresh_cache-bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:23:43 user nova-compute[74805]: DEBUG nova.network.neutron [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:23:43 user nova-compute[74805]: DEBUG nova.network.neutron [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:23:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:43 user nova-compute[74805]: DEBUG nova.network.neutron [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Updating instance_info_cache with network_info: [{"id": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "address": "fa:16:3e:48:b0:09", "network": {"id": "62c3a0d2-d7cf-41dd-adb6-f2331929ee00", "bridge": "br-int", "label": "tempest-TestShelveInstance-1115394549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec78f4baa84125864c0992ecfa6181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5818fba-ad", "ovs_interfaceid": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:23:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Releasing lock "refresh_cache-bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:23:43 user nova-compute[74805]: DEBUG nova.compute.manager [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Instance network_info: |[{"id": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "address": "fa:16:3e:48:b0:09", "network": {"id": "62c3a0d2-d7cf-41dd-adb6-f2331929ee00", "bridge": "br-int", "label": "tempest-TestShelveInstance-1115394549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec78f4baa84125864c0992ecfa6181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5818fba-ad", "ovs_interfaceid": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:23:43 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:23:43 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Took 0.97 seconds to deallocate network for instance.
Nov 15 04:23:43 user nova-compute[74805]: DEBUG nova.compute.manager [req-19917139-f7d2-41fd-ad25-dd616793d16e req-4fdd9a7b-e7f0-4c23-acbd-f7b4552b09a2 service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Received event network-vif-deleted-62730abb-e77d-4e27-8e57-929086b708e3 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:23:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1975acec-8ef1-466b-8f9e-d1060a4e30ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1975acec-8ef1-466b-8f9e-d1060a4e30ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:44 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-1975acec-8ef1-466b-8f9e-d1060a4e30ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:23:44 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-1975acec-8ef1-466b-8f9e-d1060a4e30ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:23:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1975acec-8ef1-466b-8f9e-d1060a4e30ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:44 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-1975acec-8ef1-466b-8f9e-d1060a4e30ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Deleted allocations for instance 51e0a627-f95e-4347-92a7-4a218413e884
Nov 15 04:23:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1975acec-8ef1-466b-8f9e-d1060a4e30ce tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "51e0a627-f95e-4347-92a7-4a218413e884" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.483s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:44 user nova-compute[74805]: DEBUG nova.compute.manager [req-aa1102d7-4e54-4942-b1f4-d017f7c1f260 req-9ad635f3-575e-40e7-ac63-654d165b4eff service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Received event network-vif-plugged-62730abb-e77d-4e27-8e57-929086b708e3 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:23:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-aa1102d7-4e54-4942-b1f4-d017f7c1f260 req-9ad635f3-575e-40e7-ac63-654d165b4eff service nova] Acquiring lock "51e0a627-f95e-4347-92a7-4a218413e884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-aa1102d7-4e54-4942-b1f4-d017f7c1f260 req-9ad635f3-575e-40e7-ac63-654d165b4eff service nova] Lock "51e0a627-f95e-4347-92a7-4a218413e884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-aa1102d7-4e54-4942-b1f4-d017f7c1f260 req-9ad635f3-575e-40e7-ac63-654d165b4eff service nova] Lock "51e0a627-f95e-4347-92a7-4a218413e884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:44 user nova-compute[74805]: DEBUG nova.compute.manager [req-aa1102d7-4e54-4942-b1f4-d017f7c1f260 req-9ad635f3-575e-40e7-ac63-654d165b4eff service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] No waiting events found dispatching network-vif-plugged-62730abb-e77d-4e27-8e57-929086b708e3 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:23:44 user nova-compute[74805]: WARNING nova.compute.manager [req-aa1102d7-4e54-4942-b1f4-d017f7c1f260 req-9ad635f3-575e-40e7-ac63-654d165b4eff service nova] [instance: 51e0a627-f95e-4347-92a7-4a218413e884] Received unexpected event network-vif-plugged-62730abb-e77d-4e27-8e57-929086b708e3 for instance with vm_state deleted and task_state None.
Nov 15 04:23:44 user nova-compute[74805]: DEBUG nova.compute.manager [req-aa1102d7-4e54-4942-b1f4-d017f7c1f260 req-9ad635f3-575e-40e7-ac63-654d165b4eff service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Received event network-changed-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:23:44 user nova-compute[74805]: DEBUG nova.compute.manager [req-aa1102d7-4e54-4942-b1f4-d017f7c1f260 req-9ad635f3-575e-40e7-ac63-654d165b4eff service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Refreshing instance network info cache due to event network-changed-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:23:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-aa1102d7-4e54-4942-b1f4-d017f7c1f260 req-9ad635f3-575e-40e7-ac63-654d165b4eff service nova] Acquiring lock "refresh_cache-bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:23:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-aa1102d7-4e54-4942-b1f4-d017f7c1f260 req-9ad635f3-575e-40e7-ac63-654d165b4eff service nova] Acquired lock "refresh_cache-bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:23:44 user nova-compute[74805]: DEBUG nova.network.neutron [req-aa1102d7-4e54-4942-b1f4-d017f7c1f260 req-9ad635f3-575e-40e7-ac63-654d165b4eff service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Refreshing network info cache for port b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:23:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:45 user nova-compute[74805]: DEBUG nova.network.neutron [req-aa1102d7-4e54-4942-b1f4-d017f7c1f260 req-9ad635f3-575e-40e7-ac63-654d165b4eff service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Updated VIF entry in instance network info cache for port b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:23:45 user nova-compute[74805]: DEBUG nova.network.neutron [req-aa1102d7-4e54-4942-b1f4-d017f7c1f260 req-9ad635f3-575e-40e7-ac63-654d165b4eff service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Updating instance_info_cache with network_info: [{"id": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "address": "fa:16:3e:48:b0:09", "network": {"id": "62c3a0d2-d7cf-41dd-adb6-f2331929ee00", "bridge": "br-int", "label": "tempest-TestShelveInstance-1115394549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec78f4baa84125864c0992ecfa6181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5818fba-ad", "ovs_interfaceid": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:23:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-aa1102d7-4e54-4942-b1f4-d017f7c1f260 req-9ad635f3-575e-40e7-ac63-654d165b4eff service nova] Releasing lock "refresh_cache-bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG nova.compute.manager [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:23:46 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Creating image(s)
Nov 15 04:23:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Did not create local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Ensure instance console log exists: /opt/stack/data/nova/instances/bc2e6fef-e9b0-4413-ad26-e4a076cb0b49/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Start _get_guest_xml network_info=[{"id": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "address": "fa:16:3e:48:b0:09", "network": {"id": "62c3a0d2-d7cf-41dd-adb6-f2331929ee00", "bridge": "br-int", "label": "tempest-TestShelveInstance-1115394549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec78f4baa84125864c0992ecfa6181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5818fba-ad", "ovs_interfaceid": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'foiIdAtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bc2e6fef-e9b0-4413-ad26-e4a076cb0b49', 'attached_at': '', 'detached_at': '', 'volume_id': '44a3adea-ac4e-44f2-935b-9d9c28f70afb', 'serial': '44a3adea-ac4e-44f2-935b-9d9c28f70afb'}, 'delete_on_termination': True, 'attachment_id': '97f58ad9-073d-40b5-85d2-ba746001d576', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:23:46 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:23:46 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:23:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'foiIdAtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:23:46 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:23:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:23:46 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:23:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:23:46 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[47769a7d-3004-4b91-a20b-6ad4872fa3c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:23:46 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[107c6c7c-5041-4700-a4c5-f2ada785f1eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb] added
Nov 15 04:23:46 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[64830a15-b936-4c15-9786-14466f548ea3]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[48974e42-53ef-424a-bfc5-77d312126fdf]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v foiIdAtF {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v foiIdAtF" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c673af5-d830-4958-940e-06933bf93bbd]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'foiIdAtF'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[134fe966-1246-4389-906d-5b597bbc353b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b1e1fe-7e4a-4c2b-a082-a9fd1e8a5b69]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 (non-flash)
Nov 15 04:23:46 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 (non-flash)
Nov 15 04:23:46 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2e8ece-acce-4688-9d36-d74ac16554e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb, portal: 172.16.0.220,3260]
Nov 15 04:23:46 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb, portal: 172.16.0.220,3260] successful.
Nov 15 04:23:46 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7489bd6b-68e6-479b-b4b8-a5225286091a]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb0d7eb-b2b6-4af8-9186-5c15173c4580]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 (non-flash)
Nov 15 04:23:46 user nova-compute[74805]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)
Nov 15 04:23:46 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 (non-flash)
Nov 15 04:23:46 user nova-compute[74805]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)
Nov 15 04:23:46 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52308e2-709b-468c-a225-7936b2b00487]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:23:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'foiIdAtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:23:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:23:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23563363264333832', 'path': '/dev/sdc'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:23:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563363264333832', 'path': '/dev/sdc'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:23:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:23:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1631741636',display_name='tempest-TestShelveInstance-server-1631741636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1631741636',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJZ7VNrqog1l5LS5ex5rgm9h9OaqVSpKNKvGoqpKAwA7018UsVo8X4OO2N4xP1K//IYAzTMHD0Ji+yoeCcs7+FCRWzP8wxCbmmZRQ7L83rEsZslABx/Y41Z0E46WakUyQ==',key_name='tempest-TestShelveInstance-385247914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ffec78f4baa84125864c0992ecfa6181',ramdisk_id='',reservation_id='r-il5y2g8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1222914404',owner_user_name='tempest-TestShelveInstance-1222914404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:23:41Z,user_data=None,user_id='4de845d5de0a4cc880f29b4a522c81e1',uuid=bc2e6fef-e9b0-4413-ad26-e4a076cb0b49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "address": "fa:16:3e:48:b0:09", "network": {"id": "62c3a0d2-d7cf-41dd-adb6-f2331929ee00", "bridge": "br-int", "label": "tempest-TestShelveInstance-1115394549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec78f4baa84125864c0992ecfa6181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5818fba-ad", "ovs_interfaceid": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:23:47 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Converting VIF {"id": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "address": "fa:16:3e:48:b0:09", "network": {"id": "62c3a0d2-d7cf-41dd-adb6-f2331929ee00", "bridge": "br-int", "label": "tempest-TestShelveInstance-1115394549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec78f4baa84125864c0992ecfa6181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5818fba-ad", "ovs_interfaceid": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:23:47 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:b0:09,bridge_name='br-int',has_traffic_filtering=True,id=b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31,network=Network(62c3a0d2-d7cf-41dd-adb6-f2331929ee00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5818fba-ad') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:23:47 user nova-compute[74805]: DEBUG nova.objects.instance [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lazy-loading 'pci_devices' on Instance uuid bc2e6fef-e9b0-4413-ad26-e4a076cb0b49 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:23:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:23:47 user nova-compute[74805]:   <uuid>bc2e6fef-e9b0-4413-ad26-e4a076cb0b49</uuid>
Nov 15 04:23:47 user nova-compute[74805]:   <name>instance-0000001a</name>
Nov 15 04:23:47 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:23:47 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:23:47 user nova-compute[74805]:   <metadata>
Nov 15 04:23:47 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:23:47 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:23:47 user nova-compute[74805]:       <nova:name>tempest-TestShelveInstance-server-1631741636</nova:name>
Nov 15 04:23:47 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:23:46</nova:creationTime>
Nov 15 04:23:47 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:23:47 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:23:47 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:23:47 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:23:47 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:23:47 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:23:47 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:23:47 user nova-compute[74805]:       <nova:owner>
Nov 15 04:23:47 user nova-compute[74805]:         <nova:user uuid="4de845d5de0a4cc880f29b4a522c81e1">tempest-TestShelveInstance-1222914404-project-member</nova:user>
Nov 15 04:23:47 user nova-compute[74805]:         <nova:project uuid="ffec78f4baa84125864c0992ecfa6181">tempest-TestShelveInstance-1222914404</nova:project>
Nov 15 04:23:47 user nova-compute[74805]:       </nova:owner>
Nov 15 04:23:47 user nova-compute[74805]:       <nova:ports>
Nov 15 04:23:47 user nova-compute[74805]:         <nova:port uuid="b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31">
Nov 15 04:23:47 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 04:23:47 user nova-compute[74805]:         </nova:port>
Nov 15 04:23:47 user nova-compute[74805]:       </nova:ports>
Nov 15 04:23:47 user nova-compute[74805]:     </nova:instance>
Nov 15 04:23:47 user nova-compute[74805]:   </metadata>
Nov 15 04:23:47 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:23:47 user nova-compute[74805]:     <system>
Nov 15 04:23:47 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:23:47 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:23:47 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:23:47 user nova-compute[74805]:       <entry name="serial">bc2e6fef-e9b0-4413-ad26-e4a076cb0b49</entry>
Nov 15 04:23:47 user nova-compute[74805]:       <entry name="uuid">bc2e6fef-e9b0-4413-ad26-e4a076cb0b49</entry>
Nov 15 04:23:47 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:23:47 user nova-compute[74805]:     </system>
Nov 15 04:23:47 user nova-compute[74805]:   </sysinfo>
Nov 15 04:23:47 user nova-compute[74805]:   <os>
Nov 15 04:23:47 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:23:47 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:23:47 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:23:47 user nova-compute[74805]:   </os>
Nov 15 04:23:47 user nova-compute[74805]:   <features>
Nov 15 04:23:47 user nova-compute[74805]:     <acpi/>
Nov 15 04:23:47 user nova-compute[74805]:     <apic/>
Nov 15 04:23:47 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:23:47 user nova-compute[74805]:   </features>
Nov 15 04:23:47 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:23:47 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:23:47 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:23:47 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:23:47 user nova-compute[74805]:   </clock>
Nov 15 04:23:47 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:23:47 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:23:47 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:23:47 user nova-compute[74805]:   </cpu>
Nov 15 04:23:47 user nova-compute[74805]:   <devices>
Nov 15 04:23:47 user nova-compute[74805]:     <disk type="block" device="disk">
Nov 15 04:23:47 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:23:47 user nova-compute[74805]:       <source dev="/dev/sdc"/>
Nov 15 04:23:47 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:23:47 user nova-compute[74805]:       <serial>44a3adea-ac4e-44f2-935b-9d9c28f70afb</serial>
Nov 15 04:23:47 user nova-compute[74805]:     </disk>
Nov 15 04:23:47 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:23:47 user nova-compute[74805]:       <mac address="fa:16:3e:48:b0:09"/>
Nov 15 04:23:47 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:23:47 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:23:47 user nova-compute[74805]:       <target dev="tapb5818fba-ad"/>
Nov 15 04:23:47 user nova-compute[74805]:     </interface>
Nov 15 04:23:47 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:23:47 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/bc2e6fef-e9b0-4413-ad26-e4a076cb0b49/console.log" append="off"/>
Nov 15 04:23:47 user nova-compute[74805]:     </serial>
Nov 15 04:23:47 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:23:47 user nova-compute[74805]:     <video>
Nov 15 04:23:47 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:23:47 user nova-compute[74805]:     </video>
Nov 15 04:23:47 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:23:47 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:23:47 user nova-compute[74805]:     </rng>
Nov 15 04:23:47 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:23:47 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:23:47 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:23:47 user nova-compute[74805]:     </memballoon>
Nov 15 04:23:47 user nova-compute[74805]:   </devices>
Nov 15 04:23:47 user nova-compute[74805]: </domain>
Nov 15 04:23:47 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:23:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:23:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1631741636',display_name='tempest-TestShelveInstance-server-1631741636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1631741636',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJZ7VNrqog1l5LS5ex5rgm9h9OaqVSpKNKvGoqpKAwA7018UsVo8X4OO2N4xP1K//IYAzTMHD0Ji+yoeCcs7+FCRWzP8wxCbmmZRQ7L83rEsZslABx/Y41Z0E46WakUyQ==',key_name='tempest-TestShelveInstance-385247914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ffec78f4baa84125864c0992ecfa6181',ramdisk_id='',reservation_id='r-il5y2g8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1222914404',owner_user_name='tempest-TestShelveInstance-1222914404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:23:41Z,user_data=None,user_id='4de845d5de0a4cc880f29b4a522c81e1',uuid=bc2e6fef-e9b0-4413-ad26-e4a076cb0b49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "address": "fa:16:3e:48:b0:09", "network": {"id": "62c3a0d2-d7cf-41dd-adb6-f2331929ee00", "bridge": "br-int", "label": "tempest-TestShelveInstance-1115394549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec78f4baa84125864c0992ecfa6181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5818fba-ad", "ovs_interfaceid": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:23:47 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Converting VIF {"id": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "address": "fa:16:3e:48:b0:09", "network": {"id": "62c3a0d2-d7cf-41dd-adb6-f2331929ee00", "bridge": "br-int", "label": "tempest-TestShelveInstance-1115394549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec78f4baa84125864c0992ecfa6181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5818fba-ad", "ovs_interfaceid": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:23:47 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:b0:09,bridge_name='br-int',has_traffic_filtering=True,id=b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31,network=Network(62c3a0d2-d7cf-41dd-adb6-f2331929ee00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5818fba-ad') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:23:47 user nova-compute[74805]: DEBUG os_vif [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:b0:09,bridge_name='br-int',has_traffic_filtering=True,id=b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31,network=Network(62c3a0d2-d7cf-41dd-adb6-f2331929ee00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5818fba-ad') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:23:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:23:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:23:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '01a2484f-44ad-5a30-b4f4-b813f8c4448e', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:23:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:23:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5818fba-ad, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:23:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb5818fba-ad, col_values=(('qos', UUID('5028fa7a-a00f-4b45-9f8c-da72aa36a14e')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:23:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb5818fba-ad, col_values=(('external_ids', {'iface-id': 'b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:b0:09', 'vm-uuid': 'bc2e6fef-e9b0-4413-ad26-e4a076cb0b49'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:23:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:23:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:47 user nova-compute[74805]: INFO os_vif [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:b0:09,bridge_name='br-int',has_traffic_filtering=True,id=b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31,network=Network(62c3a0d2-d7cf-41dd-adb6-f2331929ee00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5818fba-ad')
Nov 15 04:23:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:23:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] No VIF found with MAC fa:16:3e:48:b0:09, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:23:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:49 user nova-compute[74805]: DEBUG nova.compute.manager [req-df5f8499-4be6-4770-9ed8-99d25e392d5d req-103aaeb3-32f4-48e1-b316-7dcfbcbd0f73 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Received event network-vif-plugged-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:23:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-df5f8499-4be6-4770-9ed8-99d25e392d5d req-103aaeb3-32f4-48e1-b316-7dcfbcbd0f73 service nova] Acquiring lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-df5f8499-4be6-4770-9ed8-99d25e392d5d req-103aaeb3-32f4-48e1-b316-7dcfbcbd0f73 service nova] Lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-df5f8499-4be6-4770-9ed8-99d25e392d5d req-103aaeb3-32f4-48e1-b316-7dcfbcbd0f73 service nova] Lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:49 user nova-compute[74805]: DEBUG nova.compute.manager [req-df5f8499-4be6-4770-9ed8-99d25e392d5d req-103aaeb3-32f4-48e1-b316-7dcfbcbd0f73 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] No waiting events found dispatching network-vif-plugged-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:23:49 user nova-compute[74805]: WARNING nova.compute.manager [req-df5f8499-4be6-4770-9ed8-99d25e392d5d req-103aaeb3-32f4-48e1-b316-7dcfbcbd0f73 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Received unexpected event network-vif-plugged-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 for instance with vm_state building and task_state spawning.
Nov 15 04:23:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:51 user nova-compute[74805]: DEBUG nova.compute.manager [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:23:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:23:51 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Instance spawned successfully.
Nov 15 04:23:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:23:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:23:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:23:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:23:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:23:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:23:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:23:51 user nova-compute[74805]: INFO nova.compute.manager [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Took 5.25 seconds to spawn the instance on the hypervisor.
Nov 15 04:23:51 user nova-compute[74805]: DEBUG nova.compute.manager [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:23:51 user nova-compute[74805]: DEBUG nova.compute.manager [req-b9210caf-640f-4d1f-95bf-77040e45fdbb req-8e441b07-2a10-4671-bdb7-20328724e14a service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Received event network-vif-plugged-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:23:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b9210caf-640f-4d1f-95bf-77040e45fdbb req-8e441b07-2a10-4671-bdb7-20328724e14a service nova] Acquiring lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b9210caf-640f-4d1f-95bf-77040e45fdbb req-8e441b07-2a10-4671-bdb7-20328724e14a service nova] Lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b9210caf-640f-4d1f-95bf-77040e45fdbb req-8e441b07-2a10-4671-bdb7-20328724e14a service nova] Lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:51 user nova-compute[74805]: DEBUG nova.compute.manager [req-b9210caf-640f-4d1f-95bf-77040e45fdbb req-8e441b07-2a10-4671-bdb7-20328724e14a service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] No waiting events found dispatching network-vif-plugged-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:23:51 user nova-compute[74805]: WARNING nova.compute.manager [req-b9210caf-640f-4d1f-95bf-77040e45fdbb req-8e441b07-2a10-4671-bdb7-20328724e14a service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Received unexpected event network-vif-plugged-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 for instance with vm_state building and task_state spawning.
Nov 15 04:23:51 user nova-compute[74805]: INFO nova.compute.manager [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Took 11.19 seconds to build instance.
Nov 15 04:23:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1e9d4db4-eaef-4d83-ba16-a4d62b92e365 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.315s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "9f267864-0b72-431d-9b0d-c63436002a4c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "9f267864-0b72-431d-9b0d-c63436002a4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:54 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:23:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:54 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:23:54 user nova-compute[74805]: INFO nova.compute.claims [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Claim successful on node user
Nov 15 04:23:54 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:23:54 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:23:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:54 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:23:55 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:23:55 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:23:55 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:23:55 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:23:55 user nova-compute[74805]: DEBUG nova.policy [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8cba9273daa1478fa6cc8274443b4f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11645073d58476491d101b9f3ee4052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:23:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:55 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:23:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:23:55 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Creating image(s)
Nov 15 04:23:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "/opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "/opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.186s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.195s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk 1073741824" returned: 0 in 0.069s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:55 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Successfully created port: bd5458e6-03d9-4fab-bbfb-23989a82c193 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:23:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.199s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:55 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:23:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Cannot resize image /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Ensure instance console log exists: /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Successfully updated port: bd5458e6-03d9-4fab-bbfb-23989a82c193 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "refresh_cache-9f267864-0b72-431d-9b0d-c63436002a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquired lock "refresh_cache-9f267864-0b72-431d-9b0d-c63436002a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.compute.manager [req-24bdaec3-4a59-4efe-b056-bb3df8a8beca req-17407d7f-1ed4-419f-b98e-8b4c042594ee service nova] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Received event network-changed-bd5458e6-03d9-4fab-bbfb-23989a82c193 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.compute.manager [req-24bdaec3-4a59-4efe-b056-bb3df8a8beca req-17407d7f-1ed4-419f-b98e-8b4c042594ee service nova] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Refreshing instance network info cache due to event network-changed-bd5458e6-03d9-4fab-bbfb-23989a82c193. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-24bdaec3-4a59-4efe-b056-bb3df8a8beca req-17407d7f-1ed4-419f-b98e-8b4c042594ee service nova] Acquiring lock "refresh_cache-9f267864-0b72-431d-9b0d-c63436002a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Updating instance_info_cache with network_info: [{"id": "bd5458e6-03d9-4fab-bbfb-23989a82c193", "address": "fa:16:3e:86:87:bc", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5458e6-03", "ovs_interfaceid": "bd5458e6-03d9-4fab-bbfb-23989a82c193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Releasing lock "refresh_cache-9f267864-0b72-431d-9b0d-c63436002a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Instance network_info: |[{"id": "bd5458e6-03d9-4fab-bbfb-23989a82c193", "address": "fa:16:3e:86:87:bc", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5458e6-03", "ovs_interfaceid": "bd5458e6-03d9-4fab-bbfb-23989a82c193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-24bdaec3-4a59-4efe-b056-bb3df8a8beca req-17407d7f-1ed4-419f-b98e-8b4c042594ee service nova] Acquired lock "refresh_cache-9f267864-0b72-431d-9b0d-c63436002a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.network.neutron [req-24bdaec3-4a59-4efe-b056-bb3df8a8beca req-17407d7f-1ed4-419f-b98e-8b4c042594ee service nova] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Refreshing network info cache for port bd5458e6-03d9-4fab-bbfb-23989a82c193 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Start _get_guest_xml network_info=[{"id": "bd5458e6-03d9-4fab-bbfb-23989a82c193", "address": "fa:16:3e:86:87:bc", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5458e6-03", "ovs_interfaceid": "bd5458e6-03d9-4fab-bbfb-23989a82c193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:23:56 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:23:56 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1546015785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1546015785',id=27,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d11645073d58476491d101b9f3ee4052',ramdisk_id='',reservation_id='r-7nc6syzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1297861260',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:23:55Z,user_data=None,user_id='8cba9273daa1478fa6cc8274443b4f40',uuid=9f267864-0b72-431d-9b0d-c63436002a4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd5458e6-03d9-4fab-bbfb-23989a82c193", "address": "fa:16:3e:86:87:bc", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5458e6-03", "ovs_interfaceid": "bd5458e6-03d9-4fab-bbfb-23989a82c193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Converting VIF {"id": "bd5458e6-03d9-4fab-bbfb-23989a82c193", "address": "fa:16:3e:86:87:bc", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5458e6-03", "ovs_interfaceid": "bd5458e6-03d9-4fab-bbfb-23989a82c193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:87:bc,bridge_name='br-int',has_traffic_filtering=True,id=bd5458e6-03d9-4fab-bbfb-23989a82c193,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd5458e6-03') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.objects.instance [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f267864-0b72-431d-9b0d-c63436002a4c {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:23:56 user nova-compute[74805]:   <uuid>9f267864-0b72-431d-9b0d-c63436002a4c</uuid>
Nov 15 04:23:56 user nova-compute[74805]:   <name>instance-0000001b</name>
Nov 15 04:23:56 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:23:56 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:23:56 user nova-compute[74805]:   <metadata>
Nov 15 04:23:56 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:23:56 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:23:56 user nova-compute[74805]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1546015785</nova:name>
Nov 15 04:23:56 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:23:56</nova:creationTime>
Nov 15 04:23:56 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:23:56 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:23:56 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:23:56 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:23:56 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:23:56 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:23:56 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:23:56 user nova-compute[74805]:       <nova:owner>
Nov 15 04:23:56 user nova-compute[74805]:         <nova:user uuid="8cba9273daa1478fa6cc8274443b4f40">tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member</nova:user>
Nov 15 04:23:56 user nova-compute[74805]:         <nova:project uuid="d11645073d58476491d101b9f3ee4052">tempest-ServerBootFromVolumeStableRescueTest-1297861260</nova:project>
Nov 15 04:23:56 user nova-compute[74805]:       </nova:owner>
Nov 15 04:23:56 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:23:56 user nova-compute[74805]:       <nova:ports>
Nov 15 04:23:56 user nova-compute[74805]:         <nova:port uuid="bd5458e6-03d9-4fab-bbfb-23989a82c193">
Nov 15 04:23:56 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 04:23:56 user nova-compute[74805]:         </nova:port>
Nov 15 04:23:56 user nova-compute[74805]:       </nova:ports>
Nov 15 04:23:56 user nova-compute[74805]:     </nova:instance>
Nov 15 04:23:56 user nova-compute[74805]:   </metadata>
Nov 15 04:23:56 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:23:56 user nova-compute[74805]:     <system>
Nov 15 04:23:56 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:23:56 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:23:56 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:23:56 user nova-compute[74805]:       <entry name="serial">9f267864-0b72-431d-9b0d-c63436002a4c</entry>
Nov 15 04:23:56 user nova-compute[74805]:       <entry name="uuid">9f267864-0b72-431d-9b0d-c63436002a4c</entry>
Nov 15 04:23:56 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:23:56 user nova-compute[74805]:     </system>
Nov 15 04:23:56 user nova-compute[74805]:   </sysinfo>
Nov 15 04:23:56 user nova-compute[74805]:   <os>
Nov 15 04:23:56 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:23:56 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:23:56 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:23:56 user nova-compute[74805]:   </os>
Nov 15 04:23:56 user nova-compute[74805]:   <features>
Nov 15 04:23:56 user nova-compute[74805]:     <acpi/>
Nov 15 04:23:56 user nova-compute[74805]:     <apic/>
Nov 15 04:23:56 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:23:56 user nova-compute[74805]:   </features>
Nov 15 04:23:56 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:23:56 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:23:56 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:23:56 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:23:56 user nova-compute[74805]:   </clock>
Nov 15 04:23:56 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:23:56 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:23:56 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:23:56 user nova-compute[74805]:   </cpu>
Nov 15 04:23:56 user nova-compute[74805]:   <devices>
Nov 15 04:23:56 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:23:56 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:23:56 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk"/>
Nov 15 04:23:56 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:23:56 user nova-compute[74805]:     </disk>
Nov 15 04:23:56 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:23:56 user nova-compute[74805]:       <mac address="fa:16:3e:86:87:bc"/>
Nov 15 04:23:56 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:23:56 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:23:56 user nova-compute[74805]:       <target dev="tapbd5458e6-03"/>
Nov 15 04:23:56 user nova-compute[74805]:     </interface>
Nov 15 04:23:56 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:23:56 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/console.log" append="off"/>
Nov 15 04:23:56 user nova-compute[74805]:     </serial>
Nov 15 04:23:56 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:23:56 user nova-compute[74805]:     <video>
Nov 15 04:23:56 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:23:56 user nova-compute[74805]:     </video>
Nov 15 04:23:56 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:23:56 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:23:56 user nova-compute[74805]:     </rng>
Nov 15 04:23:56 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:23:56 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:23:56 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:23:56 user nova-compute[74805]:     </memballoon>
Nov 15 04:23:56 user nova-compute[74805]:   </devices>
Nov 15 04:23:56 user nova-compute[74805]: </domain>
Nov 15 04:23:56 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1546015785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1546015785',id=27,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d11645073d58476491d101b9f3ee4052',ramdisk_id='',reservation_id='r-7nc6syzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1297861260',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:23:55Z,user_data=None,user_id='8cba9273daa1478fa6cc8274443b4f40',uuid=9f267864-0b72-431d-9b0d-c63436002a4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd5458e6-03d9-4fab-bbfb-23989a82c193", "address": "fa:16:3e:86:87:bc", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5458e6-03", "ovs_interfaceid": "bd5458e6-03d9-4fab-bbfb-23989a82c193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Converting VIF {"id": "bd5458e6-03d9-4fab-bbfb-23989a82c193", "address": "fa:16:3e:86:87:bc", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5458e6-03", "ovs_interfaceid": "bd5458e6-03d9-4fab-bbfb-23989a82c193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:87:bc,bridge_name='br-int',has_traffic_filtering=True,id=bd5458e6-03d9-4fab-bbfb-23989a82c193,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd5458e6-03') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG os_vif [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:87:bc,bridge_name='br-int',has_traffic_filtering=True,id=bd5458e6-03d9-4fab-bbfb-23989a82c193,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd5458e6-03') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d3a857c-ce38-5608-85ea-9e180eeac4b9', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd5458e6-03, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd5458e6-03, col_values=(('qos', UUID('3e3b8458-270c-4f49-8e01-34caf7c1b665')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd5458e6-03, col_values=(('external_ids', {'iface-id': 'bd5458e6-03d9-4fab-bbfb-23989a82c193', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:87:bc', 'vm-uuid': '9f267864-0b72-431d-9b0d-c63436002a4c'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:23:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:56 user nova-compute[74805]: INFO os_vif [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:87:bc,bridge_name='br-int',has_traffic_filtering=True,id=bd5458e6-03d9-4fab-bbfb-23989a82c193,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd5458e6-03')
Nov 15 04:23:57 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:23:57 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] No VIF found with MAC fa:16:3e:86:87:bc, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:23:57 user nova-compute[74805]: DEBUG nova.network.neutron [req-24bdaec3-4a59-4efe-b056-bb3df8a8beca req-17407d7f-1ed4-419f-b98e-8b4c042594ee service nova] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Updated VIF entry in instance network info cache for port bd5458e6-03d9-4fab-bbfb-23989a82c193. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:23:57 user nova-compute[74805]: DEBUG nova.network.neutron [req-24bdaec3-4a59-4efe-b056-bb3df8a8beca req-17407d7f-1ed4-419f-b98e-8b4c042594ee service nova] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Updating instance_info_cache with network_info: [{"id": "bd5458e6-03d9-4fab-bbfb-23989a82c193", "address": "fa:16:3e:86:87:bc", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5458e6-03", "ovs_interfaceid": "bd5458e6-03d9-4fab-bbfb-23989a82c193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:23:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-24bdaec3-4a59-4efe-b056-bb3df8a8beca req-17407d7f-1ed4-419f-b98e-8b4c042594ee service nova] Releasing lock "refresh_cache-9f267864-0b72-431d-9b0d-c63436002a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:23:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:58 user nova-compute[74805]: DEBUG nova.compute.manager [req-f15643e9-4d75-4ffd-a045-437c7bd5a1a1 req-8bd68fad-7ecd-48ea-919d-01042ccdae0d service nova] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Received event network-vif-plugged-bd5458e6-03d9-4fab-bbfb-23989a82c193 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:23:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f15643e9-4d75-4ffd-a045-437c7bd5a1a1 req-8bd68fad-7ecd-48ea-919d-01042ccdae0d service nova] Acquiring lock "9f267864-0b72-431d-9b0d-c63436002a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:23:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f15643e9-4d75-4ffd-a045-437c7bd5a1a1 req-8bd68fad-7ecd-48ea-919d-01042ccdae0d service nova] Lock "9f267864-0b72-431d-9b0d-c63436002a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:23:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f15643e9-4d75-4ffd-a045-437c7bd5a1a1 req-8bd68fad-7ecd-48ea-919d-01042ccdae0d service nova] Lock "9f267864-0b72-431d-9b0d-c63436002a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:23:58 user nova-compute[74805]: DEBUG nova.compute.manager [req-f15643e9-4d75-4ffd-a045-437c7bd5a1a1 req-8bd68fad-7ecd-48ea-919d-01042ccdae0d service nova] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] No waiting events found dispatching network-vif-plugged-bd5458e6-03d9-4fab-bbfb-23989a82c193 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:23:58 user nova-compute[74805]: WARNING nova.compute.manager [req-f15643e9-4d75-4ffd-a045-437c7bd5a1a1 req-8bd68fad-7ecd-48ea-919d-01042ccdae0d service nova] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Received unexpected event network-vif-plugged-bd5458e6-03d9-4fab-bbfb-23989a82c193 for instance with vm_state building and task_state spawning.
Nov 15 04:23:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:23:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:01 user nova-compute[74805]: DEBUG nova.compute.manager [req-f674ba11-1e72-45c6-8642-a8a339071803 req-bf7d6e20-06c9-41bd-ae8f-83ce8954781d service nova] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Received event network-vif-plugged-bd5458e6-03d9-4fab-bbfb-23989a82c193 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:24:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f674ba11-1e72-45c6-8642-a8a339071803 req-bf7d6e20-06c9-41bd-ae8f-83ce8954781d service nova] Acquiring lock "9f267864-0b72-431d-9b0d-c63436002a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f674ba11-1e72-45c6-8642-a8a339071803 req-bf7d6e20-06c9-41bd-ae8f-83ce8954781d service nova] Lock "9f267864-0b72-431d-9b0d-c63436002a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f674ba11-1e72-45c6-8642-a8a339071803 req-bf7d6e20-06c9-41bd-ae8f-83ce8954781d service nova] Lock "9f267864-0b72-431d-9b0d-c63436002a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:01 user nova-compute[74805]: DEBUG nova.compute.manager [req-f674ba11-1e72-45c6-8642-a8a339071803 req-bf7d6e20-06c9-41bd-ae8f-83ce8954781d service nova] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] No waiting events found dispatching network-vif-plugged-bd5458e6-03d9-4fab-bbfb-23989a82c193 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:24:01 user nova-compute[74805]: WARNING nova.compute.manager [req-f674ba11-1e72-45c6-8642-a8a339071803 req-bf7d6e20-06c9-41bd-ae8f-83ce8954781d service nova] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Received unexpected event network-vif-plugged-bd5458e6-03d9-4fab-bbfb-23989a82c193 for instance with vm_state building and task_state spawning.
Nov 15 04:24:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:02 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:24:02 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:24:02 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Instance spawned successfully.
Nov 15 04:24:02 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:24:02 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:24:02 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:24:02 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:24:02 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:24:02 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:24:02 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:24:02 user nova-compute[74805]: INFO nova.compute.manager [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Took 7.57 seconds to spawn the instance on the hypervisor.
Nov 15 04:24:02 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:24:03 user nova-compute[74805]: INFO nova.compute.manager [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Took 8.97 seconds to build instance.
Nov 15 04:24:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b8d36cae-fb05-4763-9a60-2805eee1f316 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "9f267864-0b72-431d-9b0d-c63436002a4c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.211s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:06 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:24:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:07 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:24:07 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:24:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:07 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:24:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:24:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:24:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:24:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:24:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:24:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:24:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk --force-share --output=json" returned: 0 in 0.370s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:24:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:24:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:24:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:24:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8d9f442b-dc92-4a46-af8b-19b7b7656c4d tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Acquiring lock "a1ddc84e-c9e1-4284-8782-7973417486d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8d9f442b-dc92-4a46-af8b-19b7b7656c4d tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "a1ddc84e-c9e1-4284-8782-7973417486d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8d9f442b-dc92-4a46-af8b-19b7b7656c4d tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Acquiring lock "a1ddc84e-c9e1-4284-8782-7973417486d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8d9f442b-dc92-4a46-af8b-19b7b7656c4d tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "a1ddc84e-c9e1-4284-8782-7973417486d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8d9f442b-dc92-4a46-af8b-19b7b7656c4d tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "a1ddc84e-c9e1-4284-8782-7973417486d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:08 user nova-compute[74805]: INFO nova.compute.manager [None req-8d9f442b-dc92-4a46-af8b-19b7b7656c4d tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Terminating instance
Nov 15 04:24:08 user nova-compute[74805]: DEBUG nova.compute.manager [None req-8d9f442b-dc92-4a46-af8b-19b7b7656c4d tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:24:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json" returned: 0 in 0.370s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:24:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:24:09 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:24:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:24:09 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:09 user nova-compute[74805]: DEBUG nova.compute.manager [req-45004e3b-87d5-4586-9597-8797bf14db98 req-1f919956-cc01-4e61-afe3-783635140486 service nova] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Received event network-vif-unplugged-f5cc7efb-fb8e-453c-b34c-a6df55603359 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:24:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-45004e3b-87d5-4586-9597-8797bf14db98 req-1f919956-cc01-4e61-afe3-783635140486 service nova] Acquiring lock "a1ddc84e-c9e1-4284-8782-7973417486d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-45004e3b-87d5-4586-9597-8797bf14db98 req-1f919956-cc01-4e61-afe3-783635140486 service nova] Lock "a1ddc84e-c9e1-4284-8782-7973417486d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-45004e3b-87d5-4586-9597-8797bf14db98 req-1f919956-cc01-4e61-afe3-783635140486 service nova] Lock "a1ddc84e-c9e1-4284-8782-7973417486d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:09 user nova-compute[74805]: DEBUG nova.compute.manager [req-45004e3b-87d5-4586-9597-8797bf14db98 req-1f919956-cc01-4e61-afe3-783635140486 service nova] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] No waiting events found dispatching network-vif-unplugged-f5cc7efb-fb8e-453c-b34c-a6df55603359 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:24:09 user nova-compute[74805]: DEBUG nova.compute.manager [req-45004e3b-87d5-4586-9597-8797bf14db98 req-1f919956-cc01-4e61-afe3-783635140486 service nova] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Received event network-vif-unplugged-f5cc7efb-fb8e-453c-b34c-a6df55603359 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:24:09 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:24:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:24:09 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:24:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:24:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:24:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:24:09 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Instance destroyed successfully.
Nov 15 04:24:09 user nova-compute[74805]: DEBUG nova.objects.instance [None req-8d9f442b-dc92-4a46-af8b-19b7b7656c4d tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lazy-loading 'resources' on Instance uuid a1ddc84e-c9e1-4284-8782-7973417486d8 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:24:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-8d9f442b-dc92-4a46-af8b-19b7b7656c4d tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:22:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-654881351',display_name='tempest-VolumesAdminNegativeTest-server-654881351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-654881351',id=24,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:22:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13324230e774496aa688ef50d872cb1f',ramdisk_id='',reservation_id='r-s5o1a6nr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-77980530',owner_user_name='tempest-VolumesAdminNegativeTest-77980530-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:22:18Z,user_data=None,user_id='3e816730fe634ef08d520fd01186b10e',uuid=a1ddc84e-c9e1-4284-8782-7973417486d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5cc7efb-fb8e-453c-b34c-a6df55603359", "address": "fa:16:3e:d5:48:2c", "network": {"id": "8a59b0de-c0e7-442f-90fa-ccb85294d3f7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640403300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13324230e774496aa688ef50d872cb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5cc7efb-fb", "ovs_interfaceid": "f5cc7efb-fb8e-453c-b34c-a6df55603359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:24:10 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-8d9f442b-dc92-4a46-af8b-19b7b7656c4d tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Converting VIF {"id": "f5cc7efb-fb8e-453c-b34c-a6df55603359", "address": "fa:16:3e:d5:48:2c", "network": {"id": "8a59b0de-c0e7-442f-90fa-ccb85294d3f7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640403300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13324230e774496aa688ef50d872cb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5cc7efb-fb", "ovs_interfaceid": "f5cc7efb-fb8e-453c-b34c-a6df55603359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:24:10 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-8d9f442b-dc92-4a46-af8b-19b7b7656c4d tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:48:2c,bridge_name='br-int',has_traffic_filtering=True,id=f5cc7efb-fb8e-453c-b34c-a6df55603359,network=Network(8a59b0de-c0e7-442f-90fa-ccb85294d3f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5cc7efb-fb') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:24:10 user nova-compute[74805]: DEBUG os_vif [None req-8d9f442b-dc92-4a46-af8b-19b7b7656c4d tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:48:2c,bridge_name='br-int',has_traffic_filtering=True,id=f5cc7efb-fb8e-453c-b34c-a6df55603359,network=Network(8a59b0de-c0e7-442f-90fa-ccb85294d3f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5cc7efb-fb') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:24:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5cc7efb-fb, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:24:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:24:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b8e45d2-26e1-489f-90cd-e20c471948f9) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:24:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:24:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:10 user nova-compute[74805]: INFO os_vif [None req-8d9f442b-dc92-4a46-af8b-19b7b7656c4d tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:48:2c,bridge_name='br-int',has_traffic_filtering=True,id=f5cc7efb-fb8e-453c-b34c-a6df55603359,network=Network(8a59b0de-c0e7-442f-90fa-ccb85294d3f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5cc7efb-fb')
Nov 15 04:24:10 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-8d9f442b-dc92-4a46-af8b-19b7b7656c4d tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Deleting instance files /opt/stack/data/nova/instances/a1ddc84e-c9e1-4284-8782-7973417486d8_del
Nov 15 04:24:10 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-8d9f442b-dc92-4a46-af8b-19b7b7656c4d tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Deletion of /opt/stack/data/nova/instances/a1ddc84e-c9e1-4284-8782-7973417486d8_del complete
Nov 15 04:24:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:24:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:24:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:24:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:10 user nova-compute[74805]: INFO nova.compute.manager [None req-8d9f442b-dc92-4a46-af8b-19b7b7656c4d tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Took 1.53 seconds to destroy the instance on the hypervisor.
Nov 15 04:24:10 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-8d9f442b-dc92-4a46-af8b-19b7b7656c4d tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:24:10 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:24:10 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:24:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:24:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:24:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:24:10 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Error from libvirt while getting description of instance-00000018: [Error Code 42] Domain not found: no domain with matching uuid 'a1ddc84e-c9e1-4284-8782-7973417486d8' (instance-00000018): libvirt.libvirtError: Domain not found: no domain with matching uuid 'a1ddc84e-c9e1-4284-8782-7973417486d8' (instance-00000018)
Nov 15 04:24:11 user nova-compute[74805]: DEBUG nova.compute.manager [req-b60a2e7f-ae05-4e77-a58b-3479a1f8f089 req-1d1eb8e7-f0c6-492d-8f95-83b41ad4ea3b service nova] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Received event network-vif-deleted-f5cc7efb-fb8e-453c-b34c-a6df55603359 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:24:11 user nova-compute[74805]: INFO nova.compute.manager [req-b60a2e7f-ae05-4e77-a58b-3479a1f8f089 req-1d1eb8e7-f0c6-492d-8f95-83b41ad4ea3b service nova] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Neutron deleted interface f5cc7efb-fb8e-453c-b34c-a6df55603359; detaching it from the instance and deleting it from the info cache
Nov 15 04:24:11 user nova-compute[74805]: DEBUG nova.network.neutron [req-b60a2e7f-ae05-4e77-a58b-3479a1f8f089 req-1d1eb8e7-f0c6-492d-8f95-83b41ad4ea3b service nova] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:24:11 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:24:11 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:24:11 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:24:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=7888MB free_disk=24.65587615966797GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:24:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:11 user nova-compute[74805]: DEBUG nova.compute.manager [req-b60a2e7f-ae05-4e77-a58b-3479a1f8f089 req-1d1eb8e7-f0c6-492d-8f95-83b41ad4ea3b service nova] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Detach interface failed, port_id=f5cc7efb-fb8e-453c-b34c-a6df55603359, reason: Instance a1ddc84e-c9e1-4284-8782-7973417486d8 could not be found. {{(pid=74805) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 04:24:11 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Took 1.05 seconds to deallocate network for instance.
Nov 15 04:24:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8d9f442b-dc92-4a46-af8b-19b7b7656c4d tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance d63f3726-27df-455f-bda0-3ddca95b70d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:24:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance e5004557-00fa-4824-9233-343c2261588d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:24:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 45c66453-2f83-476b-a03b-6bdbb01d1849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:24:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance f329eddf-6a3b-4f05-9353-1b1e475ba420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:24:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance a1ddc84e-c9e1-4284-8782-7973417486d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:24:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 4a2d5475-04a4-414d-9ce9-d5204494f898 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:24:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance bc2e6fef-e9b0-4413-ad26-e4a076cb0b49 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:24:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 9f267864-0b72-431d-9b0d-c63436002a4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:24:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:24:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:24:11 user nova-compute[74805]: DEBUG nova.compute.manager [req-4b4af3c6-d0f3-466f-9b7a-84da26aefa6f req-01832971-3b0c-4982-baf8-0b601eb3cf8a service nova] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Received event network-vif-plugged-f5cc7efb-fb8e-453c-b34c-a6df55603359 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:24:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-4b4af3c6-d0f3-466f-9b7a-84da26aefa6f req-01832971-3b0c-4982-baf8-0b601eb3cf8a service nova] Acquiring lock "a1ddc84e-c9e1-4284-8782-7973417486d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-4b4af3c6-d0f3-466f-9b7a-84da26aefa6f req-01832971-3b0c-4982-baf8-0b601eb3cf8a service nova] Lock "a1ddc84e-c9e1-4284-8782-7973417486d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-4b4af3c6-d0f3-466f-9b7a-84da26aefa6f req-01832971-3b0c-4982-baf8-0b601eb3cf8a service nova] Lock "a1ddc84e-c9e1-4284-8782-7973417486d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:11 user nova-compute[74805]: DEBUG nova.compute.manager [req-4b4af3c6-d0f3-466f-9b7a-84da26aefa6f req-01832971-3b0c-4982-baf8-0b601eb3cf8a service nova] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] No waiting events found dispatching network-vif-plugged-f5cc7efb-fb8e-453c-b34c-a6df55603359 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:24:11 user nova-compute[74805]: WARNING nova.compute.manager [req-4b4af3c6-d0f3-466f-9b7a-84da26aefa6f req-01832971-3b0c-4982-baf8-0b601eb3cf8a service nova] [instance: a1ddc84e-c9e1-4284-8782-7973417486d8] Received unexpected event network-vif-plugged-f5cc7efb-fb8e-453c-b34c-a6df55603359 for instance with vm_state deleted and task_state None.
Nov 15 04:24:11 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:24:11 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:24:11 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:24:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.566s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8d9f442b-dc92-4a46-af8b-19b7b7656c4d tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.425s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:12 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-8d9f442b-dc92-4a46-af8b-19b7b7656c4d tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:24:12 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-8d9f442b-dc92-4a46-af8b-19b7b7656c4d tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:24:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8d9f442b-dc92-4a46-af8b-19b7b7656c4d tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:12 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-8d9f442b-dc92-4a46-af8b-19b7b7656c4d tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Deleted allocations for instance a1ddc84e-c9e1-4284-8782-7973417486d8
Nov 15 04:24:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8d9f442b-dc92-4a46-af8b-19b7b7656c4d tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "a1ddc84e-c9e1-4284-8782-7973417486d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.634s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:12 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:24:12 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:24:12 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:24:12 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:24:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-e5004557-00fa-4824-9233-343c2261588d" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:24:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-e5004557-00fa-4824-9233-343c2261588d" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:24:12 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: e5004557-00fa-4824-9233-343c2261588d] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:24:13 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: e5004557-00fa-4824-9233-343c2261588d] Updating instance_info_cache with network_info: [{"id": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "address": "fa:16:3e:c8:0f:b4", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96104fe5-a8", "ovs_interfaceid": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:24:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-e5004557-00fa-4824-9233-343c2261588d" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:24:13 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: e5004557-00fa-4824-9233-343c2261588d] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:24:13 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:24:13 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:24:13 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:24:15 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:24:15 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:24:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:18 user nova-compute[74805]: DEBUG nova.compute.manager [req-c0800c82-3c90-477d-952d-ec6f3db6a0d7 req-30fc18d7-f1c0-44ac-b8b4-1ef23fe3123f service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Received event network-changed-90a9632d-7041-430e-a0f4-0b8ec60eb332 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:24:18 user nova-compute[74805]: DEBUG nova.compute.manager [req-c0800c82-3c90-477d-952d-ec6f3db6a0d7 req-30fc18d7-f1c0-44ac-b8b4-1ef23fe3123f service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Refreshing instance network info cache due to event network-changed-90a9632d-7041-430e-a0f4-0b8ec60eb332. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:24:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c0800c82-3c90-477d-952d-ec6f3db6a0d7 req-30fc18d7-f1c0-44ac-b8b4-1ef23fe3123f service nova] Acquiring lock "refresh_cache-4a2d5475-04a4-414d-9ce9-d5204494f898" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:24:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c0800c82-3c90-477d-952d-ec6f3db6a0d7 req-30fc18d7-f1c0-44ac-b8b4-1ef23fe3123f service nova] Acquired lock "refresh_cache-4a2d5475-04a4-414d-9ce9-d5204494f898" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:24:18 user nova-compute[74805]: DEBUG nova.network.neutron [req-c0800c82-3c90-477d-952d-ec6f3db6a0d7 req-30fc18d7-f1c0-44ac-b8b4-1ef23fe3123f service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Refreshing network info cache for port 90a9632d-7041-430e-a0f4-0b8ec60eb332 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:24:18 user nova-compute[74805]: DEBUG nova.network.neutron [req-c0800c82-3c90-477d-952d-ec6f3db6a0d7 req-30fc18d7-f1c0-44ac-b8b4-1ef23fe3123f service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Updated VIF entry in instance network info cache for port 90a9632d-7041-430e-a0f4-0b8ec60eb332. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:24:18 user nova-compute[74805]: DEBUG nova.network.neutron [req-c0800c82-3c90-477d-952d-ec6f3db6a0d7 req-30fc18d7-f1c0-44ac-b8b4-1ef23fe3123f service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Updating instance_info_cache with network_info: [{"id": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "address": "fa:16:3e:61:a1:b6", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a9632d-70", "ovs_interfaceid": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:24:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c0800c82-3c90-477d-952d-ec6f3db6a0d7 req-30fc18d7-f1c0-44ac-b8b4-1ef23fe3123f service nova] Releasing lock "refresh_cache-4a2d5475-04a4-414d-9ce9-d5204494f898" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:24:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Acquiring lock "bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Lock "bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:19 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:24:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:20 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:24:20 user nova-compute[74805]: INFO nova.compute.claims [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Claim successful on node user
Nov 15 04:24:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:20 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:24:20 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:24:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:20 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:24:20 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:24:20 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:24:20 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:24:20 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:24:20 user nova-compute[74805]: DEBUG nova.policy [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e56b4cdf0792437fb2faa830366ec4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10d75d23473b4fb48a22ad55d6cf93e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:24:20 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:24:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:24:20 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Creating image(s)
Nov 15 04:24:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Lock "/opt/stack/data/nova/instances/bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.287s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Lock "/opt/stack/data/nova/instances/bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.192s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.185s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Successfully created port: 3af89bf6-2da7-4d33-a99c-ef123b1732c2 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd/disk 1073741824" returned: 0 in 0.050s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "4a2d5475-04a4-414d-9ce9-d5204494f898" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "4a2d5475-04a4-414d-9ce9-d5204494f898" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:21 user nova-compute[74805]: INFO nova.compute.manager [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Shelving
Nov 15 04:24:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.179s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Cannot resize image /opt/stack/data/nova/instances/bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Ensure instance console log exists: /opt/stack/data/nova/instances/bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG nova.compute.manager [req-8925d3e8-f90d-44e6-b70b-7290f821362e req-83f75542-9504-4e45-a036-7c3473edc69d service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Received event network-vif-unplugged-90a9632d-7041-430e-a0f4-0b8ec60eb332 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8925d3e8-f90d-44e6-b70b-7290f821362e req-83f75542-9504-4e45-a036-7c3473edc69d service nova] Acquiring lock "4a2d5475-04a4-414d-9ce9-d5204494f898-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8925d3e8-f90d-44e6-b70b-7290f821362e req-83f75542-9504-4e45-a036-7c3473edc69d service nova] Lock "4a2d5475-04a4-414d-9ce9-d5204494f898-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8925d3e8-f90d-44e6-b70b-7290f821362e req-83f75542-9504-4e45-a036-7c3473edc69d service nova] Lock "4a2d5475-04a4-414d-9ce9-d5204494f898-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:21 user nova-compute[74805]: DEBUG nova.compute.manager [req-8925d3e8-f90d-44e6-b70b-7290f821362e req-83f75542-9504-4e45-a036-7c3473edc69d service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] No waiting events found dispatching network-vif-unplugged-90a9632d-7041-430e-a0f4-0b8ec60eb332 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:24:21 user nova-compute[74805]: WARNING nova.compute.manager [req-8925d3e8-f90d-44e6-b70b-7290f821362e req-83f75542-9504-4e45-a036-7c3473edc69d service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Received unexpected event network-vif-unplugged-90a9632d-7041-430e-a0f4-0b8ec60eb332 for instance with vm_state active and task_state shelving.
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Successfully updated port: 3af89bf6-2da7-4d33-a99c-ef123b1732c2 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Acquiring lock "refresh_cache-bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Acquired lock "refresh_cache-bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:24:22 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Instance destroyed successfully.
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:24:22 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Beginning cold snapshot process
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-dc1c26a8-5fef-46e7-a030-03d00345524c req-8cb68cda-718f-490c-9102-88f2a9b82d66 service nova] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Received event network-changed-3af89bf6-2da7-4d33-a99c-ef123b1732c2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-dc1c26a8-5fef-46e7-a030-03d00345524c req-8cb68cda-718f-490c-9102-88f2a9b82d66 service nova] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Refreshing instance network info cache due to event network-changed-3af89bf6-2da7-4d33-a99c-ef123b1732c2. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-dc1c26a8-5fef-46e7-a030-03d00345524c req-8cb68cda-718f-490c-9102-88f2a9b82d66 service nova] Acquiring lock "refresh_cache-bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.privsep.utils [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74805) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk /opt/stack/data/nova/instances/snapshots/tmppqgzm9et/8aada4e30c31413eb892e839ba42e694 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Updating instance_info_cache with network_info: [{"id": "3af89bf6-2da7-4d33-a99c-ef123b1732c2", "address": "fa:16:3e:f8:84:fb", "network": {"id": "8ef5c460-a691-4872-b212-64425d090e83", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "73611220d55a49e9a671c10706774c3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3af89bf6-2d", "ovs_interfaceid": "3af89bf6-2da7-4d33-a99c-ef123b1732c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Releasing lock "refresh_cache-bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Instance network_info: |[{"id": "3af89bf6-2da7-4d33-a99c-ef123b1732c2", "address": "fa:16:3e:f8:84:fb", "network": {"id": "8ef5c460-a691-4872-b212-64425d090e83", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "73611220d55a49e9a671c10706774c3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3af89bf6-2d", "ovs_interfaceid": "3af89bf6-2da7-4d33-a99c-ef123b1732c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-dc1c26a8-5fef-46e7-a030-03d00345524c req-8cb68cda-718f-490c-9102-88f2a9b82d66 service nova] Acquired lock "refresh_cache-bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.network.neutron [req-dc1c26a8-5fef-46e7-a030-03d00345524c req-8cb68cda-718f-490c-9102-88f2a9b82d66 service nova] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Refreshing network info cache for port 3af89bf6-2da7-4d33-a99c-ef123b1732c2 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Start _get_guest_xml network_info=[{"id": "3af89bf6-2da7-4d33-a99c-ef123b1732c2", "address": "fa:16:3e:f8:84:fb", "network": {"id": "8ef5c460-a691-4872-b212-64425d090e83", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "73611220d55a49e9a671c10706774c3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3af89bf6-2d", "ovs_interfaceid": "3af89bf6-2da7-4d33-a99c-ef123b1732c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:24:22 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:24:22 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:24:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-631993904',display_name='tempest-VolumesNegativeTest-instance-631993904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-631993904',id=28,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='10d75d23473b4fb48a22ad55d6cf93e8',ramdisk_id='',reservation_id='r-7vc0km5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1422002093',owner_user_name='tempest-VolumesNegativeTest-1422002093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:24:21Z,user_data=None,user_id='e56b4cdf0792437fb2faa830366ec4f2',uuid=bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3af89bf6-2da7-4d33-a99c-ef123b1732c2", "address": "fa:16:3e:f8:84:fb", "network": {"id": "8ef5c460-a691-4872-b212-64425d090e83", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "73611220d55a49e9a671c10706774c3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3af89bf6-2d", "ovs_interfaceid": "3af89bf6-2da7-4d33-a99c-ef123b1732c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Converting VIF {"id": "3af89bf6-2da7-4d33-a99c-ef123b1732c2", "address": "fa:16:3e:f8:84:fb", "network": {"id": "8ef5c460-a691-4872-b212-64425d090e83", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "73611220d55a49e9a671c10706774c3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3af89bf6-2d", "ovs_interfaceid": "3af89bf6-2da7-4d33-a99c-ef123b1732c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:84:fb,bridge_name='br-int',has_traffic_filtering=True,id=3af89bf6-2da7-4d33-a99c-ef123b1732c2,network=Network(8ef5c460-a691-4872-b212-64425d090e83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3af89bf6-2d') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:24:22 user nova-compute[74805]: DEBUG nova.objects.instance [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Lazy-loading 'pci_devices' on Instance uuid bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:24:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:24:23 user nova-compute[74805]:   <uuid>bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd</uuid>
Nov 15 04:24:23 user nova-compute[74805]:   <name>instance-0000001c</name>
Nov 15 04:24:23 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:24:23 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:24:23 user nova-compute[74805]:   <metadata>
Nov 15 04:24:23 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:24:23 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:24:23 user nova-compute[74805]:       <nova:name>tempest-VolumesNegativeTest-instance-631993904</nova:name>
Nov 15 04:24:23 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:24:22</nova:creationTime>
Nov 15 04:24:23 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:24:23 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:24:23 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:24:23 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:24:23 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:24:23 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:24:23 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:24:23 user nova-compute[74805]:       <nova:owner>
Nov 15 04:24:23 user nova-compute[74805]:         <nova:user uuid="e56b4cdf0792437fb2faa830366ec4f2">tempest-VolumesNegativeTest-1422002093-project-member</nova:user>
Nov 15 04:24:23 user nova-compute[74805]:         <nova:project uuid="10d75d23473b4fb48a22ad55d6cf93e8">tempest-VolumesNegativeTest-1422002093</nova:project>
Nov 15 04:24:23 user nova-compute[74805]:       </nova:owner>
Nov 15 04:24:23 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:24:23 user nova-compute[74805]:       <nova:ports>
Nov 15 04:24:23 user nova-compute[74805]:         <nova:port uuid="3af89bf6-2da7-4d33-a99c-ef123b1732c2">
Nov 15 04:24:23 user nova-compute[74805]:           <nova:ip type="fixed" address="192.168.233.244" ipVersion="4"/>
Nov 15 04:24:23 user nova-compute[74805]:         </nova:port>
Nov 15 04:24:23 user nova-compute[74805]:       </nova:ports>
Nov 15 04:24:23 user nova-compute[74805]:     </nova:instance>
Nov 15 04:24:23 user nova-compute[74805]:   </metadata>
Nov 15 04:24:23 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:24:23 user nova-compute[74805]:     <system>
Nov 15 04:24:23 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:24:23 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:24:23 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:24:23 user nova-compute[74805]:       <entry name="serial">bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd</entry>
Nov 15 04:24:23 user nova-compute[74805]:       <entry name="uuid">bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd</entry>
Nov 15 04:24:23 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:24:23 user nova-compute[74805]:     </system>
Nov 15 04:24:23 user nova-compute[74805]:   </sysinfo>
Nov 15 04:24:23 user nova-compute[74805]:   <os>
Nov 15 04:24:23 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:24:23 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:24:23 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:24:23 user nova-compute[74805]:   </os>
Nov 15 04:24:23 user nova-compute[74805]:   <features>
Nov 15 04:24:23 user nova-compute[74805]:     <acpi/>
Nov 15 04:24:23 user nova-compute[74805]:     <apic/>
Nov 15 04:24:23 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:24:23 user nova-compute[74805]:   </features>
Nov 15 04:24:23 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:24:23 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:24:23 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:24:23 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:24:23 user nova-compute[74805]:   </clock>
Nov 15 04:24:23 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:24:23 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:24:23 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:24:23 user nova-compute[74805]:   </cpu>
Nov 15 04:24:23 user nova-compute[74805]:   <devices>
Nov 15 04:24:23 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:24:23 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:24:23 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd/disk"/>
Nov 15 04:24:23 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:24:23 user nova-compute[74805]:     </disk>
Nov 15 04:24:23 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:24:23 user nova-compute[74805]:       <mac address="fa:16:3e:f8:84:fb"/>
Nov 15 04:24:23 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:24:23 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:24:23 user nova-compute[74805]:       <target dev="tap3af89bf6-2d"/>
Nov 15 04:24:23 user nova-compute[74805]:     </interface>
Nov 15 04:24:23 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:24:23 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd/console.log" append="off"/>
Nov 15 04:24:23 user nova-compute[74805]:     </serial>
Nov 15 04:24:23 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:24:23 user nova-compute[74805]:     <video>
Nov 15 04:24:23 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:24:23 user nova-compute[74805]:     </video>
Nov 15 04:24:23 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:24:23 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:24:23 user nova-compute[74805]:     </rng>
Nov 15 04:24:23 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:24:23 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:24:23 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:24:23 user nova-compute[74805]:     </memballoon>
Nov 15 04:24:23 user nova-compute[74805]:   </devices>
Nov 15 04:24:23 user nova-compute[74805]: </domain>
Nov 15 04:24:23 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:24:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:24:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-631993904',display_name='tempest-VolumesNegativeTest-instance-631993904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-631993904',id=28,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='10d75d23473b4fb48a22ad55d6cf93e8',ramdisk_id='',reservation_id='r-7vc0km5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1422002093',owner_user_name='tempest-VolumesNegativeTest-1422002093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:24:21Z,user_data=None,user_id='e56b4cdf0792437fb2faa830366ec4f2',uuid=bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3af89bf6-2da7-4d33-a99c-ef123b1732c2", "address": "fa:16:3e:f8:84:fb", "network": {"id": "8ef5c460-a691-4872-b212-64425d090e83", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "73611220d55a49e9a671c10706774c3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3af89bf6-2d", "ovs_interfaceid": "3af89bf6-2da7-4d33-a99c-ef123b1732c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:24:23 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Converting VIF {"id": "3af89bf6-2da7-4d33-a99c-ef123b1732c2", "address": "fa:16:3e:f8:84:fb", "network": {"id": "8ef5c460-a691-4872-b212-64425d090e83", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "73611220d55a49e9a671c10706774c3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3af89bf6-2d", "ovs_interfaceid": "3af89bf6-2da7-4d33-a99c-ef123b1732c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:24:23 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:84:fb,bridge_name='br-int',has_traffic_filtering=True,id=3af89bf6-2da7-4d33-a99c-ef123b1732c2,network=Network(8ef5c460-a691-4872-b212-64425d090e83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3af89bf6-2d') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:24:23 user nova-compute[74805]: DEBUG os_vif [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:84:fb,bridge_name='br-int',has_traffic_filtering=True,id=3af89bf6-2da7-4d33-a99c-ef123b1732c2,network=Network(8ef5c460-a691-4872-b212-64425d090e83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3af89bf6-2d') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:24:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:24:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:24:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b5bea727-6a39-5ae4-80c4-7bcac6f52714', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:24:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:24:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3af89bf6-2d, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:24:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3af89bf6-2d, col_values=(('qos', UUID('0cfda220-3ea4-48ad-a6f3-0768aa32373a')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:24:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3af89bf6-2d, col_values=(('external_ids', {'iface-id': '3af89bf6-2da7-4d33-a99c-ef123b1732c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:84:fb', 'vm-uuid': 'bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:24:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:24:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:23 user nova-compute[74805]: INFO os_vif [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:84:fb,bridge_name='br-int',has_traffic_filtering=True,id=3af89bf6-2da7-4d33-a99c-ef123b1732c2,network=Network(8ef5c460-a691-4872-b212-64425d090e83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3af89bf6-2d')
Nov 15 04:24:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:24:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] No VIF found with MAC fa:16:3e:f8:84:fb, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:24:23 user nova-compute[74805]: DEBUG nova.network.neutron [req-dc1c26a8-5fef-46e7-a030-03d00345524c req-8cb68cda-718f-490c-9102-88f2a9b82d66 service nova] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Updated VIF entry in instance network info cache for port 3af89bf6-2da7-4d33-a99c-ef123b1732c2. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:24:23 user nova-compute[74805]: DEBUG nova.network.neutron [req-dc1c26a8-5fef-46e7-a030-03d00345524c req-8cb68cda-718f-490c-9102-88f2a9b82d66 service nova] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Updating instance_info_cache with network_info: [{"id": "3af89bf6-2da7-4d33-a99c-ef123b1732c2", "address": "fa:16:3e:f8:84:fb", "network": {"id": "8ef5c460-a691-4872-b212-64425d090e83", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "73611220d55a49e9a671c10706774c3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3af89bf6-2d", "ovs_interfaceid": "3af89bf6-2da7-4d33-a99c-ef123b1732c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:24:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-dc1c26a8-5fef-46e7-a030-03d00345524c req-8cb68cda-718f-490c-9102-88f2a9b82d66 service nova] Releasing lock "refresh_cache-bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:24:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk /opt/stack/data/nova/instances/snapshots/tmppqgzm9et/8aada4e30c31413eb892e839ba42e694" returned: 0 in 0.945s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:24:23 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Snapshot extracted, beginning image upload
Nov 15 04:24:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-8560bada-86e8-4375-b9b8-d8db380e5d40 req-9f58d532-18e8-4bc3-874d-4e21c290d64a service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Received event network-vif-plugged-90a9632d-7041-430e-a0f4-0b8ec60eb332 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:24:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8560bada-86e8-4375-b9b8-d8db380e5d40 req-9f58d532-18e8-4bc3-874d-4e21c290d64a service nova] Acquiring lock "4a2d5475-04a4-414d-9ce9-d5204494f898-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8560bada-86e8-4375-b9b8-d8db380e5d40 req-9f58d532-18e8-4bc3-874d-4e21c290d64a service nova] Lock "4a2d5475-04a4-414d-9ce9-d5204494f898-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8560bada-86e8-4375-b9b8-d8db380e5d40 req-9f58d532-18e8-4bc3-874d-4e21c290d64a service nova] Lock "4a2d5475-04a4-414d-9ce9-d5204494f898-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-8560bada-86e8-4375-b9b8-d8db380e5d40 req-9f58d532-18e8-4bc3-874d-4e21c290d64a service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] No waiting events found dispatching network-vif-plugged-90a9632d-7041-430e-a0f4-0b8ec60eb332 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:24:24 user nova-compute[74805]: WARNING nova.compute.manager [req-8560bada-86e8-4375-b9b8-d8db380e5d40 req-9f58d532-18e8-4bc3-874d-4e21c290d64a service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Received unexpected event network-vif-plugged-90a9632d-7041-430e-a0f4-0b8ec60eb332 for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 04:24:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-67435800-5fe6-4490-961d-60d8f29c6396 req-8550c3fe-b175-4015-bd65-9772accd62e7 service nova] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Received event network-vif-plugged-3af89bf6-2da7-4d33-a99c-ef123b1732c2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:24:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-67435800-5fe6-4490-961d-60d8f29c6396 req-8550c3fe-b175-4015-bd65-9772accd62e7 service nova] Acquiring lock "bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-67435800-5fe6-4490-961d-60d8f29c6396 req-8550c3fe-b175-4015-bd65-9772accd62e7 service nova] Lock "bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-67435800-5fe6-4490-961d-60d8f29c6396 req-8550c3fe-b175-4015-bd65-9772accd62e7 service nova] Lock "bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-67435800-5fe6-4490-961d-60d8f29c6396 req-8550c3fe-b175-4015-bd65-9772accd62e7 service nova] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] No waiting events found dispatching network-vif-plugged-3af89bf6-2da7-4d33-a99c-ef123b1732c2 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:24:24 user nova-compute[74805]: WARNING nova.compute.manager [req-67435800-5fe6-4490-961d-60d8f29c6396 req-8550c3fe-b175-4015-bd65-9772accd62e7 service nova] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Received unexpected event network-vif-plugged-3af89bf6-2da7-4d33-a99c-ef123b1732c2 for instance with vm_state building and task_state spawning.
Nov 15 04:24:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:26 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Snapshot image upload complete
Nov 15 04:24:26 user nova-compute[74805]: DEBUG nova.compute.manager [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:24:26 user nova-compute[74805]: INFO nova.compute.manager [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Shelve offloading
Nov 15 04:24:26 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Instance destroyed successfully.
Nov 15 04:24:26 user nova-compute[74805]: DEBUG nova.compute.manager [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:24:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "refresh_cache-4a2d5475-04a4-414d-9ce9-d5204494f898" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:24:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquired lock "refresh_cache-4a2d5475-04a4-414d-9ce9-d5204494f898" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:24:26 user nova-compute[74805]: DEBUG nova.network.neutron [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:24:26 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:24:26 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:24:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-5623fb53-6034-48b1-92cb-09317e072828 req-968d6acb-6620-499b-b20b-4d993cd043f0 service nova] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Received event network-vif-plugged-3af89bf6-2da7-4d33-a99c-ef123b1732c2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:24:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5623fb53-6034-48b1-92cb-09317e072828 req-968d6acb-6620-499b-b20b-4d993cd043f0 service nova] Acquiring lock "bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5623fb53-6034-48b1-92cb-09317e072828 req-968d6acb-6620-499b-b20b-4d993cd043f0 service nova] Lock "bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5623fb53-6034-48b1-92cb-09317e072828 req-968d6acb-6620-499b-b20b-4d993cd043f0 service nova] Lock "bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-5623fb53-6034-48b1-92cb-09317e072828 req-968d6acb-6620-499b-b20b-4d993cd043f0 service nova] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] No waiting events found dispatching network-vif-plugged-3af89bf6-2da7-4d33-a99c-ef123b1732c2 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:24:26 user nova-compute[74805]: WARNING nova.compute.manager [req-5623fb53-6034-48b1-92cb-09317e072828 req-968d6acb-6620-499b-b20b-4d993cd043f0 service nova] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Received unexpected event network-vif-plugged-3af89bf6-2da7-4d33-a99c-ef123b1732c2 for instance with vm_state building and task_state spawning.
Nov 15 04:24:26 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Instance spawned successfully.
Nov 15 04:24:26 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:24:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:24:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:24:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:24:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:24:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:24:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:24:27 user nova-compute[74805]: INFO nova.compute.manager [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Took 6.50 seconds to spawn the instance on the hypervisor.
Nov 15 04:24:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:24:27 user nova-compute[74805]: INFO nova.compute.manager [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Took 7.16 seconds to build instance.
Nov 15 04:24:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b17aa5ac-3ca5-4004-8402-ba4668fdace2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Lock "bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.257s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:27 user nova-compute[74805]: DEBUG nova.network.neutron [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Updating instance_info_cache with network_info: [{"id": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "address": "fa:16:3e:61:a1:b6", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a9632d-70", "ovs_interfaceid": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:24:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Releasing lock "refresh_cache-4a2d5475-04a4-414d-9ce9-d5204494f898" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:24:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:29 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Instance destroyed successfully.
Nov 15 04:24:29 user nova-compute[74805]: DEBUG nova.objects.instance [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lazy-loading 'resources' on Instance uuid 4a2d5475-04a4-414d-9ce9-d5204494f898 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-918598282',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-918598282',id=25,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMymrvqIzYGxGC8fgN4EdQbJ0JI3rZYj1T8Y5E6V+FSJeCmAYkDYrYJ8BCpQMPV7261ZAXmjrXyft6H81pTvLfoVVhh1tKM5UtLUU619sjSGelYRZRrJtmj2R7elo05DA==',key_name='tempest-keypair-1201355498',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:22:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5e01874e82ed4ae08813343751506eeb',ramdisk_id='',reservation_id='r-0vg8si2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2114494734',owner_user_name='tempest-AttachVolumeShelveTestJSON-2114494734-project-member',shelved_at='2023-11-15T04:24:26.371308',shelved_host='user',shelved_image_id='f15a0a7c-9de2-42b0-9fe6-e61b97e06657'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:24:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2876983d30794d8db191857d2f420f7d',uuid=4a2d5475-04a4-414d-9ce9-d5204494f898,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "address": "fa:16:3e:61:a1:b6", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a9632d-70", "ovs_interfaceid": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Converting VIF {"id": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "address": "fa:16:3e:61:a1:b6", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a9632d-70", "ovs_interfaceid": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:a1:b6,bridge_name='br-int',has_traffic_filtering=True,id=90a9632d-7041-430e-a0f4-0b8ec60eb332,network=Network(5febf498-f447-4e3b-a484-320124bd0158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a9632d-70') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG os_vif [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:a1:b6,bridge_name='br-int',has_traffic_filtering=True,id=90a9632d-7041-430e-a0f4-0b8ec60eb332,network=Network(5febf498-f447-4e3b-a484-320124bd0158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a9632d-70') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90a9632d-70, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG nova.compute.manager [req-5f29930c-145d-499a-adb1-fc4bb61e5669 req-5e44638d-0626-4ab5-af4e-9c525cf41881 service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Received event network-changed-90a9632d-7041-430e-a0f4-0b8ec60eb332 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG nova.compute.manager [req-5f29930c-145d-499a-adb1-fc4bb61e5669 req-5e44638d-0626-4ab5-af4e-9c525cf41881 service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Refreshing instance network info cache due to event network-changed-90a9632d-7041-430e-a0f4-0b8ec60eb332. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5f29930c-145d-499a-adb1-fc4bb61e5669 req-5e44638d-0626-4ab5-af4e-9c525cf41881 service nova] Acquiring lock "refresh_cache-4a2d5475-04a4-414d-9ce9-d5204494f898" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5f29930c-145d-499a-adb1-fc4bb61e5669 req-5e44638d-0626-4ab5-af4e-9c525cf41881 service nova] Acquired lock "refresh_cache-4a2d5475-04a4-414d-9ce9-d5204494f898" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG nova.network.neutron [req-5f29930c-145d-499a-adb1-fc4bb61e5669 req-5e44638d-0626-4ab5-af4e-9c525cf41881 service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Refreshing network info cache for port 90a9632d-7041-430e-a0f4-0b8ec60eb332 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8636bac8-a6f2-4d23-aafe-e8b919b77dbf) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:29 user nova-compute[74805]: INFO os_vif [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:a1:b6,bridge_name='br-int',has_traffic_filtering=True,id=90a9632d-7041-430e-a0f4-0b8ec60eb332,network=Network(5febf498-f447-4e3b-a484-320124bd0158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a9632d-70')
Nov 15 04:24:29 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Deleting instance files /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898_del
Nov 15 04:24:29 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Deletion of /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898_del complete
Nov 15 04:24:29 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Deleted allocations for instance 4a2d5475-04a4-414d-9ce9-d5204494f898
Nov 15 04:24:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "6594aaea-3698-4d56-babf-95f9654138f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "6594aaea-3698-4d56-babf-95f9654138f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG nova.objects.instance [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lazy-loading 'numa_topology' on Instance uuid 4a2d5475-04a4-414d-9ce9-d5204494f898 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG nova.objects.base [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Object Instance<4a2d5475-04a4-414d-9ce9-d5204494f898> lazy-loaded attributes: resources,numa_topology {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.271s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:24:29 user nova-compute[74805]: INFO nova.compute.claims [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Claim successful on node user
Nov 15 04:24:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-45cec8d5-95ae-4ccf-881e-d4b499befce7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "4a2d5475-04a4-414d-9ce9-d5204494f898" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.424s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG nova.network.neutron [req-5f29930c-145d-499a-adb1-fc4bb61e5669 req-5e44638d-0626-4ab5-af4e-9c525cf41881 service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Updated VIF entry in instance network info cache for port 90a9632d-7041-430e-a0f4-0b8ec60eb332. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG nova.network.neutron [req-5f29930c-145d-499a-adb1-fc4bb61e5669 req-5e44638d-0626-4ab5-af4e-9c525cf41881 service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Updating instance_info_cache with network_info: [{"id": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "address": "fa:16:3e:61:a1:b6", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap90a9632d-70", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:24:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5f29930c-145d-499a-adb1-fc4bb61e5669 req-5e44638d-0626-4ab5-af4e-9c525cf41881 service nova] Releasing lock "refresh_cache-4a2d5475-04a4-414d-9ce9-d5204494f898" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:24:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:30 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:24:30 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:24:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.580s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:30 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:24:30 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:24:30 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:24:30 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:24:30 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:24:30 user nova-compute[74805]: DEBUG nova.policy [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba1bcf1e429045129d379293cc490bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8280c6302b2e42998c7c436522c47e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:24:30 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:24:30 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:24:30 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Creating image(s)
Nov 15 04:24:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "/opt/stack/data/nova/instances/6594aaea-3698-4d56-babf-95f9654138f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "/opt/stack/data/nova/instances/6594aaea-3698-4d56-babf-95f9654138f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "/opt/stack/data/nova/instances/6594aaea-3698-4d56-babf-95f9654138f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:30 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:24:30 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.191s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:24:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:30 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:24:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.209s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:24:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/6594aaea-3698-4d56-babf-95f9654138f1/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:24:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/6594aaea-3698-4d56-babf-95f9654138f1/disk 1073741824" returned: 0 in 0.052s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:24:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:24:31 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Successfully created port: dd7dff22-92a5-49fa-a626-381e41aff96e {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:24:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.192s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:24:31 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6594aaea-3698-4d56-babf-95f9654138f1/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:24:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6594aaea-3698-4d56-babf-95f9654138f1/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:24:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6594aaea-3698-4d56-babf-95f9654138f1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:24:31 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Cannot resize image /opt/stack/data/nova/instances/6594aaea-3698-4d56-babf-95f9654138f1/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:24:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:24:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Ensure instance console log exists: /opt/stack/data/nova/instances/6594aaea-3698-4d56-babf-95f9654138f1/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:24:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:31 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Successfully updated port: dd7dff22-92a5-49fa-a626-381e41aff96e {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:24:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "refresh_cache-6594aaea-3698-4d56-babf-95f9654138f1" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:24:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquired lock "refresh_cache-6594aaea-3698-4d56-babf-95f9654138f1" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:24:31 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:24:31 user nova-compute[74805]: DEBUG nova.compute.manager [req-a6891a3c-8aa1-4ece-aabd-b7999cc060d6 req-1291febf-b04f-43ec-88f4-6fbf0af6da3d service nova] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Received event network-changed-dd7dff22-92a5-49fa-a626-381e41aff96e {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:24:31 user nova-compute[74805]: DEBUG nova.compute.manager [req-a6891a3c-8aa1-4ece-aabd-b7999cc060d6 req-1291febf-b04f-43ec-88f4-6fbf0af6da3d service nova] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Refreshing instance network info cache due to event network-changed-dd7dff22-92a5-49fa-a626-381e41aff96e. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:24:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-a6891a3c-8aa1-4ece-aabd-b7999cc060d6 req-1291febf-b04f-43ec-88f4-6fbf0af6da3d service nova] Acquiring lock "refresh_cache-6594aaea-3698-4d56-babf-95f9654138f1" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:24:31 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Updating instance_info_cache with network_info: [{"id": "dd7dff22-92a5-49fa-a626-381e41aff96e", "address": "fa:16:3e:b3:03:ad", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7dff22-92", "ovs_interfaceid": "dd7dff22-92a5-49fa-a626-381e41aff96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Releasing lock "refresh_cache-6594aaea-3698-4d56-babf-95f9654138f1" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Instance network_info: |[{"id": "dd7dff22-92a5-49fa-a626-381e41aff96e", "address": "fa:16:3e:b3:03:ad", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7dff22-92", "ovs_interfaceid": "dd7dff22-92a5-49fa-a626-381e41aff96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-a6891a3c-8aa1-4ece-aabd-b7999cc060d6 req-1291febf-b04f-43ec-88f4-6fbf0af6da3d service nova] Acquired lock "refresh_cache-6594aaea-3698-4d56-babf-95f9654138f1" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.network.neutron [req-a6891a3c-8aa1-4ece-aabd-b7999cc060d6 req-1291febf-b04f-43ec-88f4-6fbf0af6da3d service nova] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Refreshing network info cache for port dd7dff22-92a5-49fa-a626-381e41aff96e {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Start _get_guest_xml network_info=[{"id": "dd7dff22-92a5-49fa-a626-381e41aff96e", "address": "fa:16:3e:b3:03:ad", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7dff22-92", "ovs_interfaceid": "dd7dff22-92a5-49fa-a626-381e41aff96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:24:32 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:24:32 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:24:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1554897870',display_name='tempest-AttachVolumeNegativeTest-server-1554897870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1554897870',id=29,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7q1MREnC2oa0490nBsqykazceRuECSy3eb/+EVFi7bhATwCVy9elm/cmDKDyK3aBbUGnuDuTZS/y+VD1Vv3YovVfgWofb6bxIMW0gzq8nJhLJgK0rxBeLiHXxTWIPJ0g==',key_name='tempest-keypair-1555135107',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8280c6302b2e42998c7c436522c47e79',ramdisk_id='',reservation_id='r-mm5s8exu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-6184130',owner_user_name='tempest-AttachVolumeNegativeTest-6184130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:24:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba1bcf1e429045129d379293cc490bde',uuid=6594aaea-3698-4d56-babf-95f9654138f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd7dff22-92a5-49fa-a626-381e41aff96e", "address": "fa:16:3e:b3:03:ad", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7dff22-92", "ovs_interfaceid": "dd7dff22-92a5-49fa-a626-381e41aff96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Converting VIF {"id": "dd7dff22-92a5-49fa-a626-381e41aff96e", "address": "fa:16:3e:b3:03:ad", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7dff22-92", "ovs_interfaceid": "dd7dff22-92a5-49fa-a626-381e41aff96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:03:ad,bridge_name='br-int',has_traffic_filtering=True,id=dd7dff22-92a5-49fa-a626-381e41aff96e,network=Network(3454b4d8-1ff9-4f3c-9a93-499645affcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd7dff22-92') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.objects.instance [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lazy-loading 'pci_devices' on Instance uuid 6594aaea-3698-4d56-babf-95f9654138f1 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:24:32 user nova-compute[74805]:   <uuid>6594aaea-3698-4d56-babf-95f9654138f1</uuid>
Nov 15 04:24:32 user nova-compute[74805]:   <name>instance-0000001d</name>
Nov 15 04:24:32 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:24:32 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:24:32 user nova-compute[74805]:   <metadata>
Nov 15 04:24:32 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:24:32 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:24:32 user nova-compute[74805]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1554897870</nova:name>
Nov 15 04:24:32 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:24:32</nova:creationTime>
Nov 15 04:24:32 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:24:32 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:24:32 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:24:32 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:24:32 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:24:32 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:24:32 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:24:32 user nova-compute[74805]:       <nova:owner>
Nov 15 04:24:32 user nova-compute[74805]:         <nova:user uuid="ba1bcf1e429045129d379293cc490bde">tempest-AttachVolumeNegativeTest-6184130-project-member</nova:user>
Nov 15 04:24:32 user nova-compute[74805]:         <nova:project uuid="8280c6302b2e42998c7c436522c47e79">tempest-AttachVolumeNegativeTest-6184130</nova:project>
Nov 15 04:24:32 user nova-compute[74805]:       </nova:owner>
Nov 15 04:24:32 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:24:32 user nova-compute[74805]:       <nova:ports>
Nov 15 04:24:32 user nova-compute[74805]:         <nova:port uuid="dd7dff22-92a5-49fa-a626-381e41aff96e">
Nov 15 04:24:32 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 04:24:32 user nova-compute[74805]:         </nova:port>
Nov 15 04:24:32 user nova-compute[74805]:       </nova:ports>
Nov 15 04:24:32 user nova-compute[74805]:     </nova:instance>
Nov 15 04:24:32 user nova-compute[74805]:   </metadata>
Nov 15 04:24:32 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:24:32 user nova-compute[74805]:     <system>
Nov 15 04:24:32 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:24:32 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:24:32 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:24:32 user nova-compute[74805]:       <entry name="serial">6594aaea-3698-4d56-babf-95f9654138f1</entry>
Nov 15 04:24:32 user nova-compute[74805]:       <entry name="uuid">6594aaea-3698-4d56-babf-95f9654138f1</entry>
Nov 15 04:24:32 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:24:32 user nova-compute[74805]:     </system>
Nov 15 04:24:32 user nova-compute[74805]:   </sysinfo>
Nov 15 04:24:32 user nova-compute[74805]:   <os>
Nov 15 04:24:32 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:24:32 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:24:32 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:24:32 user nova-compute[74805]:   </os>
Nov 15 04:24:32 user nova-compute[74805]:   <features>
Nov 15 04:24:32 user nova-compute[74805]:     <acpi/>
Nov 15 04:24:32 user nova-compute[74805]:     <apic/>
Nov 15 04:24:32 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:24:32 user nova-compute[74805]:   </features>
Nov 15 04:24:32 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:24:32 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:24:32 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:24:32 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:24:32 user nova-compute[74805]:   </clock>
Nov 15 04:24:32 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:24:32 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:24:32 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:24:32 user nova-compute[74805]:   </cpu>
Nov 15 04:24:32 user nova-compute[74805]:   <devices>
Nov 15 04:24:32 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:24:32 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:24:32 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/6594aaea-3698-4d56-babf-95f9654138f1/disk"/>
Nov 15 04:24:32 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:24:32 user nova-compute[74805]:     </disk>
Nov 15 04:24:32 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:24:32 user nova-compute[74805]:       <mac address="fa:16:3e:b3:03:ad"/>
Nov 15 04:24:32 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:24:32 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:24:32 user nova-compute[74805]:       <target dev="tapdd7dff22-92"/>
Nov 15 04:24:32 user nova-compute[74805]:     </interface>
Nov 15 04:24:32 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:24:32 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/6594aaea-3698-4d56-babf-95f9654138f1/console.log" append="off"/>
Nov 15 04:24:32 user nova-compute[74805]:     </serial>
Nov 15 04:24:32 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:24:32 user nova-compute[74805]:     <video>
Nov 15 04:24:32 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:24:32 user nova-compute[74805]:     </video>
Nov 15 04:24:32 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:24:32 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:24:32 user nova-compute[74805]:     </rng>
Nov 15 04:24:32 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:24:32 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:24:32 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:24:32 user nova-compute[74805]:     </memballoon>
Nov 15 04:24:32 user nova-compute[74805]:   </devices>
Nov 15 04:24:32 user nova-compute[74805]: </domain>
Nov 15 04:24:32 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:24:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1554897870',display_name='tempest-AttachVolumeNegativeTest-server-1554897870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1554897870',id=29,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7q1MREnC2oa0490nBsqykazceRuECSy3eb/+EVFi7bhATwCVy9elm/cmDKDyK3aBbUGnuDuTZS/y+VD1Vv3YovVfgWofb6bxIMW0gzq8nJhLJgK0rxBeLiHXxTWIPJ0g==',key_name='tempest-keypair-1555135107',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8280c6302b2e42998c7c436522c47e79',ramdisk_id='',reservation_id='r-mm5s8exu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-6184130',owner_user_name='tempest-AttachVolumeNegativeTest-6184130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:24:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba1bcf1e429045129d379293cc490bde',uuid=6594aaea-3698-4d56-babf-95f9654138f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd7dff22-92a5-49fa-a626-381e41aff96e", "address": "fa:16:3e:b3:03:ad", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7dff22-92", "ovs_interfaceid": "dd7dff22-92a5-49fa-a626-381e41aff96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Converting VIF {"id": "dd7dff22-92a5-49fa-a626-381e41aff96e", "address": "fa:16:3e:b3:03:ad", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7dff22-92", "ovs_interfaceid": "dd7dff22-92a5-49fa-a626-381e41aff96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:03:ad,bridge_name='br-int',has_traffic_filtering=True,id=dd7dff22-92a5-49fa-a626-381e41aff96e,network=Network(3454b4d8-1ff9-4f3c-9a93-499645affcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd7dff22-92') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG os_vif [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:03:ad,bridge_name='br-int',has_traffic_filtering=True,id=dd7dff22-92a5-49fa-a626-381e41aff96e,network=Network(3454b4d8-1ff9-4f3c-9a93-499645affcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd7dff22-92') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '21ab2e7f-a242-5649-9e07-58c903dde668', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd7dff22-92, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd7dff22-92, col_values=(('qos', UUID('34528be6-6291-4b75-805a-a5c83441c11b')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd7dff22-92, col_values=(('external_ids', {'iface-id': 'dd7dff22-92a5-49fa-a626-381e41aff96e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:03:ad', 'vm-uuid': '6594aaea-3698-4d56-babf-95f9654138f1'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:32 user nova-compute[74805]: INFO os_vif [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:03:ad,bridge_name='br-int',has_traffic_filtering=True,id=dd7dff22-92a5-49fa-a626-381e41aff96e,network=Network(3454b4d8-1ff9-4f3c-9a93-499645affcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd7dff22-92')
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] No VIF found with MAC fa:16:3e:b3:03:ad, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.network.neutron [req-a6891a3c-8aa1-4ece-aabd-b7999cc060d6 req-1291febf-b04f-43ec-88f4-6fbf0af6da3d service nova] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Updated VIF entry in instance network info cache for port dd7dff22-92a5-49fa-a626-381e41aff96e. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG nova.network.neutron [req-a6891a3c-8aa1-4ece-aabd-b7999cc060d6 req-1291febf-b04f-43ec-88f4-6fbf0af6da3d service nova] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Updating instance_info_cache with network_info: [{"id": "dd7dff22-92a5-49fa-a626-381e41aff96e", "address": "fa:16:3e:b3:03:ad", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7dff22-92", "ovs_interfaceid": "dd7dff22-92a5-49fa-a626-381e41aff96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:24:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-a6891a3c-8aa1-4ece-aabd-b7999cc060d6 req-1291febf-b04f-43ec-88f4-6fbf0af6da3d service nova] Releasing lock "refresh_cache-6594aaea-3698-4d56-babf-95f9654138f1" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:24:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:33 user nova-compute[74805]: DEBUG nova.compute.manager [req-527ee83c-367c-4fb0-834d-c8235f42fadb req-7c32e2af-5a4d-4445-abcd-207bcb5f6f33 service nova] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Received event network-vif-plugged-dd7dff22-92a5-49fa-a626-381e41aff96e {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:24:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-527ee83c-367c-4fb0-834d-c8235f42fadb req-7c32e2af-5a4d-4445-abcd-207bcb5f6f33 service nova] Acquiring lock "6594aaea-3698-4d56-babf-95f9654138f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-527ee83c-367c-4fb0-834d-c8235f42fadb req-7c32e2af-5a4d-4445-abcd-207bcb5f6f33 service nova] Lock "6594aaea-3698-4d56-babf-95f9654138f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-527ee83c-367c-4fb0-834d-c8235f42fadb req-7c32e2af-5a4d-4445-abcd-207bcb5f6f33 service nova] Lock "6594aaea-3698-4d56-babf-95f9654138f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:33 user nova-compute[74805]: DEBUG nova.compute.manager [req-527ee83c-367c-4fb0-834d-c8235f42fadb req-7c32e2af-5a4d-4445-abcd-207bcb5f6f33 service nova] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] No waiting events found dispatching network-vif-plugged-dd7dff22-92a5-49fa-a626-381e41aff96e {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:24:33 user nova-compute[74805]: WARNING nova.compute.manager [req-527ee83c-367c-4fb0-834d-c8235f42fadb req-7c32e2af-5a4d-4445-abcd-207bcb5f6f33 service nova] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Received unexpected event network-vif-plugged-dd7dff22-92a5-49fa-a626-381e41aff96e for instance with vm_state building and task_state spawning.
Nov 15 04:24:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:36 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:24:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:24:36 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Instance spawned successfully.
Nov 15 04:24:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:24:36 user nova-compute[74805]: DEBUG nova.compute.manager [req-38c86cc1-2cea-49f6-bada-44b964c8a962 req-1b8970af-cf0e-4102-b714-60382f32d1eb service nova] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Received event network-vif-plugged-dd7dff22-92a5-49fa-a626-381e41aff96e {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:24:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-38c86cc1-2cea-49f6-bada-44b964c8a962 req-1b8970af-cf0e-4102-b714-60382f32d1eb service nova] Acquiring lock "6594aaea-3698-4d56-babf-95f9654138f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-38c86cc1-2cea-49f6-bada-44b964c8a962 req-1b8970af-cf0e-4102-b714-60382f32d1eb service nova] Lock "6594aaea-3698-4d56-babf-95f9654138f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-38c86cc1-2cea-49f6-bada-44b964c8a962 req-1b8970af-cf0e-4102-b714-60382f32d1eb service nova] Lock "6594aaea-3698-4d56-babf-95f9654138f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:36 user nova-compute[74805]: DEBUG nova.compute.manager [req-38c86cc1-2cea-49f6-bada-44b964c8a962 req-1b8970af-cf0e-4102-b714-60382f32d1eb service nova] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] No waiting events found dispatching network-vif-plugged-dd7dff22-92a5-49fa-a626-381e41aff96e {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:24:36 user nova-compute[74805]: WARNING nova.compute.manager [req-38c86cc1-2cea-49f6-bada-44b964c8a962 req-1b8970af-cf0e-4102-b714-60382f32d1eb service nova] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Received unexpected event network-vif-plugged-dd7dff22-92a5-49fa-a626-381e41aff96e for instance with vm_state building and task_state spawning.
Nov 15 04:24:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:24:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:24:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:24:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:24:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:24:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:24:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:36 user nova-compute[74805]: INFO nova.compute.manager [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Took 5.75 seconds to spawn the instance on the hypervisor.
Nov 15 04:24:36 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:24:36 user nova-compute[74805]: INFO nova.compute.manager [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Took 6.97 seconds to build instance.
Nov 15 04:24:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ae1befbd-a564-4e7b-b142-6963e05b580a tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "6594aaea-3698-4d56-babf-95f9654138f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.091s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:39 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:24:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:39 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:24:39 user nova-compute[74805]: INFO nova.compute.claims [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Claim successful on node user
Nov 15 04:24:39 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:24:39 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:24:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:40 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:24:40 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:24:40 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:24:40 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:24:40 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:24:40 user nova-compute[74805]: DEBUG nova.policy [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '147187e3ec664f869db966f1e47a2445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '464531969a244952b436e763f17ab970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:24:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:40 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:24:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:24:40 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Creating image(s)
Nov 15 04:24:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "/opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "/opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:24:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.186s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:24:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:24:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.185s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:24:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:24:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk 1073741824" returned: 0 in 0.060s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:24:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:24:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.190s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:24:40 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:24:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:24:40 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Successfully created port: b5adbddb-acb3-40b1-9768-923daa9f3a29 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Cannot resize image /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Ensure instance console log exists: /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Successfully updated port: b5adbddb-acb3-40b1-9768-923daa9f3a29 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "refresh_cache-8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquired lock "refresh_cache-8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.compute.manager [req-7d8d83e8-0f44-4b1c-97ad-23d357e73107 req-ebcce0f7-1c8f-4ca8-8aab-b78ce67c5124 service nova] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Received event network-changed-b5adbddb-acb3-40b1-9768-923daa9f3a29 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.compute.manager [req-7d8d83e8-0f44-4b1c-97ad-23d357e73107 req-ebcce0f7-1c8f-4ca8-8aab-b78ce67c5124 service nova] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Refreshing instance network info cache due to event network-changed-b5adbddb-acb3-40b1-9768-923daa9f3a29. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7d8d83e8-0f44-4b1c-97ad-23d357e73107 req-ebcce0f7-1c8f-4ca8-8aab-b78ce67c5124 service nova] Acquiring lock "refresh_cache-8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Updating instance_info_cache with network_info: [{"id": "b5adbddb-acb3-40b1-9768-923daa9f3a29", "address": "fa:16:3e:7f:dc:30", "network": {"id": "a06a4001-e7e0-4991-b68a-0a0395d22e19", "bridge": "br-int", "label": "tempest-TestStampPattern-341788822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464531969a244952b436e763f17ab970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5adbddb-ac", "ovs_interfaceid": "b5adbddb-acb3-40b1-9768-923daa9f3a29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Releasing lock "refresh_cache-8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Instance network_info: |[{"id": "b5adbddb-acb3-40b1-9768-923daa9f3a29", "address": "fa:16:3e:7f:dc:30", "network": {"id": "a06a4001-e7e0-4991-b68a-0a0395d22e19", "bridge": "br-int", "label": "tempest-TestStampPattern-341788822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464531969a244952b436e763f17ab970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5adbddb-ac", "ovs_interfaceid": "b5adbddb-acb3-40b1-9768-923daa9f3a29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7d8d83e8-0f44-4b1c-97ad-23d357e73107 req-ebcce0f7-1c8f-4ca8-8aab-b78ce67c5124 service nova] Acquired lock "refresh_cache-8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.network.neutron [req-7d8d83e8-0f44-4b1c-97ad-23d357e73107 req-ebcce0f7-1c8f-4ca8-8aab-b78ce67c5124 service nova] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Refreshing network info cache for port b5adbddb-acb3-40b1-9768-923daa9f3a29 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Start _get_guest_xml network_info=[{"id": "b5adbddb-acb3-40b1-9768-923daa9f3a29", "address": "fa:16:3e:7f:dc:30", "network": {"id": "a06a4001-e7e0-4991-b68a-0a0395d22e19", "bridge": "br-int", "label": "tempest-TestStampPattern-341788822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464531969a244952b436e763f17ab970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5adbddb-ac", "ovs_interfaceid": "b5adbddb-acb3-40b1-9768-923daa9f3a29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:24:41 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:24:41 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:24:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1181153034',display_name='tempest-TestStampPattern-server-1181153034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1181153034',id=30,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0NRAQgDbUZf0EbqtKAGHs4GX+/AbapMrSMTst3yG7lWtxqhChiIE0p667dQ9MtVVa6R0YR0OFwR3oN8tOTGfWd9b0OvJqkw2muo0XPuAEVruetlLFRHgQ9v/OWONwx2w==',key_name='tempest-TestStampPattern-1861490322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='464531969a244952b436e763f17ab970',ramdisk_id='',reservation_id='r-ymdi31sg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1523333335',owner_user_name='tempest-TestStampPattern-1523333335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:24:40Z,user_data=None,user_id='147187e3ec664f869db966f1e47a2445',uuid=8d27a3c7-54c7-45fd-85ab-05aa3d375a4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5adbddb-acb3-40b1-9768-923daa9f3a29", "address": "fa:16:3e:7f:dc:30", "network": {"id": "a06a4001-e7e0-4991-b68a-0a0395d22e19", "bridge": "br-int", "label": "tempest-TestStampPattern-341788822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464531969a244952b436e763f17ab970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5adbddb-ac", "ovs_interfaceid": "b5adbddb-acb3-40b1-9768-923daa9f3a29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Converting VIF {"id": "b5adbddb-acb3-40b1-9768-923daa9f3a29", "address": "fa:16:3e:7f:dc:30", "network": {"id": "a06a4001-e7e0-4991-b68a-0a0395d22e19", "bridge": "br-int", "label": "tempest-TestStampPattern-341788822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464531969a244952b436e763f17ab970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5adbddb-ac", "ovs_interfaceid": "b5adbddb-acb3-40b1-9768-923daa9f3a29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:dc:30,bridge_name='br-int',has_traffic_filtering=True,id=b5adbddb-acb3-40b1-9768-923daa9f3a29,network=Network(a06a4001-e7e0-4991-b68a-0a0395d22e19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5adbddb-ac') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:24:41 user nova-compute[74805]: DEBUG nova.objects.instance [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:24:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:24:42 user nova-compute[74805]:   <uuid>8d27a3c7-54c7-45fd-85ab-05aa3d375a4c</uuid>
Nov 15 04:24:42 user nova-compute[74805]:   <name>instance-0000001e</name>
Nov 15 04:24:42 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:24:42 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:24:42 user nova-compute[74805]:   <metadata>
Nov 15 04:24:42 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:24:42 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:24:42 user nova-compute[74805]:       <nova:name>tempest-TestStampPattern-server-1181153034</nova:name>
Nov 15 04:24:42 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:24:41</nova:creationTime>
Nov 15 04:24:42 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:24:42 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:24:42 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:24:42 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:24:42 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:24:42 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:24:42 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:24:42 user nova-compute[74805]:       <nova:owner>
Nov 15 04:24:42 user nova-compute[74805]:         <nova:user uuid="147187e3ec664f869db966f1e47a2445">tempest-TestStampPattern-1523333335-project-member</nova:user>
Nov 15 04:24:42 user nova-compute[74805]:         <nova:project uuid="464531969a244952b436e763f17ab970">tempest-TestStampPattern-1523333335</nova:project>
Nov 15 04:24:42 user nova-compute[74805]:       </nova:owner>
Nov 15 04:24:42 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:24:42 user nova-compute[74805]:       <nova:ports>
Nov 15 04:24:42 user nova-compute[74805]:         <nova:port uuid="b5adbddb-acb3-40b1-9768-923daa9f3a29">
Nov 15 04:24:42 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 04:24:42 user nova-compute[74805]:         </nova:port>
Nov 15 04:24:42 user nova-compute[74805]:       </nova:ports>
Nov 15 04:24:42 user nova-compute[74805]:     </nova:instance>
Nov 15 04:24:42 user nova-compute[74805]:   </metadata>
Nov 15 04:24:42 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:24:42 user nova-compute[74805]:     <system>
Nov 15 04:24:42 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:24:42 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:24:42 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:24:42 user nova-compute[74805]:       <entry name="serial">8d27a3c7-54c7-45fd-85ab-05aa3d375a4c</entry>
Nov 15 04:24:42 user nova-compute[74805]:       <entry name="uuid">8d27a3c7-54c7-45fd-85ab-05aa3d375a4c</entry>
Nov 15 04:24:42 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:24:42 user nova-compute[74805]:     </system>
Nov 15 04:24:42 user nova-compute[74805]:   </sysinfo>
Nov 15 04:24:42 user nova-compute[74805]:   <os>
Nov 15 04:24:42 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:24:42 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:24:42 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:24:42 user nova-compute[74805]:   </os>
Nov 15 04:24:42 user nova-compute[74805]:   <features>
Nov 15 04:24:42 user nova-compute[74805]:     <acpi/>
Nov 15 04:24:42 user nova-compute[74805]:     <apic/>
Nov 15 04:24:42 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:24:42 user nova-compute[74805]:   </features>
Nov 15 04:24:42 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:24:42 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:24:42 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:24:42 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:24:42 user nova-compute[74805]:   </clock>
Nov 15 04:24:42 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:24:42 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:24:42 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:24:42 user nova-compute[74805]:   </cpu>
Nov 15 04:24:42 user nova-compute[74805]:   <devices>
Nov 15 04:24:42 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:24:42 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:24:42 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk"/>
Nov 15 04:24:42 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:24:42 user nova-compute[74805]:     </disk>
Nov 15 04:24:42 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:24:42 user nova-compute[74805]:       <mac address="fa:16:3e:7f:dc:30"/>
Nov 15 04:24:42 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:24:42 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:24:42 user nova-compute[74805]:       <target dev="tapb5adbddb-ac"/>
Nov 15 04:24:42 user nova-compute[74805]:     </interface>
Nov 15 04:24:42 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:24:42 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/console.log" append="off"/>
Nov 15 04:24:42 user nova-compute[74805]:     </serial>
Nov 15 04:24:42 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:24:42 user nova-compute[74805]:     <video>
Nov 15 04:24:42 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:24:42 user nova-compute[74805]:     </video>
Nov 15 04:24:42 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:24:42 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:24:42 user nova-compute[74805]:     </rng>
Nov 15 04:24:42 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:24:42 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:24:42 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:24:42 user nova-compute[74805]:     </memballoon>
Nov 15 04:24:42 user nova-compute[74805]:   </devices>
Nov 15 04:24:42 user nova-compute[74805]: </domain>
Nov 15 04:24:42 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:24:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:24:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1181153034',display_name='tempest-TestStampPattern-server-1181153034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1181153034',id=30,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0NRAQgDbUZf0EbqtKAGHs4GX+/AbapMrSMTst3yG7lWtxqhChiIE0p667dQ9MtVVa6R0YR0OFwR3oN8tOTGfWd9b0OvJqkw2muo0XPuAEVruetlLFRHgQ9v/OWONwx2w==',key_name='tempest-TestStampPattern-1861490322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='464531969a244952b436e763f17ab970',ramdisk_id='',reservation_id='r-ymdi31sg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1523333335',owner_user_name='tempest-TestStampPattern-1523333335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:24:40Z,user_data=None,user_id='147187e3ec664f869db966f1e47a2445',uuid=8d27a3c7-54c7-45fd-85ab-05aa3d375a4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5adbddb-acb3-40b1-9768-923daa9f3a29", "address": "fa:16:3e:7f:dc:30", "network": {"id": "a06a4001-e7e0-4991-b68a-0a0395d22e19", "bridge": "br-int", "label": "tempest-TestStampPattern-341788822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464531969a244952b436e763f17ab970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5adbddb-ac", "ovs_interfaceid": "b5adbddb-acb3-40b1-9768-923daa9f3a29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:24:42 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Converting VIF {"id": "b5adbddb-acb3-40b1-9768-923daa9f3a29", "address": "fa:16:3e:7f:dc:30", "network": {"id": "a06a4001-e7e0-4991-b68a-0a0395d22e19", "bridge": "br-int", "label": "tempest-TestStampPattern-341788822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464531969a244952b436e763f17ab970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5adbddb-ac", "ovs_interfaceid": "b5adbddb-acb3-40b1-9768-923daa9f3a29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:24:42 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:dc:30,bridge_name='br-int',has_traffic_filtering=True,id=b5adbddb-acb3-40b1-9768-923daa9f3a29,network=Network(a06a4001-e7e0-4991-b68a-0a0395d22e19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5adbddb-ac') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:24:42 user nova-compute[74805]: DEBUG os_vif [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:dc:30,bridge_name='br-int',has_traffic_filtering=True,id=b5adbddb-acb3-40b1-9768-923daa9f3a29,network=Network(a06a4001-e7e0-4991-b68a-0a0395d22e19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5adbddb-ac') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:24:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:24:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:24:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7aaee8a0-72ca-5960-88fa-ee66a20dbd74', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:24:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:24:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5adbddb-ac, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:24:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb5adbddb-ac, col_values=(('qos', UUID('bff699ff-1ca0-484f-8c0f-1b4371cbe3e6')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:24:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb5adbddb-ac, col_values=(('external_ids', {'iface-id': 'b5adbddb-acb3-40b1-9768-923daa9f3a29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:dc:30', 'vm-uuid': '8d27a3c7-54c7-45fd-85ab-05aa3d375a4c'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:24:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:24:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:42 user nova-compute[74805]: INFO os_vif [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:dc:30,bridge_name='br-int',has_traffic_filtering=True,id=b5adbddb-acb3-40b1-9768-923daa9f3a29,network=Network(a06a4001-e7e0-4991-b68a-0a0395d22e19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5adbddb-ac')
Nov 15 04:24:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:24:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] No VIF found with MAC fa:16:3e:7f:dc:30, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:24:42 user nova-compute[74805]: DEBUG nova.network.neutron [req-7d8d83e8-0f44-4b1c-97ad-23d357e73107 req-ebcce0f7-1c8f-4ca8-8aab-b78ce67c5124 service nova] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Updated VIF entry in instance network info cache for port b5adbddb-acb3-40b1-9768-923daa9f3a29. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:24:42 user nova-compute[74805]: DEBUG nova.network.neutron [req-7d8d83e8-0f44-4b1c-97ad-23d357e73107 req-ebcce0f7-1c8f-4ca8-8aab-b78ce67c5124 service nova] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Updating instance_info_cache with network_info: [{"id": "b5adbddb-acb3-40b1-9768-923daa9f3a29", "address": "fa:16:3e:7f:dc:30", "network": {"id": "a06a4001-e7e0-4991-b68a-0a0395d22e19", "bridge": "br-int", "label": "tempest-TestStampPattern-341788822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464531969a244952b436e763f17ab970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5adbddb-ac", "ovs_interfaceid": "b5adbddb-acb3-40b1-9768-923daa9f3a29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:24:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7d8d83e8-0f44-4b1c-97ad-23d357e73107 req-ebcce0f7-1c8f-4ca8-8aab-b78ce67c5124 service nova] Releasing lock "refresh_cache-8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:24:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:43 user nova-compute[74805]: DEBUG nova.compute.manager [req-b78fc3eb-4109-4b58-accd-7139d6a84073 req-5023e6e9-3aa6-41a8-91dc-9b75c310c159 service nova] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Received event network-vif-plugged-b5adbddb-acb3-40b1-9768-923daa9f3a29 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:24:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b78fc3eb-4109-4b58-accd-7139d6a84073 req-5023e6e9-3aa6-41a8-91dc-9b75c310c159 service nova] Acquiring lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b78fc3eb-4109-4b58-accd-7139d6a84073 req-5023e6e9-3aa6-41a8-91dc-9b75c310c159 service nova] Lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b78fc3eb-4109-4b58-accd-7139d6a84073 req-5023e6e9-3aa6-41a8-91dc-9b75c310c159 service nova] Lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:43 user nova-compute[74805]: DEBUG nova.compute.manager [req-b78fc3eb-4109-4b58-accd-7139d6a84073 req-5023e6e9-3aa6-41a8-91dc-9b75c310c159 service nova] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] No waiting events found dispatching network-vif-plugged-b5adbddb-acb3-40b1-9768-923daa9f3a29 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:24:43 user nova-compute[74805]: WARNING nova.compute.manager [req-b78fc3eb-4109-4b58-accd-7139d6a84073 req-5023e6e9-3aa6-41a8-91dc-9b75c310c159 service nova] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Received unexpected event network-vif-plugged-b5adbddb-acb3-40b1-9768-923daa9f3a29 for instance with vm_state building and task_state spawning.
Nov 15 04:24:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:45 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:24:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:24:45 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Instance spawned successfully.
Nov 15 04:24:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:24:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:24:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:24:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:24:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:24:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:24:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:24:45 user nova-compute[74805]: INFO nova.compute.manager [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Took 5.31 seconds to spawn the instance on the hypervisor.
Nov 15 04:24:45 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:24:45 user nova-compute[74805]: INFO nova.compute.manager [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Took 6.08 seconds to build instance.
Nov 15 04:24:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd95a24-a47e-448a-a489-f64f149a18a2 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.178s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-510fced5-88bd-4d25-bec7-e62c3dc76bbc req-d769c769-22bc-45b9-87d9-6114c912d65c service nova] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Received event network-vif-plugged-b5adbddb-acb3-40b1-9768-923daa9f3a29 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:24:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-510fced5-88bd-4d25-bec7-e62c3dc76bbc req-d769c769-22bc-45b9-87d9-6114c912d65c service nova] Acquiring lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:24:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-510fced5-88bd-4d25-bec7-e62c3dc76bbc req-d769c769-22bc-45b9-87d9-6114c912d65c service nova] Lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:24:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-510fced5-88bd-4d25-bec7-e62c3dc76bbc req-d769c769-22bc-45b9-87d9-6114c912d65c service nova] Lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:24:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-510fced5-88bd-4d25-bec7-e62c3dc76bbc req-d769c769-22bc-45b9-87d9-6114c912d65c service nova] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] No waiting events found dispatching network-vif-plugged-b5adbddb-acb3-40b1-9768-923daa9f3a29 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:24:45 user nova-compute[74805]: WARNING nova.compute.manager [req-510fced5-88bd-4d25-bec7-e62c3dc76bbc req-d769c769-22bc-45b9-87d9-6114c912d65c service nova] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Received unexpected event network-vif-plugged-b5adbddb-acb3-40b1-9768-923daa9f3a29 for instance with vm_state active and task_state None.
Nov 15 04:24:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:24:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-18654957-fe83-42b8-9424-ebffa66eef8e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Acquiring lock "45c66453-2f83-476b-a03b-6bdbb01d1849" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:25:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-18654957-fe83-42b8-9424-ebffa66eef8e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "45c66453-2f83-476b-a03b-6bdbb01d1849" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:25:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-18654957-fe83-42b8-9424-ebffa66eef8e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Acquiring lock "45c66453-2f83-476b-a03b-6bdbb01d1849-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:25:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-18654957-fe83-42b8-9424-ebffa66eef8e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "45c66453-2f83-476b-a03b-6bdbb01d1849-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:25:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-18654957-fe83-42b8-9424-ebffa66eef8e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "45c66453-2f83-476b-a03b-6bdbb01d1849-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:25:01 user nova-compute[74805]: INFO nova.compute.manager [None req-18654957-fe83-42b8-9424-ebffa66eef8e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Terminating instance
Nov 15 04:25:01 user nova-compute[74805]: DEBUG nova.compute.manager [None req-18654957-fe83-42b8-9424-ebffa66eef8e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:25:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:02 user nova-compute[74805]: DEBUG nova.compute.manager [req-6f1bb205-1e49-4622-a73e-2f9b341a3545 req-5b3258c7-c489-4038-b4dd-ac155dbfb163 service nova] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Received event network-vif-unplugged-28a2a15e-d316-4502-a5d8-c7877fc85311 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:25:02 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6f1bb205-1e49-4622-a73e-2f9b341a3545 req-5b3258c7-c489-4038-b4dd-ac155dbfb163 service nova] Acquiring lock "45c66453-2f83-476b-a03b-6bdbb01d1849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:25:02 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6f1bb205-1e49-4622-a73e-2f9b341a3545 req-5b3258c7-c489-4038-b4dd-ac155dbfb163 service nova] Lock "45c66453-2f83-476b-a03b-6bdbb01d1849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:25:02 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6f1bb205-1e49-4622-a73e-2f9b341a3545 req-5b3258c7-c489-4038-b4dd-ac155dbfb163 service nova] Lock "45c66453-2f83-476b-a03b-6bdbb01d1849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:25:02 user nova-compute[74805]: DEBUG nova.compute.manager [req-6f1bb205-1e49-4622-a73e-2f9b341a3545 req-5b3258c7-c489-4038-b4dd-ac155dbfb163 service nova] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] No waiting events found dispatching network-vif-unplugged-28a2a15e-d316-4502-a5d8-c7877fc85311 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:25:02 user nova-compute[74805]: DEBUG nova.compute.manager [req-6f1bb205-1e49-4622-a73e-2f9b341a3545 req-5b3258c7-c489-4038-b4dd-ac155dbfb163 service nova] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Received event network-vif-unplugged-28a2a15e-d316-4502-a5d8-c7877fc85311 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:25:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:02 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Instance destroyed successfully.
Nov 15 04:25:02 user nova-compute[74805]: DEBUG nova.objects.instance [None req-18654957-fe83-42b8-9424-ebffa66eef8e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lazy-loading 'resources' on Instance uuid 45c66453-2f83-476b-a03b-6bdbb01d1849 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:25:02 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-18654957-fe83-42b8-9424-ebffa66eef8e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:19:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1669253906',display_name='tempest-VolumesAdminNegativeTest-server-1669253906',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1669253906',id=19,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9P/2ttgkTeylZi0Y8xDg0L+cg2tc7VdCgMr0ARwRUnkFgbNKuywjoonMcD9nlQN59zBslJOvp0CnVj+gz+S481YJBNjPeXBNm2wFKgMaxMD1pwEc4eCF73FaUDrzzYjg==',key_name='tempest-keypair-1068167141',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:19:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13324230e774496aa688ef50d872cb1f',ramdisk_id='',reservation_id='r-o3lism3h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-77980530',owner_user_name='tempest-VolumesAdminNegativeTest-77980530-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:19:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e816730fe634ef08d520fd01186b10e',uuid=45c66453-2f83-476b-a03b-6bdbb01d1849,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28a2a15e-d316-4502-a5d8-c7877fc85311", "address": "fa:16:3e:9c:8d:32", "network": {"id": "8a59b0de-c0e7-442f-90fa-ccb85294d3f7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640403300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13324230e774496aa688ef50d872cb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28a2a15e-d3", "ovs_interfaceid": "28a2a15e-d316-4502-a5d8-c7877fc85311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:25:02 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-18654957-fe83-42b8-9424-ebffa66eef8e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Converting VIF {"id": "28a2a15e-d316-4502-a5d8-c7877fc85311", "address": "fa:16:3e:9c:8d:32", "network": {"id": "8a59b0de-c0e7-442f-90fa-ccb85294d3f7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1640403300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13324230e774496aa688ef50d872cb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28a2a15e-d3", "ovs_interfaceid": "28a2a15e-d316-4502-a5d8-c7877fc85311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:25:02 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-18654957-fe83-42b8-9424-ebffa66eef8e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:8d:32,bridge_name='br-int',has_traffic_filtering=True,id=28a2a15e-d316-4502-a5d8-c7877fc85311,network=Network(8a59b0de-c0e7-442f-90fa-ccb85294d3f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28a2a15e-d3') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:25:02 user nova-compute[74805]: DEBUG os_vif [None req-18654957-fe83-42b8-9424-ebffa66eef8e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:8d:32,bridge_name='br-int',has_traffic_filtering=True,id=28a2a15e-d316-4502-a5d8-c7877fc85311,network=Network(8a59b0de-c0e7-442f-90fa-ccb85294d3f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28a2a15e-d3') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:25:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28a2a15e-d3, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:25:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:25:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=abf41899-bb7a-4e2f-b8c1-3a636ef48ed3) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:25:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:25:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:02 user nova-compute[74805]: INFO os_vif [None req-18654957-fe83-42b8-9424-ebffa66eef8e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:8d:32,bridge_name='br-int',has_traffic_filtering=True,id=28a2a15e-d316-4502-a5d8-c7877fc85311,network=Network(8a59b0de-c0e7-442f-90fa-ccb85294d3f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28a2a15e-d3')
Nov 15 04:25:02 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-18654957-fe83-42b8-9424-ebffa66eef8e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Deleting instance files /opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849_del
Nov 15 04:25:02 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-18654957-fe83-42b8-9424-ebffa66eef8e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Deletion of /opt/stack/data/nova/instances/45c66453-2f83-476b-a03b-6bdbb01d1849_del complete
Nov 15 04:25:02 user nova-compute[74805]: INFO nova.compute.manager [None req-18654957-fe83-42b8-9424-ebffa66eef8e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 04:25:02 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-18654957-fe83-42b8-9424-ebffa66eef8e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:25:02 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:25:02 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:25:03 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:25:03 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Took 0.77 seconds to deallocate network for instance.
Nov 15 04:25:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-18654957-fe83-42b8-9424-ebffa66eef8e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:25:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-18654957-fe83-42b8-9424-ebffa66eef8e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:25:03 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-18654957-fe83-42b8-9424-ebffa66eef8e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:25:03 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-18654957-fe83-42b8-9424-ebffa66eef8e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:25:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-18654957-fe83-42b8-9424-ebffa66eef8e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:25:04 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-18654957-fe83-42b8-9424-ebffa66eef8e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Deleted allocations for instance 45c66453-2f83-476b-a03b-6bdbb01d1849
Nov 15 04:25:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-18654957-fe83-42b8-9424-ebffa66eef8e tempest-VolumesAdminNegativeTest-77980530 tempest-VolumesAdminNegativeTest-77980530-project-member] Lock "45c66453-2f83-476b-a03b-6bdbb01d1849" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.166s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:25:04 user nova-compute[74805]: DEBUG nova.compute.manager [req-ae921f14-be96-4b48-a83c-95d3e0ba65fe req-541d25e8-896d-492d-9c5a-5e207d255341 service nova] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Received event network-vif-plugged-28a2a15e-d316-4502-a5d8-c7877fc85311 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:25:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ae921f14-be96-4b48-a83c-95d3e0ba65fe req-541d25e8-896d-492d-9c5a-5e207d255341 service nova] Acquiring lock "45c66453-2f83-476b-a03b-6bdbb01d1849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:25:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ae921f14-be96-4b48-a83c-95d3e0ba65fe req-541d25e8-896d-492d-9c5a-5e207d255341 service nova] Lock "45c66453-2f83-476b-a03b-6bdbb01d1849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:25:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ae921f14-be96-4b48-a83c-95d3e0ba65fe req-541d25e8-896d-492d-9c5a-5e207d255341 service nova] Lock "45c66453-2f83-476b-a03b-6bdbb01d1849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:25:04 user nova-compute[74805]: DEBUG nova.compute.manager [req-ae921f14-be96-4b48-a83c-95d3e0ba65fe req-541d25e8-896d-492d-9c5a-5e207d255341 service nova] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] No waiting events found dispatching network-vif-plugged-28a2a15e-d316-4502-a5d8-c7877fc85311 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:25:04 user nova-compute[74805]: WARNING nova.compute.manager [req-ae921f14-be96-4b48-a83c-95d3e0ba65fe req-541d25e8-896d-492d-9c5a-5e207d255341 service nova] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Received unexpected event network-vif-plugged-28a2a15e-d316-4502-a5d8-c7877fc85311 for instance with vm_state deleted and task_state None.
Nov 15 04:25:04 user nova-compute[74805]: DEBUG nova.compute.manager [req-ae921f14-be96-4b48-a83c-95d3e0ba65fe req-541d25e8-896d-492d-9c5a-5e207d255341 service nova] [instance: 45c66453-2f83-476b-a03b-6bdbb01d1849] Received event network-vif-deleted-28a2a15e-d316-4502-a5d8-c7877fc85311 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:25:05 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:25:05 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74805) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 04:25:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:06 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:25:06 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:25:06 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Cleaning up deleted instances {{(pid=74805) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 04:25:06 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] There are 0 instances to clean {{(pid=74805) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 04:25:07 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:25:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:25:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:25:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:25:07 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:25:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:25:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6594aaea-3698-4d56-babf-95f9654138f1/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6594aaea-3698-4d56-babf-95f9654138f1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6594aaea-3698-4d56-babf-95f9654138f1/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6594aaea-3698-4d56-babf-95f9654138f1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:25:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:10 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:25:10 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:25:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=7648MB free_disk=25.248920440673828GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:25:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:25:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:25:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance d63f3726-27df-455f-bda0-3ddca95b70d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:25:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance e5004557-00fa-4824-9233-343c2261588d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:25:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance f329eddf-6a3b-4f05-9353-1b1e475ba420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:25:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance bc2e6fef-e9b0-4413-ad26-e4a076cb0b49 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:25:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 9f267864-0b72-431d-9b0d-c63436002a4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:25:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:25:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 6594aaea-3698-4d56-babf-95f9654138f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:25:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:25:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:25:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:25:10 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:25:10 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:25:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:25:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.397s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:25:11 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:25:11 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:25:11 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:25:12 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:25:12 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:25:12 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:25:12 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Didn't find any instances for network info cache update. {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 04:25:12 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:25:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:12 user nova-compute[74805]: DEBUG nova.objects.instance [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'flavor' on Instance uuid e5004557-00fa-4824-9233-343c2261588d {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:25:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "refresh_cache-e5004557-00fa-4824-9233-343c2261588d" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:25:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquired lock "refresh_cache-e5004557-00fa-4824-9233-343c2261588d" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:25:12 user nova-compute[74805]: DEBUG nova.network.neutron [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:25:12 user nova-compute[74805]: DEBUG nova.objects.instance [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'info_cache' on Instance uuid e5004557-00fa-4824-9233-343c2261588d {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:25:12 user nova-compute[74805]: DEBUG nova.objects.base [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Object Instance<e5004557-00fa-4824-9233-343c2261588d> lazy-loaded attributes: flavor,info_cache {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.network.neutron [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Updating instance_info_cache with network_info: [{"id": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "address": "fa:16:3e:c8:0f:b4", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96104fe5-a8", "ovs_interfaceid": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Releasing lock "refresh_cache-e5004557-00fa-4824-9233-343c2261588d" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:25:13 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: e5004557-00fa-4824-9233-343c2261588d] Instance destroyed successfully.
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.objects.instance [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'resources' on Instance uuid e5004557-00fa-4824-9233-343c2261588d {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.objects.base [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Object Instance<e5004557-00fa-4824-9233-343c2261588d> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:17:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1146298859',display_name='tempest-AttachVolumeTestJSON-server-1146298859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1146298859',id=15,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcDGmoSL9n6BzrErqwQE4CV+qAoPf9h8eN4+5EDz04bsyjTTZ4Sit9JWjEhWommytKEKkL3SeMOXxTqRGtePTLcAr9xdzbbxAAil9ruYGUIPqhf/tGyrXvLN/cCYSgOhg==',key_name='tempest-keypair-2130424993',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:17:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b7ba201faadb461882c823f9bd895af9',ramdisk_id='',reservation_id='r-g45utcp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-17326548',owner_user_name='tempest-AttachVolumeTestJSON-17326548-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:23:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50fe72dfe19f4c9792c4733f14b2d464',uuid=e5004557-00fa-4824-9233-343c2261588d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "address": "fa:16:3e:c8:0f:b4", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96104fe5-a8", "ovs_interfaceid": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Converting VIF {"id": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "address": "fa:16:3e:c8:0f:b4", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96104fe5-a8", "ovs_interfaceid": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:0f:b4,bridge_name='br-int',has_traffic_filtering=True,id=96104fe5-a8a5-445d-9c2a-6631a15e4349,network=Network(5b2973a0-643c-4d30-a6cd-3d1391fe2cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96104fe5-a8') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG os_vif [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:0f:b4,bridge_name='br-int',has_traffic_filtering=True,id=96104fe5-a8a5-445d-9c2a-6631a15e4349,network=Network(5b2973a0-643c-4d30-a6cd-3d1391fe2cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96104fe5-a8') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96104fe5-a8, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b7a2702-3392-4baf-9b3f-ae6bd4b5a75a) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:25:13 user nova-compute[74805]: INFO os_vif [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:0f:b4,bridge_name='br-int',has_traffic_filtering=True,id=96104fe5-a8a5-445d-9c2a-6631a15e4349,network=Network(5b2973a0-643c-4d30-a6cd-3d1391fe2cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96104fe5-a8')
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Start _get_guest_xml network_info=[{"id": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "address": "fa:16:3e:c8:0f:b4", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96104fe5-a8", "ovs_interfaceid": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.objects.instance [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'numa_topology' on Instance uuid e5004557-00fa-4824-9233-343c2261588d {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.objects.base [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Object Instance<e5004557-00fa-4824-9233-343c2261588d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:25:13 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:25:13 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.objects.instance [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'vcpu_model' on Instance uuid e5004557-00fa-4824-9233-343c2261588d {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.objects.base [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Object Instance<e5004557-00fa-4824-9233-343c2261588d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:17:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1146298859',display_name='tempest-AttachVolumeTestJSON-server-1146298859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1146298859',id=15,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcDGmoSL9n6BzrErqwQE4CV+qAoPf9h8eN4+5EDz04bsyjTTZ4Sit9JWjEhWommytKEKkL3SeMOXxTqRGtePTLcAr9xdzbbxAAil9ruYGUIPqhf/tGyrXvLN/cCYSgOhg==',key_name='tempest-keypair-2130424993',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:17:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b7ba201faadb461882c823f9bd895af9',ramdisk_id='',reservation_id='r-g45utcp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-17326548',owner_user_name='tempest-AttachVolumeTestJSON-17326548-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:23:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50fe72dfe19f4c9792c4733f14b2d464',uuid=e5004557-00fa-4824-9233-343c2261588d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "address": "fa:16:3e:c8:0f:b4", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96104fe5-a8", "ovs_interfaceid": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Converting VIF {"id": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "address": "fa:16:3e:c8:0f:b4", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96104fe5-a8", "ovs_interfaceid": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:0f:b4,bridge_name='br-int',has_traffic_filtering=True,id=96104fe5-a8a5-445d-9c2a-6631a15e4349,network=Network(5b2973a0-643c-4d30-a6cd-3d1391fe2cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96104fe5-a8') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.objects.instance [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'pci_devices' on Instance uuid e5004557-00fa-4824-9233-343c2261588d {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.objects.base [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Object Instance<e5004557-00fa-4824-9233-343c2261588d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:25:13 user nova-compute[74805]:   <uuid>e5004557-00fa-4824-9233-343c2261588d</uuid>
Nov 15 04:25:13 user nova-compute[74805]:   <name>instance-0000000f</name>
Nov 15 04:25:13 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:25:13 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:25:13 user nova-compute[74805]:   <metadata>
Nov 15 04:25:13 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:25:13 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:25:13 user nova-compute[74805]:       <nova:name>tempest-AttachVolumeTestJSON-server-1146298859</nova:name>
Nov 15 04:25:13 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:25:13</nova:creationTime>
Nov 15 04:25:13 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:25:13 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:25:13 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:25:13 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:25:13 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:25:13 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:25:13 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:25:13 user nova-compute[74805]:       <nova:owner>
Nov 15 04:25:13 user nova-compute[74805]:         <nova:user uuid="50fe72dfe19f4c9792c4733f14b2d464">tempest-AttachVolumeTestJSON-17326548-project-member</nova:user>
Nov 15 04:25:13 user nova-compute[74805]:         <nova:project uuid="b7ba201faadb461882c823f9bd895af9">tempest-AttachVolumeTestJSON-17326548</nova:project>
Nov 15 04:25:13 user nova-compute[74805]:       </nova:owner>
Nov 15 04:25:13 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:25:13 user nova-compute[74805]:       <nova:ports>
Nov 15 04:25:13 user nova-compute[74805]:         <nova:port uuid="96104fe5-a8a5-445d-9c2a-6631a15e4349">
Nov 15 04:25:13 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 04:25:13 user nova-compute[74805]:         </nova:port>
Nov 15 04:25:13 user nova-compute[74805]:       </nova:ports>
Nov 15 04:25:13 user nova-compute[74805]:     </nova:instance>
Nov 15 04:25:13 user nova-compute[74805]:   </metadata>
Nov 15 04:25:13 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:25:13 user nova-compute[74805]:     <system>
Nov 15 04:25:13 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:25:13 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:25:13 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:25:13 user nova-compute[74805]:       <entry name="serial">e5004557-00fa-4824-9233-343c2261588d</entry>
Nov 15 04:25:13 user nova-compute[74805]:       <entry name="uuid">e5004557-00fa-4824-9233-343c2261588d</entry>
Nov 15 04:25:13 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:25:13 user nova-compute[74805]:     </system>
Nov 15 04:25:13 user nova-compute[74805]:   </sysinfo>
Nov 15 04:25:13 user nova-compute[74805]:   <os>
Nov 15 04:25:13 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:25:13 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:25:13 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:25:13 user nova-compute[74805]:   </os>
Nov 15 04:25:13 user nova-compute[74805]:   <features>
Nov 15 04:25:13 user nova-compute[74805]:     <acpi/>
Nov 15 04:25:13 user nova-compute[74805]:     <apic/>
Nov 15 04:25:13 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:25:13 user nova-compute[74805]:   </features>
Nov 15 04:25:13 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:25:13 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:25:13 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:25:13 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:25:13 user nova-compute[74805]:   </clock>
Nov 15 04:25:13 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:25:13 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:25:13 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:25:13 user nova-compute[74805]:   </cpu>
Nov 15 04:25:13 user nova-compute[74805]:   <devices>
Nov 15 04:25:13 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:25:13 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:25:13 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk"/>
Nov 15 04:25:13 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:25:13 user nova-compute[74805]:     </disk>
Nov 15 04:25:13 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:25:13 user nova-compute[74805]:       <mac address="fa:16:3e:c8:0f:b4"/>
Nov 15 04:25:13 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:25:13 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:25:13 user nova-compute[74805]:       <target dev="tap96104fe5-a8"/>
Nov 15 04:25:13 user nova-compute[74805]:     </interface>
Nov 15 04:25:13 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:25:13 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/console.log" append="off"/>
Nov 15 04:25:13 user nova-compute[74805]:     </serial>
Nov 15 04:25:13 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:25:13 user nova-compute[74805]:     <video>
Nov 15 04:25:13 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:25:13 user nova-compute[74805]:     </video>
Nov 15 04:25:13 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:25:13 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:25:13 user nova-compute[74805]:     </rng>
Nov 15 04:25:13 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:25:13 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:25:13 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:25:13 user nova-compute[74805]:     </memballoon>
Nov 15 04:25:13 user nova-compute[74805]:   </devices>
Nov 15 04:25:13 user nova-compute[74805]: </domain>
Nov 15 04:25:13 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.objects.instance [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'trusted_certs' on Instance uuid e5004557-00fa-4824-9233-343c2261588d {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG nova.objects.base [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Object Instance<e5004557-00fa-4824-9233-343c2261588d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:25:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.182s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Cannot resize image /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG nova.objects.instance [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'migration_context' on Instance uuid e5004557-00fa-4824-9233-343c2261588d {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG nova.objects.base [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Object Instance<e5004557-00fa-4824-9233-343c2261588d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:17:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1146298859',display_name='tempest-AttachVolumeTestJSON-server-1146298859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1146298859',id=15,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcDGmoSL9n6BzrErqwQE4CV+qAoPf9h8eN4+5EDz04bsyjTTZ4Sit9JWjEhWommytKEKkL3SeMOXxTqRGtePTLcAr9xdzbbxAAil9ruYGUIPqhf/tGyrXvLN/cCYSgOhg==',key_name='tempest-keypair-2130424993',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:17:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='b7ba201faadb461882c823f9bd895af9',ramdisk_id='',reservation_id='r-g45utcp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-17326548',owner_user_name='tempest-AttachVolumeTestJSON-17326548-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:23:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50fe72dfe19f4c9792c4733f14b2d464',uuid=e5004557-00fa-4824-9233-343c2261588d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "address": "fa:16:3e:c8:0f:b4", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96104fe5-a8", "ovs_interfaceid": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Converting VIF {"id": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "address": "fa:16:3e:c8:0f:b4", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96104fe5-a8", "ovs_interfaceid": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:0f:b4,bridge_name='br-int',has_traffic_filtering=True,id=96104fe5-a8a5-445d-9c2a-6631a15e4349,network=Network(5b2973a0-643c-4d30-a6cd-3d1391fe2cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96104fe5-a8') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG os_vif [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:0f:b4,bridge_name='br-int',has_traffic_filtering=True,id=96104fe5-a8a5-445d-9c2a-6631a15e4349,network=Network(5b2973a0-643c-4d30-a6cd-3d1391fe2cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96104fe5-a8') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a34ea466-36fd-5891-908e-afd1b72cd053', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96104fe5-a8, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96104fe5-a8, col_values=(('qos', UUID('8126c449-a4ed-4d68-860d-c508bfbc4a33')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96104fe5-a8, col_values=(('external_ids', {'iface-id': '96104fe5-a8a5-445d-9c2a-6631a15e4349', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:0f:b4', 'vm-uuid': 'e5004557-00fa-4824-9233-343c2261588d'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:14 user nova-compute[74805]: INFO os_vif [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:0f:b4,bridge_name='br-int',has_traffic_filtering=True,id=96104fe5-a8a5-445d-9c2a-6631a15e4349,network=Network(5b2973a0-643c-4d30-a6cd-3d1391fe2cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96104fe5-a8')
Nov 15 04:25:14 user nova-compute[74805]: DEBUG nova.compute.manager [req-c5aff1e7-7806-4fed-bb93-837cb57c7936 req-d0451ea3-0f0d-46d0-ad49-72e8033a8b88 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Received event network-changed-a8a0db92-660b-4fc3-b68c-9e6a37aa85db {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG nova.compute.manager [req-c5aff1e7-7806-4fed-bb93-837cb57c7936 req-d0451ea3-0f0d-46d0-ad49-72e8033a8b88 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Refreshing instance network info cache due to event network-changed-a8a0db92-660b-4fc3-b68c-9e6a37aa85db. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c5aff1e7-7806-4fed-bb93-837cb57c7936 req-d0451ea3-0f0d-46d0-ad49-72e8033a8b88 service nova] Acquiring lock "refresh_cache-f329eddf-6a3b-4f05-9353-1b1e475ba420" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c5aff1e7-7806-4fed-bb93-837cb57c7936 req-d0451ea3-0f0d-46d0-ad49-72e8033a8b88 service nova] Acquired lock "refresh_cache-f329eddf-6a3b-4f05-9353-1b1e475ba420" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG nova.network.neutron [req-c5aff1e7-7806-4fed-bb93-837cb57c7936 req-d0451ea3-0f0d-46d0-ad49-72e8033a8b88 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Refreshing network info cache for port a8a0db92-660b-4fc3-b68c-9e6a37aa85db {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG nova.network.neutron [req-c5aff1e7-7806-4fed-bb93-837cb57c7936 req-d0451ea3-0f0d-46d0-ad49-72e8033a8b88 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Updated VIF entry in instance network info cache for port a8a0db92-660b-4fc3-b68c-9e6a37aa85db. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG nova.network.neutron [req-c5aff1e7-7806-4fed-bb93-837cb57c7936 req-d0451ea3-0f0d-46d0-ad49-72e8033a8b88 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Updating instance_info_cache with network_info: [{"id": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "address": "fa:16:3e:44:06:9f", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a0db92-66", "ovs_interfaceid": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:25:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c5aff1e7-7806-4fed-bb93-837cb57c7936 req-d0451ea3-0f0d-46d0-ad49-72e8033a8b88 service nova] Releasing lock "refresh_cache-f329eddf-6a3b-4f05-9353-1b1e475ba420" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:25:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:15 user nova-compute[74805]: DEBUG nova.compute.manager [req-a826a31d-dbf0-4298-8788-825f74e6ee50 req-b34a26e5-f6c9-48d7-a5af-3e286f1a79d3 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Received event network-changed-a8a0db92-660b-4fc3-b68c-9e6a37aa85db {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:25:15 user nova-compute[74805]: DEBUG nova.compute.manager [req-a826a31d-dbf0-4298-8788-825f74e6ee50 req-b34a26e5-f6c9-48d7-a5af-3e286f1a79d3 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Refreshing instance network info cache due to event network-changed-a8a0db92-660b-4fc3-b68c-9e6a37aa85db. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:25:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-a826a31d-dbf0-4298-8788-825f74e6ee50 req-b34a26e5-f6c9-48d7-a5af-3e286f1a79d3 service nova] Acquiring lock "refresh_cache-f329eddf-6a3b-4f05-9353-1b1e475ba420" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:25:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-a826a31d-dbf0-4298-8788-825f74e6ee50 req-b34a26e5-f6c9-48d7-a5af-3e286f1a79d3 service nova] Acquired lock "refresh_cache-f329eddf-6a3b-4f05-9353-1b1e475ba420" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:25:15 user nova-compute[74805]: DEBUG nova.network.neutron [req-a826a31d-dbf0-4298-8788-825f74e6ee50 req-b34a26e5-f6c9-48d7-a5af-3e286f1a79d3 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Refreshing network info cache for port a8a0db92-660b-4fc3-b68c-9e6a37aa85db {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:25:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "f329eddf-6a3b-4f05-9353-1b1e475ba420" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:25:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:25:15 user nova-compute[74805]: INFO nova.compute.manager [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Detaching volume 74b00fdf-abeb-4d05-bdc6-1a1f7146d076
Nov 15 04:25:15 user nova-compute[74805]: INFO nova.virt.block_device [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Attempting to driver detach volume 74b00fdf-abeb-4d05-bdc6-1a1f7146d076 from mountpoint /dev/vdb
Nov 15 04:25:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Attempting to detach device vdb from instance f329eddf-6a3b-4f05-9353-1b1e475ba420 from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:25:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:25:15 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:25:15 user nova-compute[74805]:   <source dev="/dev/sdb"/>
Nov 15 04:25:15 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:25:15 user nova-compute[74805]:   <serial>74b00fdf-abeb-4d05-bdc6-1a1f7146d076</serial>
Nov 15 04:25:15 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:25:15 user nova-compute[74805]: </disk>
Nov 15 04:25:15 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:25:15 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Successfully detached device vdb from instance f329eddf-6a3b-4f05-9353-1b1e475ba420 from the persistent domain config.
Nov 15 04:25:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f329eddf-6a3b-4f05-9353-1b1e475ba420 from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:25:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:25:15 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:25:15 user nova-compute[74805]:   <source dev="/dev/sdb"/>
Nov 15 04:25:15 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:25:15 user nova-compute[74805]:   <serial>74b00fdf-abeb-4d05-bdc6-1a1f7146d076</serial>
Nov 15 04:25:15 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:25:15 user nova-compute[74805]: </disk>
Nov 15 04:25:15 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:25:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:15 user nova-compute[74805]: DEBUG nova.network.neutron [req-a826a31d-dbf0-4298-8788-825f74e6ee50 req-b34a26e5-f6c9-48d7-a5af-3e286f1a79d3 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Updated VIF entry in instance network info cache for port a8a0db92-660b-4fc3-b68c-9e6a37aa85db. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:25:15 user nova-compute[74805]: DEBUG nova.network.neutron [req-a826a31d-dbf0-4298-8788-825f74e6ee50 req-b34a26e5-f6c9-48d7-a5af-3e286f1a79d3 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Updating instance_info_cache with network_info: [{"id": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "address": "fa:16:3e:44:06:9f", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a0db92-66", "ovs_interfaceid": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:25:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-a826a31d-dbf0-4298-8788-825f74e6ee50 req-b34a26e5-f6c9-48d7-a5af-3e286f1a79d3 service nova] Releasing lock "refresh_cache-f329eddf-6a3b-4f05-9353-1b1e475ba420" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:25:15 user nova-compute[74805]: DEBUG nova.compute.manager [req-db17f8ef-c39b-484b-83c4-93549aef3c22 req-963c0567-49f2-41fa-a5eb-ccb94791ab00 service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Received event network-vif-plugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:25:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-db17f8ef-c39b-484b-83c4-93549aef3c22 req-963c0567-49f2-41fa-a5eb-ccb94791ab00 service nova] Acquiring lock "e5004557-00fa-4824-9233-343c2261588d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:25:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-db17f8ef-c39b-484b-83c4-93549aef3c22 req-963c0567-49f2-41fa-a5eb-ccb94791ab00 service nova] Lock "e5004557-00fa-4824-9233-343c2261588d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:25:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-db17f8ef-c39b-484b-83c4-93549aef3c22 req-963c0567-49f2-41fa-a5eb-ccb94791ab00 service nova] Lock "e5004557-00fa-4824-9233-343c2261588d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:25:15 user nova-compute[74805]: DEBUG nova.compute.manager [req-db17f8ef-c39b-484b-83c4-93549aef3c22 req-963c0567-49f2-41fa-a5eb-ccb94791ab00 service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] No waiting events found dispatching network-vif-plugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:25:15 user nova-compute[74805]: WARNING nova.compute.manager [req-db17f8ef-c39b-484b-83c4-93549aef3c22 req-963c0567-49f2-41fa-a5eb-ccb94791ab00 service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Received unexpected event network-vif-plugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 for instance with vm_state stopped and task_state powering-on.
Nov 15 04:25:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f329eddf-6a3b-4f05-9353-1b1e475ba420 {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:25:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:17 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:25:17 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:25:17 user nova-compute[74805]: DEBUG nova.compute.manager [req-cf80fc9a-4ed2-43a9-b6ef-ebda889e418a req-f631ace1-2aae-48d0-aabd-ca855016cb6a service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Received event network-vif-plugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:25:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-cf80fc9a-4ed2-43a9-b6ef-ebda889e418a req-f631ace1-2aae-48d0-aabd-ca855016cb6a service nova] Acquiring lock "e5004557-00fa-4824-9233-343c2261588d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:25:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-cf80fc9a-4ed2-43a9-b6ef-ebda889e418a req-f631ace1-2aae-48d0-aabd-ca855016cb6a service nova] Lock "e5004557-00fa-4824-9233-343c2261588d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:25:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-cf80fc9a-4ed2-43a9-b6ef-ebda889e418a req-f631ace1-2aae-48d0-aabd-ca855016cb6a service nova] Lock "e5004557-00fa-4824-9233-343c2261588d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:25:17 user nova-compute[74805]: DEBUG nova.compute.manager [req-cf80fc9a-4ed2-43a9-b6ef-ebda889e418a req-f631ace1-2aae-48d0-aabd-ca855016cb6a service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] No waiting events found dispatching network-vif-plugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:25:17 user nova-compute[74805]: WARNING nova.compute.manager [req-cf80fc9a-4ed2-43a9-b6ef-ebda889e418a req-f631ace1-2aae-48d0-aabd-ca855016cb6a service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Received unexpected event network-vif-plugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 for instance with vm_state stopped and task_state powering-on.
Nov 15 04:25:18 user nova-compute[74805]: DEBUG nova.compute.manager [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:25:18 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: e5004557-00fa-4824-9233-343c2261588d] Instance rebooted successfully.
Nov 15 04:25:18 user nova-compute[74805]: DEBUG nova.compute.manager [None req-7b23b5b8-6fc5-4eed-a3e0-f0d2a3009df9 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:25:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:20 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:25:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:25:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:25:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:25:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:25:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:32 user nova-compute[74805]: DEBUG nova.compute.manager [req-71ef10ba-78ba-4435-b146-2b5ae841dd23 req-14c23300-0df7-4682-a4c8-2bafa9bb2f5e service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Received event network-changed-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:25:32 user nova-compute[74805]: DEBUG nova.compute.manager [req-71ef10ba-78ba-4435-b146-2b5ae841dd23 req-14c23300-0df7-4682-a4c8-2bafa9bb2f5e service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Refreshing instance network info cache due to event network-changed-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:25:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-71ef10ba-78ba-4435-b146-2b5ae841dd23 req-14c23300-0df7-4682-a4c8-2bafa9bb2f5e service nova] Acquiring lock "refresh_cache-bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:25:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-71ef10ba-78ba-4435-b146-2b5ae841dd23 req-14c23300-0df7-4682-a4c8-2bafa9bb2f5e service nova] Acquired lock "refresh_cache-bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:25:32 user nova-compute[74805]: DEBUG nova.network.neutron [req-71ef10ba-78ba-4435-b146-2b5ae841dd23 req-14c23300-0df7-4682-a4c8-2bafa9bb2f5e service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Refreshing network info cache for port b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:25:32 user nova-compute[74805]: DEBUG nova.network.neutron [req-71ef10ba-78ba-4435-b146-2b5ae841dd23 req-14c23300-0df7-4682-a4c8-2bafa9bb2f5e service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Updated VIF entry in instance network info cache for port b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:25:32 user nova-compute[74805]: DEBUG nova.network.neutron [req-71ef10ba-78ba-4435-b146-2b5ae841dd23 req-14c23300-0df7-4682-a4c8-2bafa9bb2f5e service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Updating instance_info_cache with network_info: [{"id": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "address": "fa:16:3e:48:b0:09", "network": {"id": "62c3a0d2-d7cf-41dd-adb6-f2331929ee00", "bridge": "br-int", "label": "tempest-TestShelveInstance-1115394549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec78f4baa84125864c0992ecfa6181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5818fba-ad", "ovs_interfaceid": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:25:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-71ef10ba-78ba-4435-b146-2b5ae841dd23 req-14c23300-0df7-4682-a4c8-2bafa9bb2f5e service nova] Releasing lock "refresh_cache-bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:25:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Acquiring lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:25:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:25:32 user nova-compute[74805]: INFO nova.compute.manager [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Shelve offloading
Nov 15 04:25:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:33 user nova-compute[74805]: DEBUG nova.compute.manager [req-952ba5d5-e1c7-4fde-bb15-04abd18ada08 req-b17c6f31-1d52-42f8-b382-6e43848b0c3b service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Received event network-vif-unplugged-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:25:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-952ba5d5-e1c7-4fde-bb15-04abd18ada08 req-b17c6f31-1d52-42f8-b382-6e43848b0c3b service nova] Acquiring lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:25:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-952ba5d5-e1c7-4fde-bb15-04abd18ada08 req-b17c6f31-1d52-42f8-b382-6e43848b0c3b service nova] Lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:25:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-952ba5d5-e1c7-4fde-bb15-04abd18ada08 req-b17c6f31-1d52-42f8-b382-6e43848b0c3b service nova] Lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:25:33 user nova-compute[74805]: DEBUG nova.compute.manager [req-952ba5d5-e1c7-4fde-bb15-04abd18ada08 req-b17c6f31-1d52-42f8-b382-6e43848b0c3b service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] No waiting events found dispatching network-vif-unplugged-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:25:33 user nova-compute[74805]: WARNING nova.compute.manager [req-952ba5d5-e1c7-4fde-bb15-04abd18ada08 req-b17c6f31-1d52-42f8-b382-6e43848b0c3b service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Received unexpected event network-vif-unplugged-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 for instance with vm_state active and task_state shelving.
Nov 15 04:25:33 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Instance destroyed successfully.
Nov 15 04:25:33 user nova-compute[74805]: DEBUG nova.compute.manager [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:25:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Acquiring lock "refresh_cache-bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:25:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Acquired lock "refresh_cache-bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:25:33 user nova-compute[74805]: DEBUG nova.network.neutron [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:25:33 user nova-compute[74805]: DEBUG nova.network.neutron [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Updating instance_info_cache with network_info: [{"id": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "address": "fa:16:3e:48:b0:09", "network": {"id": "62c3a0d2-d7cf-41dd-adb6-f2331929ee00", "bridge": "br-int", "label": "tempest-TestShelveInstance-1115394549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec78f4baa84125864c0992ecfa6181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5818fba-ad", "ovs_interfaceid": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:25:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Releasing lock "refresh_cache-bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:34 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Instance destroyed successfully.
Nov 15 04:25:34 user nova-compute[74805]: DEBUG nova.objects.instance [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lazy-loading 'resources' on Instance uuid bc2e6fef-e9b0-4413-ad26-e4a076cb0b49 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:23:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1631741636',display_name='tempest-TestShelveInstance-server-1631741636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1631741636',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJZ7VNrqog1l5LS5ex5rgm9h9OaqVSpKNKvGoqpKAwA7018UsVo8X4OO2N4xP1K//IYAzTMHD0Ji+yoeCcs7+FCRWzP8wxCbmmZRQ7L83rEsZslABx/Y41Z0E46WakUyQ==',key_name='tempest-TestShelveInstance-385247914',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:23:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ffec78f4baa84125864c0992ecfa6181',ramdisk_id='',reservation_id='r-il5y2g8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1222914404',owner_user_name='tempest-TestShelveInstance-1222914404-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:23:52Z,user_data=None,user_id='4de845d5de0a4cc880f29b4a522c81e1',uuid=bc2e6fef-e9b0-4413-ad26-e4a076cb0b49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "address": "fa:16:3e:48:b0:09", "network": {"id": "62c3a0d2-d7cf-41dd-adb6-f2331929ee00", "bridge": "br-int", "label": "tempest-TestShelveInstance-1115394549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec78f4baa84125864c0992ecfa6181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5818fba-ad", "ovs_interfaceid": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Converting VIF {"id": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "address": "fa:16:3e:48:b0:09", "network": {"id": "62c3a0d2-d7cf-41dd-adb6-f2331929ee00", "bridge": "br-int", "label": "tempest-TestShelveInstance-1115394549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec78f4baa84125864c0992ecfa6181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5818fba-ad", "ovs_interfaceid": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:b0:09,bridge_name='br-int',has_traffic_filtering=True,id=b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31,network=Network(62c3a0d2-d7cf-41dd-adb6-f2331929ee00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5818fba-ad') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG os_vif [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:b0:09,bridge_name='br-int',has_traffic_filtering=True,id=b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31,network=Network(62c3a0d2-d7cf-41dd-adb6-f2331929ee00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5818fba-ad') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5818fba-ad, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5028fa7a-a00f-4b45-9f8c-da72aa36a14e) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:34 user nova-compute[74805]: INFO os_vif [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:b0:09,bridge_name='br-int',has_traffic_filtering=True,id=b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31,network=Network(62c3a0d2-d7cf-41dd-adb6-f2331929ee00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5818fba-ad')
Nov 15 04:25:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'foiIdAtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:25:34 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:25:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc1dd07-cb4e-4d22-bace-2b45dc92351d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:25:34 user nova-compute[74805]: No targets found.
Nov 15 04:25:34 user nova-compute[74805]: iSNS:
Nov 15 04:25:34 user nova-compute[74805]: No targets found.
Nov 15 04:25:34 user nova-compute[74805]: STATIC:
Nov 15 04:25:34 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb
Nov 15 04:25:34 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:25:34 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:25:34 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076
Nov 15 04:25:34 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:25:34 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:25:34 user nova-compute[74805]: FIRMWARE:
Nov 15 04:25:34 user nova-compute[74805]: No targets found.
Nov 15 04:25:34 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:25:34 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:25:34 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[70394254-7d66-4cf5-b7a2-ff31bcc1a19e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7aaece-825a-4d6d-9be7-afca6243dcde]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 (non-flash)
Nov 15 04:25:34 user nova-compute[74805]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)
Nov 15 04:25:34 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 (non-flash)
Nov 15 04:25:34 user nova-compute[74805]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)
Nov 15 04:25:34 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c11b640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb'): ({'sdc'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Removing single pathed devices sdc {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edcd9a3-c725-4f38-903a-a0f7c6aa825f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b8d510-df6d-494e-a261-cf08bd7c9bb8]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Flushing IO for device /dev/sdc {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c19dcd-ab92-4794-8aca-00f2332fd187]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:25:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b816de0-6495-484e-a6f2-f4cf60c7808a]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76c8652-558a-4ba3-855e-38c173e9b352]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1978db0e-d133-4b13-8f68-c8356d097d02]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb, portal: 172.16.0.220,3260]
Nov 15 04:25:35 user nova-compute[74805]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb, portal: 172.16.0.220,3260] successful.
Nov 15 04:25:35 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a07c3a-a8bd-464f-b8bf-b905aaa1da51]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] <== disconnect_volume: return (313ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:25:35 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Deleting instance files /opt/stack/data/nova/instances/bc2e6fef-e9b0-4413-ad26-e4a076cb0b49_del
Nov 15 04:25:35 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Deletion of /opt/stack/data/nova/instances/bc2e6fef-e9b0-4413-ad26-e4a076cb0b49_del complete
Nov 15 04:25:35 user nova-compute[74805]: DEBUG nova.compute.manager [req-7deab3d4-d48e-4e4e-8ac3-f5c6116a5038 req-a6b2c323-b19c-4925-b395-89ca069daef9 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Received event network-vif-plugged-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7deab3d4-d48e-4e4e-8ac3-f5c6116a5038 req-a6b2c323-b19c-4925-b395-89ca069daef9 service nova] Acquiring lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7deab3d4-d48e-4e4e-8ac3-f5c6116a5038 req-a6b2c323-b19c-4925-b395-89ca069daef9 service nova] Lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7deab3d4-d48e-4e4e-8ac3-f5c6116a5038 req-a6b2c323-b19c-4925-b395-89ca069daef9 service nova] Lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG nova.compute.manager [req-7deab3d4-d48e-4e4e-8ac3-f5c6116a5038 req-a6b2c323-b19c-4925-b395-89ca069daef9 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] No waiting events found dispatching network-vif-plugged-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:25:35 user nova-compute[74805]: WARNING nova.compute.manager [req-7deab3d4-d48e-4e4e-8ac3-f5c6116a5038 req-a6b2c323-b19c-4925-b395-89ca069daef9 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Received unexpected event network-vif-plugged-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 for instance with vm_state active and task_state shelving.
Nov 15 04:25:35 user nova-compute[74805]: DEBUG nova.compute.manager [req-7deab3d4-d48e-4e4e-8ac3-f5c6116a5038 req-a6b2c323-b19c-4925-b395-89ca069daef9 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Received event network-changed-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG nova.compute.manager [req-7deab3d4-d48e-4e4e-8ac3-f5c6116a5038 req-a6b2c323-b19c-4925-b395-89ca069daef9 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Refreshing instance network info cache due to event network-changed-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7deab3d4-d48e-4e4e-8ac3-f5c6116a5038 req-a6b2c323-b19c-4925-b395-89ca069daef9 service nova] Acquiring lock "refresh_cache-bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7deab3d4-d48e-4e4e-8ac3-f5c6116a5038 req-a6b2c323-b19c-4925-b395-89ca069daef9 service nova] Acquired lock "refresh_cache-bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG nova.network.neutron [req-7deab3d4-d48e-4e4e-8ac3-f5c6116a5038 req-a6b2c323-b19c-4925-b395-89ca069daef9 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Refreshing network info cache for port b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG nova.network.neutron [req-7deab3d4-d48e-4e4e-8ac3-f5c6116a5038 req-a6b2c323-b19c-4925-b395-89ca069daef9 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Updated VIF entry in instance network info cache for port b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG nova.network.neutron [req-7deab3d4-d48e-4e4e-8ac3-f5c6116a5038 req-a6b2c323-b19c-4925-b395-89ca069daef9 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Updating instance_info_cache with network_info: [{"id": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "address": "fa:16:3e:48:b0:09", "network": {"id": "62c3a0d2-d7cf-41dd-adb6-f2331929ee00", "bridge": null, "label": "tempest-TestShelveInstance-1115394549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec78f4baa84125864c0992ecfa6181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb5818fba-ad", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:25:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7deab3d4-d48e-4e4e-8ac3-f5c6116a5038 req-a6b2c323-b19c-4925-b395-89ca069daef9 service nova] Releasing lock "refresh_cache-bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:25:36 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Deleted allocations for instance bc2e6fef-e9b0-4413-ad26-e4a076cb0b49
Nov 15 04:25:36 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f329eddf-6a3b-4f05-9353-1b1e475ba420 is timed out.
Nov 15 04:25:36 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Successfully detached device vdb from instance f329eddf-6a3b-4f05-9353-1b1e475ba420 from the live domain config.
Nov 15 04:25:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JLtwoHDP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:25:36 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:25:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6d0b80-a8be-436d-bf25-eaf9076bbea3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:25:36 user nova-compute[74805]: No targets found.
Nov 15 04:25:36 user nova-compute[74805]: iSNS:
Nov 15 04:25:36 user nova-compute[74805]: No targets found.
Nov 15 04:25:36 user nova-compute[74805]: STATIC:
Nov 15 04:25:36 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076
Nov 15 04:25:36 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:25:36 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:25:36 user nova-compute[74805]: FIRMWARE:
Nov 15 04:25:36 user nova-compute[74805]: No targets found.
Nov 15 04:25:36 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:25:36 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:25:36 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG nova.objects.instance [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lazy-loading 'numa_topology' on Instance uuid bc2e6fef-e9b0-4413-ad26-e4a076cb0b49 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9afee3-a9a7-4109-9ac7-6210ccbc4592]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG nova.objects.base [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Object Instance<bc2e6fef-e9b0-4413-ad26-e4a076cb0b49> lazy-loaded attributes: resources,numa_topology {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f98daa-927d-45c3-95c4-d1ea417466cd]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 (non-flash)
Nov 15 04:25:36 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 (non-flash)
Nov 15 04:25:36 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2fb4287760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076'): ({'sdb'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Removing single pathed devices sdb {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[196f32e7-ddd9-4e78-b40b-aaa130d3e375]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dca74d9-3323-46e7-a532-2162852923b5]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Flushing IO for device /dev/sdb {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd02750-d69a-42de-b147-bfe43febae49]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07019a2-2a33-434b-8659-53fe7869701c]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.052s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce20d89-bc9e-435b-9c06-d366e78d31af]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0f4a17-5b5a-4a7e-8eb6-927fbc7f31de]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076, portal: 172.16.0.220,3260]
Nov 15 04:25:36 user nova-compute[74805]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076, portal: 172.16.0.220,3260] successful.
Nov 15 04:25:36 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74b00fdf-abeb-4d05-bdc6-1a1f7146d076 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acabb1a-304c-4c67-b14f-45cf6e176e79]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] <== disconnect_volume: return (321ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:25:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6d74b6ff-a026-4709-9b00-b39d3b8826cd tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.973s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:25:37 user nova-compute[74805]: DEBUG nova.objects.instance [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lazy-loading 'flavor' on Instance uuid f329eddf-6a3b-4f05-9353-1b1e475ba420 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:25:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4350da80-b4b1-472e-b8b0-67d2fe6c767f tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.943s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:25:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "fda0e490-03e3-4cf5-b22d-aab83d715616" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:25:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "fda0e490-03e3-4cf5-b22d-aab83d715616" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:25:38 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:25:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:25:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:25:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:25:38 user nova-compute[74805]: INFO nova.compute.claims [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Claim successful on node user
Nov 15 04:25:39 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:25:39 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:25:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:25:39 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:25:39 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:25:39 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:25:39 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:25:39 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:25:39 user nova-compute[74805]: DEBUG nova.policy [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0b6a8eff61f4d6ba2e83d7939143112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcdb40f067540dab36661ea0586f1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:25:39 user nova-compute[74805]: INFO nova.virt.block_device [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Booting with volume bdf88a15-d65a-43d6-aea2-07c232ecfd83 at /dev/vda
Nov 15 04:25:39 user nova-compute[74805]: DEBUG os_brick.utils [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:25:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:39 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cd1ac6-f98e-4666-9a67-d4fd167ba210]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:39 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[00167f29-5eca-4bfa-ba4c-f9b576332263]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:39 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[63403759-b7df-4dad-afa7-9d280db30bc9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:39 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccb6a4b-533a-4a83-be64-b5990cd4cdcd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:25:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:25:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:25:39 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:25:39 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[71525564-07b6-4228-9d90-596b2dafdadc]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:25:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:25:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:25:39 user nova-compute[74805]: DEBUG os_brick.utils [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:25:39 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Updating existing volume attachment record: aec38679-6e1b-466f-a03e-ba877b3a89fe {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:25:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:39 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Successfully created port: 26c6a394-5344-46d4-abf8-e49600450a07 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:25:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:40 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Successfully updated port: 26c6a394-5344-46d4-abf8-e49600450a07 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:25:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "refresh_cache-fda0e490-03e3-4cf5-b22d-aab83d715616" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:25:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquired lock "refresh_cache-fda0e490-03e3-4cf5-b22d-aab83d715616" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:25:40 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:25:40 user nova-compute[74805]: DEBUG nova.compute.manager [req-c9d65881-f98c-439d-a869-c16e810d81ce req-666063a2-9be5-45b6-bc9f-d802e52c1e84 service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Received event network-changed-26c6a394-5344-46d4-abf8-e49600450a07 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:25:40 user nova-compute[74805]: DEBUG nova.compute.manager [req-c9d65881-f98c-439d-a869-c16e810d81ce req-666063a2-9be5-45b6-bc9f-d802e52c1e84 service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Refreshing instance network info cache due to event network-changed-26c6a394-5344-46d4-abf8-e49600450a07. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:25:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c9d65881-f98c-439d-a869-c16e810d81ce req-666063a2-9be5-45b6-bc9f-d802e52c1e84 service nova] Acquiring lock "refresh_cache-fda0e490-03e3-4cf5-b22d-aab83d715616" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:25:40 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:25:40 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Updating instance_info_cache with network_info: [{"id": "26c6a394-5344-46d4-abf8-e49600450a07", "address": "fa:16:3e:e3:5f:9a", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c6a394-53", "ovs_interfaceid": "26c6a394-5344-46d4-abf8-e49600450a07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:25:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Releasing lock "refresh_cache-fda0e490-03e3-4cf5-b22d-aab83d715616" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:25:40 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Instance network_info: |[{"id": "26c6a394-5344-46d4-abf8-e49600450a07", "address": "fa:16:3e:e3:5f:9a", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c6a394-53", "ovs_interfaceid": "26c6a394-5344-46d4-abf8-e49600450a07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:25:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c9d65881-f98c-439d-a869-c16e810d81ce req-666063a2-9be5-45b6-bc9f-d802e52c1e84 service nova] Acquired lock "refresh_cache-fda0e490-03e3-4cf5-b22d-aab83d715616" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:25:40 user nova-compute[74805]: DEBUG nova.network.neutron [req-c9d65881-f98c-439d-a869-c16e810d81ce req-666063a2-9be5-45b6-bc9f-d802e52c1e84 service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Refreshing network info cache for port 26c6a394-5344-46d4-abf8-e49600450a07 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:25:41 user nova-compute[74805]: DEBUG nova.network.neutron [req-c9d65881-f98c-439d-a869-c16e810d81ce req-666063a2-9be5-45b6-bc9f-d802e52c1e84 service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Updated VIF entry in instance network info cache for port 26c6a394-5344-46d4-abf8-e49600450a07. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:25:41 user nova-compute[74805]: DEBUG nova.network.neutron [req-c9d65881-f98c-439d-a869-c16e810d81ce req-666063a2-9be5-45b6-bc9f-d802e52c1e84 service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Updating instance_info_cache with network_info: [{"id": "26c6a394-5344-46d4-abf8-e49600450a07", "address": "fa:16:3e:e3:5f:9a", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c6a394-53", "ovs_interfaceid": "26c6a394-5344-46d4-abf8-e49600450a07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:25:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c9d65881-f98c-439d-a869-c16e810d81ce req-666063a2-9be5-45b6-bc9f-d802e52c1e84 service nova] Releasing lock "refresh_cache-fda0e490-03e3-4cf5-b22d-aab83d715616" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:25:43 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:25:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:25:43 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Creating image(s)
Nov 15 04:25:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Did not create local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 04:25:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Ensure instance console log exists: /opt/stack/data/nova/instances/fda0e490-03e3-4cf5-b22d-aab83d715616/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:25:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:25:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:25:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:25:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Start _get_guest_xml network_info=[{"id": "26c6a394-5344-46d4-abf8-e49600450a07", "address": "fa:16:3e:e3:5f:9a", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c6a394-53", "ovs_interfaceid": "26c6a394-5344-46d4-abf8-e49600450a07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rBTNyREf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fda0e490-03e3-4cf5-b22d-aab83d715616', 'attached_at': '', 'detached_at': '', 'volume_id': 'bdf88a15-d65a-43d6-aea2-07c232ecfd83', 'serial': 'bdf88a15-d65a-43d6-aea2-07c232ecfd83'}, 'delete_on_termination': True, 'attachment_id': 'aec38679-6e1b-466f-a03e-ba877b3a89fe', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:25:44 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:25:44 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:25:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rBTNyREf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:25:44 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:25:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:25:44 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:25:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:25:44 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6940fb-b1d0-46ca-839c-02f0860e4e79]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:25:44 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1377dfc4-ef40-4af2-8e01-f7d1ccf7239d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83] added
Nov 15 04:25:44 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[17742a4c-de26-4fd5-877d-ff55bedefdd7]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a8519f-f144-48d0-b8ba-c40dd403310f]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rBTNyREf {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rBTNyREf" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[287f8515-acb4-43f7-879f-afedb007d286]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rBTNyREf'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[37649181-e103-4062-bfd5-54b361b3adee]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce07c3d-6969-4292-8d1a-cba3d4ab998d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 04:25:44 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 04:25:44 user nova-compute[74805]:  {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:25:44 user nova-compute[74805]: WARNING os_brick.initiator.connectors.iscsi [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 04:25:44 user nova-compute[74805]: 
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[497f8f1d-d77c-458e-9b18-8e4587b9eedc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83, portal: 172.16.0.220,3260]
Nov 15 04:25:44 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83, portal: 172.16.0.220,3260] successful.
Nov 15 04:25:44 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fa1994-893c-45bf-be1f-3174aa6096a1]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[71871812-e145-410e-8ef8-9cce0de50f91]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:25:44 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:25:44 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[645dcd02-9fc0-4530-a47c-a0f4b0484dfd]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rBTNyREf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:25:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG nova.compute.manager [None req-fa7b3de9-1e15-4817-be21-1cb0a614427f tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:45 user nova-compute[74805]: INFO nova.compute.manager [None req-fa7b3de9-1e15-4817-be21-1cb0a614427f tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] instance snapshotting
Nov 15 04:25:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26338356166633835', 'path': '/dev/sdb'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338356166633835', 'path': '/dev/sdb'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:25:45 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-fa7b3de9-1e15-4817-be21-1cb0a614427f tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Beginning live snapshot process
Nov 15 04:25:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:25:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-741514273',display_name='tempest-ServerActionsTestOtherA-server-741514273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-741514273',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGV8yvKXomaZF0BD7dR1o4bDaZdfuwtMvfH2u8DYsuFF6EZbmfxZGzCOIo9eDRbRFMNzHBU8sLiuRkxRud23xuRO+aBfUN0XRumVbmJ/zSOioI/76XwN4XIsuXVKkxna2w==',key_name='tempest-keypair-1041116715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dcdb40f067540dab36661ea0586f1d5',ramdisk_id='',reservation_id='r-7f40nzuc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1623992712',owner_user_name='tempest-ServerActionsTestOtherA-1623992712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:25:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b6a8eff61f4d6ba2e83d7939143112',uuid=fda0e490-03e3-4cf5-b22d-aab83d715616,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26c6a394-5344-46d4-abf8-e49600450a07", "address": "fa:16:3e:e3:5f:9a", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c6a394-53", "ovs_interfaceid": "26c6a394-5344-46d4-abf8-e49600450a07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converting VIF {"id": "26c6a394-5344-46d4-abf8-e49600450a07", "address": "fa:16:3e:e3:5f:9a", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c6a394-53", "ovs_interfaceid": "26c6a394-5344-46d4-abf8-e49600450a07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:5f:9a,bridge_name='br-int',has_traffic_filtering=True,id=26c6a394-5344-46d4-abf8-e49600450a07,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c6a394-53') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG nova.objects.instance [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lazy-loading 'pci_devices' on Instance uuid fda0e490-03e3-4cf5-b22d-aab83d715616 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:25:45 user nova-compute[74805]:   <uuid>fda0e490-03e3-4cf5-b22d-aab83d715616</uuid>
Nov 15 04:25:45 user nova-compute[74805]:   <name>instance-0000001f</name>
Nov 15 04:25:45 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:25:45 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:25:45 user nova-compute[74805]:   <metadata>
Nov 15 04:25:45 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:25:45 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:25:45 user nova-compute[74805]:       <nova:name>tempest-ServerActionsTestOtherA-server-741514273</nova:name>
Nov 15 04:25:45 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:25:44</nova:creationTime>
Nov 15 04:25:45 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:25:45 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:25:45 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:25:45 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:25:45 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:25:45 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:25:45 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:25:45 user nova-compute[74805]:       <nova:owner>
Nov 15 04:25:45 user nova-compute[74805]:         <nova:user uuid="d0b6a8eff61f4d6ba2e83d7939143112">tempest-ServerActionsTestOtherA-1623992712-project-member</nova:user>
Nov 15 04:25:45 user nova-compute[74805]:         <nova:project uuid="6dcdb40f067540dab36661ea0586f1d5">tempest-ServerActionsTestOtherA-1623992712</nova:project>
Nov 15 04:25:45 user nova-compute[74805]:       </nova:owner>
Nov 15 04:25:45 user nova-compute[74805]:       <nova:ports>
Nov 15 04:25:45 user nova-compute[74805]:         <nova:port uuid="26c6a394-5344-46d4-abf8-e49600450a07">
Nov 15 04:25:45 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 04:25:45 user nova-compute[74805]:         </nova:port>
Nov 15 04:25:45 user nova-compute[74805]:       </nova:ports>
Nov 15 04:25:45 user nova-compute[74805]:     </nova:instance>
Nov 15 04:25:45 user nova-compute[74805]:   </metadata>
Nov 15 04:25:45 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:25:45 user nova-compute[74805]:     <system>
Nov 15 04:25:45 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:25:45 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:25:45 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:25:45 user nova-compute[74805]:       <entry name="serial">fda0e490-03e3-4cf5-b22d-aab83d715616</entry>
Nov 15 04:25:45 user nova-compute[74805]:       <entry name="uuid">fda0e490-03e3-4cf5-b22d-aab83d715616</entry>
Nov 15 04:25:45 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:25:45 user nova-compute[74805]:     </system>
Nov 15 04:25:45 user nova-compute[74805]:   </sysinfo>
Nov 15 04:25:45 user nova-compute[74805]:   <os>
Nov 15 04:25:45 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:25:45 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:25:45 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:25:45 user nova-compute[74805]:   </os>
Nov 15 04:25:45 user nova-compute[74805]:   <features>
Nov 15 04:25:45 user nova-compute[74805]:     <acpi/>
Nov 15 04:25:45 user nova-compute[74805]:     <apic/>
Nov 15 04:25:45 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:25:45 user nova-compute[74805]:   </features>
Nov 15 04:25:45 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:25:45 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:25:45 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:25:45 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:25:45 user nova-compute[74805]:   </clock>
Nov 15 04:25:45 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:25:45 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:25:45 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:25:45 user nova-compute[74805]:   </cpu>
Nov 15 04:25:45 user nova-compute[74805]:   <devices>
Nov 15 04:25:45 user nova-compute[74805]:     <disk type="block" device="disk">
Nov 15 04:25:45 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:25:45 user nova-compute[74805]:       <source dev="/dev/sdb"/>
Nov 15 04:25:45 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:25:45 user nova-compute[74805]:       <serial>bdf88a15-d65a-43d6-aea2-07c232ecfd83</serial>
Nov 15 04:25:45 user nova-compute[74805]:     </disk>
Nov 15 04:25:45 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:25:45 user nova-compute[74805]:       <mac address="fa:16:3e:e3:5f:9a"/>
Nov 15 04:25:45 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:25:45 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:25:45 user nova-compute[74805]:       <target dev="tap26c6a394-53"/>
Nov 15 04:25:45 user nova-compute[74805]:     </interface>
Nov 15 04:25:45 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:25:45 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/fda0e490-03e3-4cf5-b22d-aab83d715616/console.log" append="off"/>
Nov 15 04:25:45 user nova-compute[74805]:     </serial>
Nov 15 04:25:45 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:25:45 user nova-compute[74805]:     <video>
Nov 15 04:25:45 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:25:45 user nova-compute[74805]:     </video>
Nov 15 04:25:45 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:25:45 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:25:45 user nova-compute[74805]:     </rng>
Nov 15 04:25:45 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:25:45 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:25:45 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:25:45 user nova-compute[74805]:     </memballoon>
Nov 15 04:25:45 user nova-compute[74805]:   </devices>
Nov 15 04:25:45 user nova-compute[74805]: </domain>
Nov 15 04:25:45 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:25:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-741514273',display_name='tempest-ServerActionsTestOtherA-server-741514273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-741514273',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGV8yvKXomaZF0BD7dR1o4bDaZdfuwtMvfH2u8DYsuFF6EZbmfxZGzCOIo9eDRbRFMNzHBU8sLiuRkxRud23xuRO+aBfUN0XRumVbmJ/zSOioI/76XwN4XIsuXVKkxna2w==',key_name='tempest-keypair-1041116715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dcdb40f067540dab36661ea0586f1d5',ramdisk_id='',reservation_id='r-7f40nzuc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1623992712',owner_user_name='tempest-ServerActionsTestOtherA-1623992712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:25:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b6a8eff61f4d6ba2e83d7939143112',uuid=fda0e490-03e3-4cf5-b22d-aab83d715616,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26c6a394-5344-46d4-abf8-e49600450a07", "address": "fa:16:3e:e3:5f:9a", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c6a394-53", "ovs_interfaceid": "26c6a394-5344-46d4-abf8-e49600450a07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converting VIF {"id": "26c6a394-5344-46d4-abf8-e49600450a07", "address": "fa:16:3e:e3:5f:9a", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c6a394-53", "ovs_interfaceid": "26c6a394-5344-46d4-abf8-e49600450a07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:5f:9a,bridge_name='br-int',has_traffic_filtering=True,id=26c6a394-5344-46d4-abf8-e49600450a07,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c6a394-53') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG os_vif [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:5f:9a,bridge_name='br-int',has_traffic_filtering=True,id=26c6a394-5344-46d4-abf8-e49600450a07,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c6a394-53') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6819de47-e976-5cb5-a9d8-ee48066962d0', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26c6a394-53, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26c6a394-53, col_values=(('qos', UUID('13120ad1-22c2-46d4-bd90-152305e7369e')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26c6a394-53, col_values=(('external_ids', {'iface-id': '26c6a394-5344-46d4-abf8-e49600450a07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:5f:9a', 'vm-uuid': 'fda0e490-03e3-4cf5-b22d-aab83d715616'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:45 user nova-compute[74805]: INFO os_vif [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:5f:9a,bridge_name='br-int',has_traffic_filtering=True,id=26c6a394-5344-46d4-abf8-e49600450a07,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c6a394-53')
Nov 15 04:25:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] No VIF found with MAC fa:16:3e:e3:5f:9a, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-fa7b3de9-1e15-4817-be21-1cb0a614427f tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json -f qcow2 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-fa7b3de9-1e15-4817-be21-1cb0a614427f tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-fa7b3de9-1e15-4817-be21-1cb0a614427f tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json -f qcow2 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-fa7b3de9-1e15-4817-be21-1cb0a614427f tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-fa7b3de9-1e15-4817-be21-1cb0a614427f tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-fa7b3de9-1e15-4817-be21-1cb0a614427f tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.172s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-fa7b3de9-1e15-4817-be21-1cb0a614427f tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpy40bd7ls/1732432a8a474f558a039a981a5affa6.delta 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-fa7b3de9-1e15-4817-be21-1cb0a614427f tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpy40bd7ls/1732432a8a474f558a039a981a5affa6.delta 1073741824" returned: 0 in 0.058s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:46 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-fa7b3de9-1e15-4817-be21-1cb0a614427f tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 04:25:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-fa7b3de9-1e15-4817-be21-1cb0a614427f tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74805) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 04:25:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-fa7b3de9-1e15-4817-be21-1cb0a614427f tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74805) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 04:25:47 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-fa7b3de9-1e15-4817-be21-1cb0a614427f tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 04:25:47 user nova-compute[74805]: DEBUG nova.compute.manager [req-8ec9389a-67ae-423b-a637-a79c3ff5974b req-3b93261f-b184-4493-8d71-802db22002f2 service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Received event network-vif-plugged-26c6a394-5344-46d4-abf8-e49600450a07 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:25:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8ec9389a-67ae-423b-a637-a79c3ff5974b req-3b93261f-b184-4493-8d71-802db22002f2 service nova] Acquiring lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:25:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8ec9389a-67ae-423b-a637-a79c3ff5974b req-3b93261f-b184-4493-8d71-802db22002f2 service nova] Lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:25:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8ec9389a-67ae-423b-a637-a79c3ff5974b req-3b93261f-b184-4493-8d71-802db22002f2 service nova] Lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:25:47 user nova-compute[74805]: DEBUG nova.compute.manager [req-8ec9389a-67ae-423b-a637-a79c3ff5974b req-3b93261f-b184-4493-8d71-802db22002f2 service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] No waiting events found dispatching network-vif-plugged-26c6a394-5344-46d4-abf8-e49600450a07 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:25:47 user nova-compute[74805]: WARNING nova.compute.manager [req-8ec9389a-67ae-423b-a637-a79c3ff5974b req-3b93261f-b184-4493-8d71-802db22002f2 service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Received unexpected event network-vif-plugged-26c6a394-5344-46d4-abf8-e49600450a07 for instance with vm_state building and task_state spawning.
Nov 15 04:25:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:47 user nova-compute[74805]: DEBUG nova.privsep.utils [None req-fa7b3de9-1e15-4817-be21-1cb0a614427f tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74805) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 04:25:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-fa7b3de9-1e15-4817-be21-1cb0a614427f tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpy40bd7ls/1732432a8a474f558a039a981a5affa6.delta /opt/stack/data/nova/instances/snapshots/tmpy40bd7ls/1732432a8a474f558a039a981a5affa6 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:25:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-fa7b3de9-1e15-4817-be21-1cb0a614427f tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpy40bd7ls/1732432a8a474f558a039a981a5affa6.delta /opt/stack/data/nova/instances/snapshots/tmpy40bd7ls/1732432a8a474f558a039a981a5affa6" returned: 0 in 0.478s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:25:48 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-fa7b3de9-1e15-4817-be21-1cb0a614427f tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Snapshot extracted, beginning image upload
Nov 15 04:25:49 user nova-compute[74805]: DEBUG nova.compute.manager [req-bd049ca6-fbee-4d12-9f92-6145143a0fc6 req-3020f121-cb9b-4fb1-979f-8ccc1ac4c83e service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Received event network-vif-plugged-26c6a394-5344-46d4-abf8-e49600450a07 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:25:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bd049ca6-fbee-4d12-9f92-6145143a0fc6 req-3020f121-cb9b-4fb1-979f-8ccc1ac4c83e service nova] Acquiring lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:25:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bd049ca6-fbee-4d12-9f92-6145143a0fc6 req-3020f121-cb9b-4fb1-979f-8ccc1ac4c83e service nova] Lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:25:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bd049ca6-fbee-4d12-9f92-6145143a0fc6 req-3020f121-cb9b-4fb1-979f-8ccc1ac4c83e service nova] Lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:25:49 user nova-compute[74805]: DEBUG nova.compute.manager [req-bd049ca6-fbee-4d12-9f92-6145143a0fc6 req-3020f121-cb9b-4fb1-979f-8ccc1ac4c83e service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] No waiting events found dispatching network-vif-plugged-26c6a394-5344-46d4-abf8-e49600450a07 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:25:49 user nova-compute[74805]: WARNING nova.compute.manager [req-bd049ca6-fbee-4d12-9f92-6145143a0fc6 req-3020f121-cb9b-4fb1-979f-8ccc1ac4c83e service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Received unexpected event network-vif-plugged-26c6a394-5344-46d4-abf8-e49600450a07 for instance with vm_state building and task_state spawning.
Nov 15 04:25:49 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:25:49 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:25:49 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Instance spawned successfully.
Nov 15 04:25:49 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:25:49 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:25:49 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:25:49 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:25:49 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:25:49 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:25:49 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:25:49 user nova-compute[74805]: INFO nova.compute.manager [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Took 5.97 seconds to spawn the instance on the hypervisor.
Nov 15 04:25:49 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:25:50 user nova-compute[74805]: INFO nova.compute.manager [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Took 11.26 seconds to build instance.
Nov 15 04:25:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ecd41c12-fe63-4363-9bcb-eef068c094ec tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "fda0e490-03e3-4cf5-b22d-aab83d715616" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.468s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:25:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:50 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-fa7b3de9-1e15-4817-be21-1cb0a614427f tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Snapshot image upload complete
Nov 15 04:25:50 user nova-compute[74805]: INFO nova.compute.manager [None req-fa7b3de9-1e15-4817-be21-1cb0a614427f tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Took 5.61 seconds to snapshot the instance on the hypervisor.
Nov 15 04:25:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:25:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:07 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a5de7209-0eeb-45ba-a60e-95b18de23333 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "f329eddf-6a3b-4f05-9353-1b1e475ba420" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a5de7209-0eeb-45ba-a60e-95b18de23333 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a5de7209-0eeb-45ba-a60e-95b18de23333 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "f329eddf-6a3b-4f05-9353-1b1e475ba420-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a5de7209-0eeb-45ba-a60e-95b18de23333 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a5de7209-0eeb-45ba-a60e-95b18de23333 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:08 user nova-compute[74805]: INFO nova.compute.manager [None req-a5de7209-0eeb-45ba-a60e-95b18de23333 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Terminating instance
Nov 15 04:26:08 user nova-compute[74805]: DEBUG nova.compute.manager [None req-a5de7209-0eeb-45ba-a60e-95b18de23333 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG nova.compute.manager [req-10abfc46-eb96-42ee-8afb-d92b4054c6ac req-ca6ecec4-17e5-4e2b-a282-f3ba480b03a7 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Received event network-vif-unplugged-a8a0db92-660b-4fc3-b68c-9e6a37aa85db {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-10abfc46-eb96-42ee-8afb-d92b4054c6ac req-ca6ecec4-17e5-4e2b-a282-f3ba480b03a7 service nova] Acquiring lock "f329eddf-6a3b-4f05-9353-1b1e475ba420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-10abfc46-eb96-42ee-8afb-d92b4054c6ac req-ca6ecec4-17e5-4e2b-a282-f3ba480b03a7 service nova] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-10abfc46-eb96-42ee-8afb-d92b4054c6ac req-ca6ecec4-17e5-4e2b-a282-f3ba480b03a7 service nova] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG nova.compute.manager [req-10abfc46-eb96-42ee-8afb-d92b4054c6ac req-ca6ecec4-17e5-4e2b-a282-f3ba480b03a7 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] No waiting events found dispatching network-vif-unplugged-a8a0db92-660b-4fc3-b68c-9e6a37aa85db {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG nova.compute.manager [req-10abfc46-eb96-42ee-8afb-d92b4054c6ac req-ca6ecec4-17e5-4e2b-a282-f3ba480b03a7 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Received event network-vif-unplugged-a8a0db92-660b-4fc3-b68c-9e6a37aa85db for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:08 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Instance destroyed successfully.
Nov 15 04:26:08 user nova-compute[74805]: DEBUG nova.objects.instance [None req-a5de7209-0eeb-45ba-a60e-95b18de23333 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lazy-loading 'resources' on Instance uuid f329eddf-6a3b-4f05-9353-1b1e475ba420 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-a5de7209-0eeb-45ba-a60e-95b18de23333 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2023098510',display_name='tempest-TestMinimumBasicScenario-server-2023098510',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2023098510',id=23,image_ref='38334ba6-47ff-4a7a-a765-26a71d072dae',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZK5HyIPCfmmC2fyBThsopmpypMefbIERGm03Bk45iT3dPJEBS3XRAlHU1kIW47VvaeablEsgUPPMWy/COwPg/1l9Pfwo6SaCaSs2oJMjmP45+Lmgk6Y727q/ux4EfcZw==',key_name='tempest-TestMinimumBasicScenario-868758740',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:21:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ddde64bc93cc40f189e1d0b6d948cd0a',ramdisk_id='',reservation_id='r-jvhaw2dm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='38334ba6-47ff-4a7a-a765-26a71d072dae',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-342422642',owner_user_name='tempest-TestMinimumBasicScenario-342422642-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:23:30Z,user_data=None,user_id='eac59db39ba64883a64ab3133eaf1972',uuid=f329eddf-6a3b-4f05-9353-1b1e475ba420,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "address": "fa:16:3e:44:06:9f", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a0db92-66", "ovs_interfaceid": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-a5de7209-0eeb-45ba-a60e-95b18de23333 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Converting VIF {"id": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "address": "fa:16:3e:44:06:9f", "network": {"id": "8408f959-0c0d-4a22-afa0-b51304c254ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1260281939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddde64bc93cc40f189e1d0b6d948cd0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a0db92-66", "ovs_interfaceid": "a8a0db92-660b-4fc3-b68c-9e6a37aa85db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-a5de7209-0eeb-45ba-a60e-95b18de23333 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:06:9f,bridge_name='br-int',has_traffic_filtering=True,id=a8a0db92-660b-4fc3-b68c-9e6a37aa85db,network=Network(8408f959-0c0d-4a22-afa0-b51304c254ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a0db92-66') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG os_vif [None req-a5de7209-0eeb-45ba-a60e-95b18de23333 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:06:9f,bridge_name='br-int',has_traffic_filtering=True,id=a8a0db92-660b-4fc3-b68c-9e6a37aa85db,network=Network(8408f959-0c0d-4a22-afa0-b51304c254ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a0db92-66') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8a0db92-66, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=493de683-65ab-4577-a387-4867bca88818) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:26:08 user nova-compute[74805]: INFO os_vif [None req-a5de7209-0eeb-45ba-a60e-95b18de23333 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:06:9f,bridge_name='br-int',has_traffic_filtering=True,id=a8a0db92-660b-4fc3-b68c-9e6a37aa85db,network=Network(8408f959-0c0d-4a22-afa0-b51304c254ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a0db92-66')
Nov 15 04:26:08 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-a5de7209-0eeb-45ba-a60e-95b18de23333 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Deleting instance files /opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420_del
Nov 15 04:26:08 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-a5de7209-0eeb-45ba-a60e-95b18de23333 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Deletion of /opt/stack/data/nova/instances/f329eddf-6a3b-4f05-9353-1b1e475ba420_del complete
Nov 15 04:26:08 user nova-compute[74805]: INFO nova.compute.manager [None req-a5de7209-0eeb-45ba-a60e-95b18de23333 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 15 04:26:08 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-a5de7209-0eeb-45ba-a60e-95b18de23333 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:26:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:09 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:26:09 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Took 0.70 seconds to deallocate network for instance.
Nov 15 04:26:09 user nova-compute[74805]: DEBUG nova.compute.manager [req-b97f119c-b421-4aa1-8524-9360561f769f req-7324e07f-1bee-4072-b8d4-b919c05f5537 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Received event network-vif-deleted-a8a0db92-660b-4fc3-b68c-9e6a37aa85db {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:26:09 user nova-compute[74805]: INFO nova.compute.manager [req-b97f119c-b421-4aa1-8524-9360561f769f req-7324e07f-1bee-4072-b8d4-b919c05f5537 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Neutron deleted interface a8a0db92-660b-4fc3-b68c-9e6a37aa85db; detaching it from the instance and deleting it from the info cache
Nov 15 04:26:09 user nova-compute[74805]: DEBUG nova.network.neutron [req-b97f119c-b421-4aa1-8524-9360561f769f req-7324e07f-1bee-4072-b8d4-b919c05f5537 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:26:09 user nova-compute[74805]: DEBUG nova.compute.manager [req-b97f119c-b421-4aa1-8524-9360561f769f req-7324e07f-1bee-4072-b8d4-b919c05f5537 service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Detach interface failed, port_id=a8a0db92-660b-4fc3-b68c-9e6a37aa85db, reason: Instance f329eddf-6a3b-4f05-9353-1b1e475ba420 could not be found. {{(pid=74805) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 04:26:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a5de7209-0eeb-45ba-a60e-95b18de23333 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a5de7209-0eeb-45ba-a60e-95b18de23333 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-a5de7209-0eeb-45ba-a60e-95b18de23333 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Refreshing inventories for resource provider ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f2b2c917-926f-42f0-b198-c6c93ee01da2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Acquiring lock "bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f2b2c917-926f-42f0-b198-c6c93ee01da2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Lock "bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f2b2c917-926f-42f0-b198-c6c93ee01da2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Acquiring lock "bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f2b2c917-926f-42f0-b198-c6c93ee01da2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Lock "bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f2b2c917-926f-42f0-b198-c6c93ee01da2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Lock "bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:10 user nova-compute[74805]: INFO nova.compute.manager [None req-f2b2c917-926f-42f0-b198-c6c93ee01da2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Terminating instance
Nov 15 04:26:10 user nova-compute[74805]: DEBUG nova.compute.manager [None req-f2b2c917-926f-42f0-b198-c6c93ee01da2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-a5de7209-0eeb-45ba-a60e-95b18de23333 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Updating ProviderTree inventory for provider ada87504-5552-4a33-b754-f9a54c67fe39 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-a5de7209-0eeb-45ba-a60e-95b18de23333 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Updating inventory in ProviderTree for provider ada87504-5552-4a33-b754-f9a54c67fe39 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-a5de7209-0eeb-45ba-a60e-95b18de23333 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Refreshing aggregate associations for resource provider ada87504-5552-4a33-b754-f9a54c67fe39, aggregates: None {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-a5de7209-0eeb-45ba-a60e-95b18de23333 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Refreshing trait associations for resource provider ada87504-5552-4a33-b754-f9a54c67fe39, traits: COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-a5de7209-0eeb-45ba-a60e-95b18de23333 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-a5de7209-0eeb-45ba-a60e-95b18de23333 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a5de7209-0eeb-45ba-a60e-95b18de23333 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.688s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:10 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-a5de7209-0eeb-45ba-a60e-95b18de23333 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Deleted allocations for instance f329eddf-6a3b-4f05-9353-1b1e475ba420
Nov 15 04:26:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG nova.compute.manager [req-5b3fbb56-36a7-4c8f-b6bc-07c0d7d9c047 req-9b5ada39-fa52-4cbf-bc4a-86ba6176a08b service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Received event network-vif-plugged-a8a0db92-660b-4fc3-b68c-9e6a37aa85db {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5b3fbb56-36a7-4c8f-b6bc-07c0d7d9c047 req-9b5ada39-fa52-4cbf-bc4a-86ba6176a08b service nova] Acquiring lock "f329eddf-6a3b-4f05-9353-1b1e475ba420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5b3fbb56-36a7-4c8f-b6bc-07c0d7d9c047 req-9b5ada39-fa52-4cbf-bc4a-86ba6176a08b service nova] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5b3fbb56-36a7-4c8f-b6bc-07c0d7d9c047 req-9b5ada39-fa52-4cbf-bc4a-86ba6176a08b service nova] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG nova.compute.manager [req-5b3fbb56-36a7-4c8f-b6bc-07c0d7d9c047 req-9b5ada39-fa52-4cbf-bc4a-86ba6176a08b service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] No waiting events found dispatching network-vif-plugged-a8a0db92-660b-4fc3-b68c-9e6a37aa85db {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:26:10 user nova-compute[74805]: WARNING nova.compute.manager [req-5b3fbb56-36a7-4c8f-b6bc-07c0d7d9c047 req-9b5ada39-fa52-4cbf-bc4a-86ba6176a08b service nova] [instance: f329eddf-6a3b-4f05-9353-1b1e475ba420] Received unexpected event network-vif-plugged-a8a0db92-660b-4fc3-b68c-9e6a37aa85db for instance with vm_state deleted and task_state None.
Nov 15 04:26:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a5de7209-0eeb-45ba-a60e-95b18de23333 tempest-TestMinimumBasicScenario-342422642 tempest-TestMinimumBasicScenario-342422642-project-member] Lock "f329eddf-6a3b-4f05-9353-1b1e475ba420" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.503s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6594aaea-3698-4d56-babf-95f9654138f1/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:10 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Instance destroyed successfully.
Nov 15 04:26:10 user nova-compute[74805]: DEBUG nova.objects.instance [None req-f2b2c917-926f-42f0-b198-c6c93ee01da2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Lazy-loading 'resources' on Instance uuid bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-f2b2c917-926f-42f0-b198-c6c93ee01da2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:24:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-631993904',display_name='tempest-VolumesNegativeTest-instance-631993904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-631993904',id=28,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:24:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='10d75d23473b4fb48a22ad55d6cf93e8',ramdisk_id='',reservation_id='r-7vc0km5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1422002093',owner_user_name='tempest-VolumesNegativeTest-1422002093-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:24:27Z,user_data=None,user_id='e56b4cdf0792437fb2faa830366ec4f2',uuid=bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3af89bf6-2da7-4d33-a99c-ef123b1732c2", "address": "fa:16:3e:f8:84:fb", "network": {"id": "8ef5c460-a691-4872-b212-64425d090e83", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "73611220d55a49e9a671c10706774c3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3af89bf6-2d", "ovs_interfaceid": "3af89bf6-2da7-4d33-a99c-ef123b1732c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-f2b2c917-926f-42f0-b198-c6c93ee01da2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Converting VIF {"id": "3af89bf6-2da7-4d33-a99c-ef123b1732c2", "address": "fa:16:3e:f8:84:fb", "network": {"id": "8ef5c460-a691-4872-b212-64425d090e83", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "73611220d55a49e9a671c10706774c3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3af89bf6-2d", "ovs_interfaceid": "3af89bf6-2da7-4d33-a99c-ef123b1732c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-f2b2c917-926f-42f0-b198-c6c93ee01da2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:84:fb,bridge_name='br-int',has_traffic_filtering=True,id=3af89bf6-2da7-4d33-a99c-ef123b1732c2,network=Network(8ef5c460-a691-4872-b212-64425d090e83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3af89bf6-2d') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG os_vif [None req-f2b2c917-926f-42f0-b198-c6c93ee01da2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:84:fb,bridge_name='br-int',has_traffic_filtering=True,id=3af89bf6-2da7-4d33-a99c-ef123b1732c2,network=Network(8ef5c460-a691-4872-b212-64425d090e83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3af89bf6-2d') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3af89bf6-2d, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0cfda220-3ea4-48ad-a6f3-0768aa32373a) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:26:10 user nova-compute[74805]: INFO os_vif [None req-f2b2c917-926f-42f0-b198-c6c93ee01da2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:84:fb,bridge_name='br-int',has_traffic_filtering=True,id=3af89bf6-2da7-4d33-a99c-ef123b1732c2,network=Network(8ef5c460-a691-4872-b212-64425d090e83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3af89bf6-2d')
Nov 15 04:26:10 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-f2b2c917-926f-42f0-b198-c6c93ee01da2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Deleting instance files /opt/stack/data/nova/instances/bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd_del
Nov 15 04:26:10 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-f2b2c917-926f-42f0-b198-c6c93ee01da2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Deletion of /opt/stack/data/nova/instances/bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd_del complete
Nov 15 04:26:11 user nova-compute[74805]: INFO nova.compute.manager [None req-f2b2c917-926f-42f0-b198-c6c93ee01da2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 15 04:26:11 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-f2b2c917-926f-42f0-b198-c6c93ee01da2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:26:11 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:26:11 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:26:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6594aaea-3698-4d56-babf-95f9654138f1/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6594aaea-3698-4d56-babf-95f9654138f1/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6594aaea-3698-4d56-babf-95f9654138f1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:11 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:26:11 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Took 0.45 seconds to deallocate network for instance.
Nov 15 04:26:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f2b2c917-926f-42f0-b198-c6c93ee01da2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f2b2c917-926f-42f0-b198-c6c93ee01da2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:11 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Error from libvirt while getting description of instance-00000017: [Error Code 42] Domain not found: no domain with matching uuid 'f329eddf-6a3b-4f05-9353-1b1e475ba420' (instance-00000017): libvirt.libvirtError: Domain not found: no domain with matching uuid 'f329eddf-6a3b-4f05-9353-1b1e475ba420' (instance-00000017)
Nov 15 04:26:12 user nova-compute[74805]: DEBUG nova.compute.manager [req-a39b3e67-2d0e-4169-b541-c8a51b8de553 req-9f507e4e-1aae-42be-b115-b2d28cb2ab2c service nova] [instance: bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd] Received event network-vif-deleted-3af89bf6-2da7-4d33-a99c-ef123b1732c2 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:26:12 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:26:12 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:26:12 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=7752MB free_disk=25.186492919921875GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:26:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:12 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-f2b2c917-926f-42f0-b198-c6c93ee01da2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:26:12 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-f2b2c917-926f-42f0-b198-c6c93ee01da2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:26:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f2b2c917-926f-42f0-b198-c6c93ee01da2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.645s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.179s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:12 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-f2b2c917-926f-42f0-b198-c6c93ee01da2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Deleted allocations for instance bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd
Nov 15 04:26:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f2b2c917-926f-42f0-b198-c6c93ee01da2 tempest-VolumesNegativeTest-1422002093 tempest-VolumesNegativeTest-1422002093-project-member] Lock "bb2e89bb-4fa4-4fde-a701-37ee07b4a6cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.287s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:12 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance d63f3726-27df-455f-bda0-3ddca95b70d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:26:12 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance e5004557-00fa-4824-9233-343c2261588d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:26:12 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 9f267864-0b72-431d-9b0d-c63436002a4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:26:12 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 6594aaea-3698-4d56-babf-95f9654138f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:26:12 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:26:12 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance fda0e490-03e3-4cf5-b22d-aab83d715616 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:26:12 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:26:12 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:26:12 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:26:12 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:26:12 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:26:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.400s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:13 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:26:13 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:26:13 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:26:13 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:26:13 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Rebuilding the list of instances to heal {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 04:26:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-d63f3726-27df-455f-bda0-3ddca95b70d9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:26:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-d63f3726-27df-455f-bda0-3ddca95b70d9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:26:13 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:26:13 user nova-compute[74805]: DEBUG nova.objects.instance [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lazy-loading 'info_cache' on Instance uuid d63f3726-27df-455f-bda0-3ddca95b70d9 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:26:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "4a2d5475-04a4-414d-9ce9-d5204494f898" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "4a2d5475-04a4-414d-9ce9-d5204494f898" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:13 user nova-compute[74805]: INFO nova.compute.manager [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Unshelving
Nov 15 04:26:13 user nova-compute[74805]: INFO nova.virt.block_device [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Booting with volume dd635a1a-ac62-4627-8a17-e02f6328d312 at /dev/vdc
Nov 15 04:26:13 user nova-compute[74805]: DEBUG os_brick.utils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:26:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43bfd04-1347-4d57-b289-9bd2f19790c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44dbce3-c3cb-4e87-88aa-f078198953fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bee94a-67cd-48a0-988b-8347d12e8c35]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef09cc90-e35c-4cd2-9ec5-a6b214c99bd0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:26:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:26:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:26:14 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:26:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ac58c5-c81f-4e47-969b-ffb17031bf03]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:26:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:26:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:26:14 user nova-compute[74805]: DEBUG os_brick.utils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:26:14 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Updating existing volume attachment record: 6e6aafff-3845-4f12-8a68-1243be699f5b {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:26:14 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Updating instance_info_cache with network_info: [{"id": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "address": "fa:16:3e:b1:3d:ff", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d0a11b6-25", "ovs_interfaceid": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:26:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-d63f3726-27df-455f-bda0-3ddca95b70d9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:26:14 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:26:14 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:26:14 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:26:14 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:26:14 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:26:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:18 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:26:18 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:26:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:18 user nova-compute[74805]: DEBUG nova.objects.instance [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lazy-loading 'pci_requests' on Instance uuid 4a2d5475-04a4-414d-9ce9-d5204494f898 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:26:18 user nova-compute[74805]: DEBUG nova.objects.instance [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lazy-loading 'numa_topology' on Instance uuid 4a2d5475-04a4-414d-9ce9-d5204494f898 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:26:18 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:26:18 user nova-compute[74805]: INFO nova.compute.claims [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Claim successful on node user
Nov 15 04:26:19 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:26:19 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:26:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:19 user nova-compute[74805]: INFO nova.network.neutron [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Updating port 90a9632d-7041-430e-a0f4-0b8ec60eb332 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 04:26:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "refresh_cache-4a2d5475-04a4-414d-9ce9-d5204494f898" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:26:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquired lock "refresh_cache-4a2d5475-04a4-414d-9ce9-d5204494f898" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:26:19 user nova-compute[74805]: DEBUG nova.network.neutron [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:26:19 user nova-compute[74805]: DEBUG nova.compute.manager [req-c1adf4ea-965b-4d66-99a6-523442862c7b req-6d86b770-9751-4c03-9d2a-a6529501f75b service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Received event network-changed-90a9632d-7041-430e-a0f4-0b8ec60eb332 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:26:19 user nova-compute[74805]: DEBUG nova.compute.manager [req-c1adf4ea-965b-4d66-99a6-523442862c7b req-6d86b770-9751-4c03-9d2a-a6529501f75b service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Refreshing instance network info cache due to event network-changed-90a9632d-7041-430e-a0f4-0b8ec60eb332. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:26:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c1adf4ea-965b-4d66-99a6-523442862c7b req-6d86b770-9751-4c03-9d2a-a6529501f75b service nova] Acquiring lock "refresh_cache-4a2d5475-04a4-414d-9ce9-d5204494f898" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:26:20 user nova-compute[74805]: DEBUG nova.network.neutron [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Updating instance_info_cache with network_info: [{"id": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "address": "fa:16:3e:61:a1:b6", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a9632d-70", "ovs_interfaceid": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:26:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Releasing lock "refresh_cache-4a2d5475-04a4-414d-9ce9-d5204494f898" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:26:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:26:20 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Creating image(s)
Nov 15 04:26:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "/opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "/opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:20 user nova-compute[74805]: DEBUG nova.objects.instance [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4a2d5475-04a4-414d-9ce9-d5204494f898 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:26:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c1adf4ea-965b-4d66-99a6-523442862c7b req-6d86b770-9751-4c03-9d2a-a6529501f75b service nova] Acquired lock "refresh_cache-4a2d5475-04a4-414d-9ce9-d5204494f898" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:26:20 user nova-compute[74805]: DEBUG nova.network.neutron [req-c1adf4ea-965b-4d66-99a6-523442862c7b req-6d86b770-9751-4c03-9d2a-a6529501f75b service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Refreshing network info cache for port 90a9632d-7041-430e-a0f4-0b8ec60eb332 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:26:20 user nova-compute[74805]: DEBUG nova.objects.base [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Object Instance<4a2d5475-04a4-414d-9ce9-d5204494f898> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:26:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "2b8004f5ff1076d73c3be9241d490f9bd28468cf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "2b8004f5ff1076d73c3be9241d490f9bd28468cf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:20 user nova-compute[74805]: DEBUG nova.compute.manager [req-760b5936-9d67-4878-8734-e2bc608d0b0e req-1a14ef0a-f391-442c-8cb3-21a3b0240481 service nova] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Received event network-changed-dd7dff22-92a5-49fa-a626-381e41aff96e {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:26:20 user nova-compute[74805]: DEBUG nova.compute.manager [req-760b5936-9d67-4878-8734-e2bc608d0b0e req-1a14ef0a-f391-442c-8cb3-21a3b0240481 service nova] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Refreshing instance network info cache due to event network-changed-dd7dff22-92a5-49fa-a626-381e41aff96e. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:26:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-760b5936-9d67-4878-8734-e2bc608d0b0e req-1a14ef0a-f391-442c-8cb3-21a3b0240481 service nova] Acquiring lock "refresh_cache-6594aaea-3698-4d56-babf-95f9654138f1" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:26:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-760b5936-9d67-4878-8734-e2bc608d0b0e req-1a14ef0a-f391-442c-8cb3-21a3b0240481 service nova] Acquired lock "refresh_cache-6594aaea-3698-4d56-babf-95f9654138f1" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:26:20 user nova-compute[74805]: DEBUG nova.network.neutron [req-760b5936-9d67-4878-8734-e2bc608d0b0e req-1a14ef0a-f391-442c-8cb3-21a3b0240481 service nova] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Refreshing network info cache for port dd7dff22-92a5-49fa-a626-381e41aff96e {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:26:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b8004f5ff1076d73c3be9241d490f9bd28468cf.part --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b8004f5ff1076d73c3be9241d490f9bd28468cf.part --force-share --output=json" returned: 0 in 0.181s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:21 user nova-compute[74805]: DEBUG nova.virt.images [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] f15a0a7c-9de2-42b0-9fe6-e61b97e06657 was qcow2, converting to raw {{(pid=74805) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 04:26:21 user nova-compute[74805]: DEBUG nova.privsep.utils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74805) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 04:26:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2b8004f5ff1076d73c3be9241d490f9bd28468cf.part /opt/stack/data/nova/instances/_base/2b8004f5ff1076d73c3be9241d490f9bd28468cf.converted {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:21 user nova-compute[74805]: DEBUG nova.network.neutron [req-c1adf4ea-965b-4d66-99a6-523442862c7b req-6d86b770-9751-4c03-9d2a-a6529501f75b service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Updated VIF entry in instance network info cache for port 90a9632d-7041-430e-a0f4-0b8ec60eb332. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:26:21 user nova-compute[74805]: DEBUG nova.network.neutron [req-c1adf4ea-965b-4d66-99a6-523442862c7b req-6d86b770-9751-4c03-9d2a-a6529501f75b service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Updating instance_info_cache with network_info: [{"id": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "address": "fa:16:3e:61:a1:b6", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a9632d-70", "ovs_interfaceid": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:26:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c1adf4ea-965b-4d66-99a6-523442862c7b req-6d86b770-9751-4c03-9d2a-a6529501f75b service nova] Releasing lock "refresh_cache-4a2d5475-04a4-414d-9ce9-d5204494f898" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:26:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "6594aaea-3698-4d56-babf-95f9654138f1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "6594aaea-3698-4d56-babf-95f9654138f1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:21 user nova-compute[74805]: DEBUG nova.objects.instance [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lazy-loading 'flavor' on Instance uuid 6594aaea-3698-4d56-babf-95f9654138f1 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG nova.network.neutron [req-760b5936-9d67-4878-8734-e2bc608d0b0e req-1a14ef0a-f391-442c-8cb3-21a3b0240481 service nova] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Updated VIF entry in instance network info cache for port dd7dff22-92a5-49fa-a626-381e41aff96e. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG nova.network.neutron [req-760b5936-9d67-4878-8734-e2bc608d0b0e req-1a14ef0a-f391-442c-8cb3-21a3b0240481 service nova] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Updating instance_info_cache with network_info: [{"id": "dd7dff22-92a5-49fa-a626-381e41aff96e", "address": "fa:16:3e:b3:03:ad", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7dff22-92", "ovs_interfaceid": "dd7dff22-92a5-49fa-a626-381e41aff96e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-760b5936-9d67-4878-8734-e2bc608d0b0e req-1a14ef0a-f391-442c-8cb3-21a3b0240481 service nova] Releasing lock "refresh_cache-6594aaea-3698-4d56-babf-95f9654138f1" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "6594aaea-3698-4d56-babf-95f9654138f1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.201s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2b8004f5ff1076d73c3be9241d490f9bd28468cf.part /opt/stack/data/nova/instances/_base/2b8004f5ff1076d73c3be9241d490f9bd28468cf.converted" returned: 0 in 0.701s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b8004f5ff1076d73c3be9241d490f9bd28468cf.converted --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "6594aaea-3698-4d56-babf-95f9654138f1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "6594aaea-3698-4d56-babf-95f9654138f1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:22 user nova-compute[74805]: INFO nova.compute.manager [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Attaching volume 12236321-ec91-436f-b281-3ccc300750e9 to /dev/vdb
Nov 15 04:26:22 user nova-compute[74805]: DEBUG os_brick.utils [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f653aa6a-5d03-4c17-b6d3-772981daf831]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae32f0f-8fb1-4e56-84bf-a098fe22a174]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b8004f5ff1076d73c3be9241d490f9bd28468cf.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "2b8004f5ff1076d73c3be9241d490f9bd28468cf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.251s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b8004f5ff1076d73c3be9241d490f9bd28468cf --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8938254a-074f-4087-95f1-40d85332b77d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff146661-4157-40df-8f3d-ff4c5193c395]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:26:22 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0513df-61f2-4d94-b9da-7ab4b341ef30]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG os_brick.utils [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Updating existing volume attachment record: 26c9f4e9-d3e6-405b-af31-73dfcc60c47b {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b8004f5ff1076d73c3be9241d490f9bd28468cf --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "2b8004f5ff1076d73c3be9241d490f9bd28468cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "2b8004f5ff1076d73c3be9241d490f9bd28468cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b8004f5ff1076d73c3be9241d490f9bd28468cf --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b8004f5ff1076d73c3be9241d490f9bd28468cf --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b8004f5ff1076d73c3be9241d490f9bd28468cf,backing_fmt=raw /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b8004f5ff1076d73c3be9241d490f9bd28468cf,backing_fmt=raw /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk 1073741824" returned: 0 in 0.047s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "2b8004f5ff1076d73c3be9241d490f9bd28468cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b8004f5ff1076d73c3be9241d490f9bd28468cf --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b8004f5ff1076d73c3be9241d490f9bd28468cf --force-share --output=json" returned: 0 in 0.172s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:23 user nova-compute[74805]: DEBUG nova.objects.instance [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lazy-loading 'migration_context' on Instance uuid 4a2d5475-04a4-414d-9ce9-d5204494f898 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:26:23 user nova-compute[74805]: DEBUG nova.objects.base [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Object Instance<4a2d5475-04a4-414d-9ce9-d5204494f898> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:26:23 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Rebasing disk image.
Nov 15 04:26:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.175s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 -F raw /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 -F raw /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk" returned: 0 in 2.353s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Ensure instance console log exists: /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Start _get_guest_xml network_info=[{"id": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "address": "fa:16:3e:61:a1:b6", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a9632d-70", "ovs_interfaceid": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='e55c211fb8e31d8cf933527acaa93e0e',container_format='bare',created_at=2023-11-15T04:24:21Z,direct_url=<?>,disk_format='qcow2',id=f15a0a7c-9de2-42b0-9fe6-e61b97e06657,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-918598282-shelved',owner='5e01874e82ed4ae08813343751506eeb',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T04:24:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJauStep', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '4a2d5475-04a4-414d-9ce9-d5204494f898', 'attached_at': '', 'detached_at': '', 'volume_id': 'dd635a1a-ac62-4627-8a17-e02f6328d312', 'serial': 'dd635a1a-ac62-4627-8a17-e02f6328d312'}, 'delete_on_termination': False, 'attachment_id': '6e6aafff-3845-4f12-8a68-1243be699f5b', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:26:25 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:26:25 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:26:25 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e55c211fb8e31d8cf933527acaa93e0e',container_format='bare',created_at=2023-11-15T04:24:21Z,direct_url=<?>,disk_format='qcow2',id=f15a0a7c-9de2-42b0-9fe6-e61b97e06657,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-918598282-shelved',owner='5e01874e82ed4ae08813343751506eeb',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T04:24:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG nova.objects.instance [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4a2d5475-04a4-414d-9ce9-d5204494f898 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG nova.objects.base [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Object Instance<4a2d5475-04a4-414d-9ce9-d5204494f898> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJauStep', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:26:25 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:26:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:26:25 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:26:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:26:25 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:26:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cc8d76-dfa6-48c7-82ba-76ced232f12a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:26:25 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee6af1f-0d03-43f9-aaca-fca7b84c276a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312] added
Nov 15 04:26:25 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af74f87-91e0-41a6-a7f0-8511307ec581]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cf1f56-7e1b-4274-b411-6f68b7911efb]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rJauStep {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rJauStep" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[17230d27-1fc9-4fd6-bfe7-a35d8093fdf6]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rJauStep'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[936c4564-60c2-463f-ac2b-59f673db15dd]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b901463-e5bb-41be-ad62-b54aa94261a3]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:26:25 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:26:25 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec8202c-452d-49fd-a38a-5c3dc7a2c2e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312, portal: 172.16.0.220,3260]
Nov 15 04:26:26 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312, portal: 172.16.0.220,3260] successful.
Nov 15 04:26:26 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:26 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[333ba087-7d83-4883-b114-5ab384d389af]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:26 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f569d1f-326b-4477-800e-c650a674990f]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:26:26 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:26:26 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:26:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:26:26 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:26:26 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:26:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:26:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:26:26 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:26:26 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:26:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:26 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a5592d-e592-426e-a98b-a866b375239c]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:26 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:26:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJauStep', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:26:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23331626262386133', 'path': '/dev/sdc'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331626262386133', 'path': '/dev/sdc'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T04:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-918598282',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-918598282',id=25,image_ref='f15a0a7c-9de2-42b0-9fe6-e61b97e06657',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1201355498',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:22:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5e01874e82ed4ae08813343751506eeb',ramdisk_id='',reservation_id='r-0vg8si2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2114494734',owner_user_name='tempest-AttachVolumeShelveTestJSON-2114494734-project-member',shelved_at='2023-11-15T04:24:26.371308',shelved_host='user',shelved_image_id='f15a0a7c-9de2-42b0-9fe6-e61b97e06657'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:26:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2876983d30794d8db191857d2f420f7d',uuid=4a2d5475-04a4-414d-9ce9-d5204494f898,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "address": "fa:16:3e:61:a1:b6", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a9632d-70", "ovs_interfaceid": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Converting VIF {"id": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "address": "fa:16:3e:61:a1:b6", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a9632d-70", "ovs_interfaceid": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:a1:b6,bridge_name='br-int',has_traffic_filtering=True,id=90a9632d-7041-430e-a0f4-0b8ec60eb332,network=Network(5febf498-f447-4e3b-a484-320124bd0158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a9632d-70') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG nova.objects.instance [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a2d5475-04a4-414d-9ce9-d5204494f898 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG nova.objects.base [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Object Instance<4a2d5475-04a4-414d-9ce9-d5204494f898> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:26:27 user nova-compute[74805]:   <uuid>4a2d5475-04a4-414d-9ce9-d5204494f898</uuid>
Nov 15 04:26:27 user nova-compute[74805]:   <name>instance-00000019</name>
Nov 15 04:26:27 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:26:27 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:26:27 user nova-compute[74805]:   <metadata>
Nov 15 04:26:27 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:26:27 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:26:27 user nova-compute[74805]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-918598282</nova:name>
Nov 15 04:26:27 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:26:25</nova:creationTime>
Nov 15 04:26:27 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:26:27 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:26:27 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:26:27 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:26:27 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:26:27 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:26:27 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:26:27 user nova-compute[74805]:       <nova:owner>
Nov 15 04:26:27 user nova-compute[74805]:         <nova:user uuid="2876983d30794d8db191857d2f420f7d">tempest-AttachVolumeShelveTestJSON-2114494734-project-member</nova:user>
Nov 15 04:26:27 user nova-compute[74805]:         <nova:project uuid="5e01874e82ed4ae08813343751506eeb">tempest-AttachVolumeShelveTestJSON-2114494734</nova:project>
Nov 15 04:26:27 user nova-compute[74805]:       </nova:owner>
Nov 15 04:26:27 user nova-compute[74805]:       <nova:root type="image" uuid="f15a0a7c-9de2-42b0-9fe6-e61b97e06657"/>
Nov 15 04:26:27 user nova-compute[74805]:       <nova:ports>
Nov 15 04:26:27 user nova-compute[74805]:         <nova:port uuid="90a9632d-7041-430e-a0f4-0b8ec60eb332">
Nov 15 04:26:27 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 04:26:27 user nova-compute[74805]:         </nova:port>
Nov 15 04:26:27 user nova-compute[74805]:       </nova:ports>
Nov 15 04:26:27 user nova-compute[74805]:     </nova:instance>
Nov 15 04:26:27 user nova-compute[74805]:   </metadata>
Nov 15 04:26:27 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:26:27 user nova-compute[74805]:     <system>
Nov 15 04:26:27 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:26:27 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:26:27 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:26:27 user nova-compute[74805]:       <entry name="serial">4a2d5475-04a4-414d-9ce9-d5204494f898</entry>
Nov 15 04:26:27 user nova-compute[74805]:       <entry name="uuid">4a2d5475-04a4-414d-9ce9-d5204494f898</entry>
Nov 15 04:26:27 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:26:27 user nova-compute[74805]:     </system>
Nov 15 04:26:27 user nova-compute[74805]:   </sysinfo>
Nov 15 04:26:27 user nova-compute[74805]:   <os>
Nov 15 04:26:27 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:26:27 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:26:27 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:26:27 user nova-compute[74805]:   </os>
Nov 15 04:26:27 user nova-compute[74805]:   <features>
Nov 15 04:26:27 user nova-compute[74805]:     <acpi/>
Nov 15 04:26:27 user nova-compute[74805]:     <apic/>
Nov 15 04:26:27 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:26:27 user nova-compute[74805]:   </features>
Nov 15 04:26:27 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:26:27 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:26:27 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:26:27 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:26:27 user nova-compute[74805]:   </clock>
Nov 15 04:26:27 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:26:27 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:26:27 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:26:27 user nova-compute[74805]:   </cpu>
Nov 15 04:26:27 user nova-compute[74805]:   <devices>
Nov 15 04:26:27 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:26:27 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:26:27 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk"/>
Nov 15 04:26:27 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:26:27 user nova-compute[74805]:     </disk>
Nov 15 04:26:27 user nova-compute[74805]:     <disk type="block" device="disk">
Nov 15 04:26:27 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:26:27 user nova-compute[74805]:       <source dev="/dev/sdc"/>
Nov 15 04:26:27 user nova-compute[74805]:       <target dev="vdc" bus="virtio"/>
Nov 15 04:26:27 user nova-compute[74805]:       <serial>dd635a1a-ac62-4627-8a17-e02f6328d312</serial>
Nov 15 04:26:27 user nova-compute[74805]:     </disk>
Nov 15 04:26:27 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:26:27 user nova-compute[74805]:       <mac address="fa:16:3e:61:a1:b6"/>
Nov 15 04:26:27 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:26:27 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:26:27 user nova-compute[74805]:       <target dev="tap90a9632d-70"/>
Nov 15 04:26:27 user nova-compute[74805]:     </interface>
Nov 15 04:26:27 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:26:27 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/console.log" append="off"/>
Nov 15 04:26:27 user nova-compute[74805]:     </serial>
Nov 15 04:26:27 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:26:27 user nova-compute[74805]:     <video>
Nov 15 04:26:27 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:26:27 user nova-compute[74805]:     </video>
Nov 15 04:26:27 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:26:27 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:26:27 user nova-compute[74805]:     </rng>
Nov 15 04:26:27 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:26:27 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:26:27 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:26:27 user nova-compute[74805]:     </memballoon>
Nov 15 04:26:27 user nova-compute[74805]:   </devices>
Nov 15 04:26:27 user nova-compute[74805]: </domain>
Nov 15 04:26:27 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T04:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-918598282',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-918598282',id=25,image_ref='f15a0a7c-9de2-42b0-9fe6-e61b97e06657',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1201355498',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:22:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5e01874e82ed4ae08813343751506eeb',ramdisk_id='',reservation_id='r-0vg8si2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2114494734',owner_user_name='tempest-AttachVolumeShelveTestJSON-2114494734-project-member',shelved_at='2023-11-15T04:24:26.371308',shelved_host='user',shelved_image_id='f15a0a7c-9de2-42b0-9fe6-e61b97e06657'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:26:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2876983d30794d8db191857d2f420f7d',uuid=4a2d5475-04a4-414d-9ce9-d5204494f898,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "address": "fa:16:3e:61:a1:b6", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a9632d-70", "ovs_interfaceid": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Converting VIF {"id": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "address": "fa:16:3e:61:a1:b6", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a9632d-70", "ovs_interfaceid": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:a1:b6,bridge_name='br-int',has_traffic_filtering=True,id=90a9632d-7041-430e-a0f4-0b8ec60eb332,network=Network(5febf498-f447-4e3b-a484-320124bd0158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a9632d-70') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG os_vif [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:a1:b6,bridge_name='br-int',has_traffic_filtering=True,id=90a9632d-7041-430e-a0f4-0b8ec60eb332,network=Network(5febf498-f447-4e3b-a484-320124bd0158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a9632d-70') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ddc45eb-2e82-59f8-aa7a-a188eebcd6d0', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90a9632d-70, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90a9632d-70, col_values=(('qos', UUID('f34dd5f7-4735-4c56-9547-9bf8308ab1ea')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90a9632d-70, col_values=(('external_ids', {'iface-id': '90a9632d-7041-430e-a0f4-0b8ec60eb332', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:a1:b6', 'vm-uuid': '4a2d5475-04a4-414d-9ce9-d5204494f898'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:27 user nova-compute[74805]: INFO os_vif [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:a1:b6,bridge_name='br-int',has_traffic_filtering=True,id=90a9632d-7041-430e-a0f4-0b8ec60eb332,network=Network(5febf498-f447-4e3b-a484-320124bd0158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a9632d-70')
Nov 15 04:26:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] No VIF found with MAC fa:16:3e:61:a1:b6, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjvFgqBK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:26:27 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:26:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:26:27 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:26:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:26:27 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cb4a15-a781-4040-9f72-ef1f15166d2f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:26:27 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b395fda8-4da2-4ff7-806d-4fde3493ce31]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9] added
Nov 15 04:26:27 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1304a8-53cc-4f75-b894-7a72ce5e1306]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d27284-45a9-47a3-a14f-6980ca180302]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TjvFgqBK {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TjvFgqBK" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2658e2f-b206-4a25-9562-d0e785f172b2]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TjvFgqBK'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[01287d9a-89e2-41cc-b13d-c5efe38ce090]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d95224-3ec5-4126-b735-f027f7d685d1]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:26:27 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:26:27 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:26:27 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:26:27 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4a149c-cff0-4048-9e15-5463c592fd6c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9, portal: 172.16.0.220,3260]
Nov 15 04:26:27 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9, portal: 172.16.0.220,3260] successful.
Nov 15 04:26:27 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd9269a-93a1-481f-b32c-6b2f3a203cb2]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4eb3f8-dc6f-4651-afd7-f037de2ab4ca]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:26:27 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:26:27 user nova-compute[74805]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 (non-flash)
Nov 15 04:26:27 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:26:27 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:26:27 user nova-compute[74805]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 (non-flash)
Nov 15 04:26:27 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[697ff32e-e999-4bc7-9a1f-994235be1683]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:27 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: None {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:26:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:28 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:26:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjvFgqBK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:26:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:26:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26532373736633463', 'path': '/dev/sdd'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:26:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532373736633463', 'path': '/dev/sdd'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:26:28 user nova-compute[74805]: DEBUG nova.objects.instance [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lazy-loading 'flavor' on Instance uuid 6594aaea-3698-4d56-babf-95f9654138f1 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:26:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:26:28 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:26:28 user nova-compute[74805]:   <source dev="/dev/sdd"/>
Nov 15 04:26:28 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:26:28 user nova-compute[74805]:   <serial>12236321-ec91-436f-b281-3ccc300750e9</serial>
Nov 15 04:26:28 user nova-compute[74805]: </disk>
Nov 15 04:26:28 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:26:28 user nova-compute[74805]: DEBUG nova.compute.manager [req-9d7f67c8-3fc6-4aff-a3b9-c82dd4d1810f req-00238a2a-56b5-4b47-9843-3d20dd67891b service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Received event network-vif-plugged-90a9632d-7041-430e-a0f4-0b8ec60eb332 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:26:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9d7f67c8-3fc6-4aff-a3b9-c82dd4d1810f req-00238a2a-56b5-4b47-9843-3d20dd67891b service nova] Acquiring lock "4a2d5475-04a4-414d-9ce9-d5204494f898-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9d7f67c8-3fc6-4aff-a3b9-c82dd4d1810f req-00238a2a-56b5-4b47-9843-3d20dd67891b service nova] Lock "4a2d5475-04a4-414d-9ce9-d5204494f898-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9d7f67c8-3fc6-4aff-a3b9-c82dd4d1810f req-00238a2a-56b5-4b47-9843-3d20dd67891b service nova] Lock "4a2d5475-04a4-414d-9ce9-d5204494f898-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:28 user nova-compute[74805]: DEBUG nova.compute.manager [req-9d7f67c8-3fc6-4aff-a3b9-c82dd4d1810f req-00238a2a-56b5-4b47-9843-3d20dd67891b service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] No waiting events found dispatching network-vif-plugged-90a9632d-7041-430e-a0f4-0b8ec60eb332 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:26:28 user nova-compute[74805]: WARNING nova.compute.manager [req-9d7f67c8-3fc6-4aff-a3b9-c82dd4d1810f req-00238a2a-56b5-4b47-9843-3d20dd67891b service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Received unexpected event network-vif-plugged-90a9632d-7041-430e-a0f4-0b8ec60eb332 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 04:26:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:26:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:26:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] No VIF found with MAC fa:16:3e:b3:03:ad, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:26:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3267d0ab-f607-4107-aff6-22a7eff12f79 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "6594aaea-3698-4d56-babf-95f9654138f1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.182s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:30 user nova-compute[74805]: DEBUG nova.compute.manager [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:26:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:30 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:26:30 user nova-compute[74805]: INFO nova.compute.claims [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Claim successful on node user
Nov 15 04:26:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "6594aaea-3698-4d56-babf-95f9654138f1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "6594aaea-3698-4d56-babf-95f9654138f1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:30 user nova-compute[74805]: INFO nova.compute.manager [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Detaching volume 12236321-ec91-436f-b281-3ccc300750e9
Nov 15 04:26:30 user nova-compute[74805]: INFO nova.virt.block_device [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Attempting to driver detach volume 12236321-ec91-436f-b281-3ccc300750e9 from mountpoint /dev/vdb
Nov 15 04:26:30 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Attempting to detach device vdb from instance 6594aaea-3698-4d56-babf-95f9654138f1 from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:26:30 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:26:30 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:26:30 user nova-compute[74805]:   <source dev="/dev/sdd"/>
Nov 15 04:26:30 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:26:30 user nova-compute[74805]:   <serial>12236321-ec91-436f-b281-3ccc300750e9</serial>
Nov 15 04:26:30 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:26:30 user nova-compute[74805]: </disk>
Nov 15 04:26:30 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:26:30 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Successfully detached device vdb from instance 6594aaea-3698-4d56-babf-95f9654138f1 from the persistent domain config.
Nov 15 04:26:30 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6594aaea-3698-4d56-babf-95f9654138f1 from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:26:30 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:26:30 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:26:30 user nova-compute[74805]:   <source dev="/dev/sdd"/>
Nov 15 04:26:30 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:26:30 user nova-compute[74805]:   <serial>12236321-ec91-436f-b281-3ccc300750e9</serial>
Nov 15 04:26:30 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:26:30 user nova-compute[74805]: </disk>
Nov 15 04:26:30 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:26:30 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:26:30 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:26:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:30 user nova-compute[74805]: DEBUG nova.compute.manager [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:26:30 user nova-compute[74805]: DEBUG nova.compute.manager [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:26:30 user nova-compute[74805]: DEBUG nova.network.neutron [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:26:30 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:26:30 user nova-compute[74805]: DEBUG nova.compute.manager [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:26:30 user nova-compute[74805]: INFO nova.virt.block_device [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Booting with volume 96a565fc-6821-43c6-a60d-1a6863c86b13 at /dev/vda
Nov 15 04:26:30 user nova-compute[74805]: DEBUG nova.compute.manager [req-c62d29f3-3357-4360-bc7e-07cf577f4039 req-e904d15f-df58-46cf-83cb-33b41674e7d0 service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Received event network-vif-plugged-90a9632d-7041-430e-a0f4-0b8ec60eb332 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:26:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c62d29f3-3357-4360-bc7e-07cf577f4039 req-e904d15f-df58-46cf-83cb-33b41674e7d0 service nova] Acquiring lock "4a2d5475-04a4-414d-9ce9-d5204494f898-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c62d29f3-3357-4360-bc7e-07cf577f4039 req-e904d15f-df58-46cf-83cb-33b41674e7d0 service nova] Lock "4a2d5475-04a4-414d-9ce9-d5204494f898-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c62d29f3-3357-4360-bc7e-07cf577f4039 req-e904d15f-df58-46cf-83cb-33b41674e7d0 service nova] Lock "4a2d5475-04a4-414d-9ce9-d5204494f898-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:30 user nova-compute[74805]: DEBUG nova.compute.manager [req-c62d29f3-3357-4360-bc7e-07cf577f4039 req-e904d15f-df58-46cf-83cb-33b41674e7d0 service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] No waiting events found dispatching network-vif-plugged-90a9632d-7041-430e-a0f4-0b8ec60eb332 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:26:30 user nova-compute[74805]: WARNING nova.compute.manager [req-c62d29f3-3357-4360-bc7e-07cf577f4039 req-e904d15f-df58-46cf-83cb-33b41674e7d0 service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Received unexpected event network-vif-plugged-90a9632d-7041-430e-a0f4-0b8ec60eb332 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 04:26:30 user nova-compute[74805]: DEBUG os_brick.utils [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:26:30 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:30 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6594aaea-3698-4d56-babf-95f9654138f1 {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:26:30 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:30 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d927dc-7b89-4c35-a061-cc0c3b78fbd0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:30 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[377574a6-fb45-4e9d-9f91-8e3cc87ea754]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f7484c-6553-4e87-a3fe-9ecbc6f2f0a0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf06e8d7-5b1c-4173-952e-902f006f0e49]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:26:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:26:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:26:31 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:26:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[422d916c-eb72-47a5-b303-52c1ad74f4e3]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:26:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:26:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:26:31 user nova-compute[74805]: DEBUG os_brick.utils [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:26:31 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Updating existing volume attachment record: 6c927608-740d-4f12-8ee1-ba2838ebcbe1 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:26:31 user nova-compute[74805]: DEBUG nova.compute.manager [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:26:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:26:31 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Instance spawned successfully.
Nov 15 04:26:31 user nova-compute[74805]: DEBUG nova.policy [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '061709b977974ab0bc342e0cbf4bb842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96d68212bfd495db1630d31eb10c5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:26:31 user nova-compute[74805]: DEBUG nova.compute.manager [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:26:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5171da56-e3a6-43f4-80d0-63decdb74ea7 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "4a2d5475-04a4-414d-9ce9-d5204494f898" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.758s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:32 user nova-compute[74805]: DEBUG nova.network.neutron [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Successfully created port: dc86c423-92d8-43e7-a330-b1ebe656885a {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:26:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:32 user nova-compute[74805]: DEBUG nova.objects.instance [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lazy-loading 'flavor' on Instance uuid 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:26:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:32 user nova-compute[74805]: INFO nova.compute.manager [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Attaching volume ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b to /dev/vdb
Nov 15 04:26:32 user nova-compute[74805]: DEBUG os_brick.utils [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:26:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:32 user nova-compute[74805]: DEBUG nova.network.neutron [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Successfully created port: 9e1f2018-b2ed-4d3c-8557-159094954698 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:26:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:32 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[939e728f-675a-40d6-8b1d-cedad369491f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:32 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f95bb47-8992-4dda-9a06-3b1f7b3b41ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:32 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f025384b-0891-4055-bafd-bbf757f29e21]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:32 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1825eb28-ddea-478e-a2ec-0a6c42553134]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:26:32 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:26:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:26:32 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:26:32 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d3c6eb-6f27-4a2d-8db7-3565c3612a2e]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:32 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:26:32 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:26:32 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:26:32 user nova-compute[74805]: DEBUG os_brick.utils [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:26:32 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Updating existing volume attachment record: fa588555-3fc1-4146-9e4f-6c1a01e2b41d {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:26:33 user nova-compute[74805]: DEBUG nova.compute.manager [req-1b158874-eef4-456b-b693-527874698c8b req-aaee36b6-da2c-44ef-8183-3b370abef0af service nova] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Received event network-changed-b5adbddb-acb3-40b1-9768-923daa9f3a29 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:26:33 user nova-compute[74805]: DEBUG nova.compute.manager [req-1b158874-eef4-456b-b693-527874698c8b req-aaee36b6-da2c-44ef-8183-3b370abef0af service nova] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Refreshing instance network info cache due to event network-changed-b5adbddb-acb3-40b1-9768-923daa9f3a29. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:26:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1b158874-eef4-456b-b693-527874698c8b req-aaee36b6-da2c-44ef-8183-3b370abef0af service nova] Acquiring lock "refresh_cache-8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:26:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1b158874-eef4-456b-b693-527874698c8b req-aaee36b6-da2c-44ef-8183-3b370abef0af service nova] Acquired lock "refresh_cache-8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:26:33 user nova-compute[74805]: DEBUG nova.network.neutron [req-1b158874-eef4-456b-b693-527874698c8b req-aaee36b6-da2c-44ef-8183-3b370abef0af service nova] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Refreshing network info cache for port b5adbddb-acb3-40b1-9768-923daa9f3a29 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:26:33 user nova-compute[74805]: DEBUG nova.network.neutron [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Successfully created port: f04eb3fe-3f8c-45d9-91f2-2f96f3757755 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:26:33 user nova-compute[74805]: DEBUG nova.network.neutron [req-1b158874-eef4-456b-b693-527874698c8b req-aaee36b6-da2c-44ef-8183-3b370abef0af service nova] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Updated VIF entry in instance network info cache for port b5adbddb-acb3-40b1-9768-923daa9f3a29. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:26:33 user nova-compute[74805]: DEBUG nova.network.neutron [req-1b158874-eef4-456b-b693-527874698c8b req-aaee36b6-da2c-44ef-8183-3b370abef0af service nova] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Updating instance_info_cache with network_info: [{"id": "b5adbddb-acb3-40b1-9768-923daa9f3a29", "address": "fa:16:3e:7f:dc:30", "network": {"id": "a06a4001-e7e0-4991-b68a-0a0395d22e19", "bridge": "br-int", "label": "tempest-TestStampPattern-341788822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464531969a244952b436e763f17ab970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5adbddb-ac", "ovs_interfaceid": "b5adbddb-acb3-40b1-9768-923daa9f3a29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:26:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1b158874-eef4-456b-b693-527874698c8b req-aaee36b6-da2c-44ef-8183-3b370abef0af service nova] Releasing lock "refresh_cache-8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:26:34 user nova-compute[74805]: DEBUG nova.network.neutron [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Successfully created port: b2b44c84-229d-451e-b81c-e45ca53d6ef5 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:26:34 user nova-compute[74805]: DEBUG nova.network.neutron [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Successfully created port: 3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:26:35 user nova-compute[74805]: DEBUG nova.network.neutron [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Successfully updated port: dc86c423-92d8-43e7-a330-b1ebe656885a {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:26:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:35 user nova-compute[74805]: DEBUG nova.compute.manager [req-05afbf80-60b4-4f51-97a0-fcce6e166393 req-23f3d00b-a68d-4cd2-b43a-26ec62108d17 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-changed-dc86c423-92d8-43e7-a330-b1ebe656885a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:26:35 user nova-compute[74805]: DEBUG nova.compute.manager [req-05afbf80-60b4-4f51-97a0-fcce6e166393 req-23f3d00b-a68d-4cd2-b43a-26ec62108d17 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Refreshing instance network info cache due to event network-changed-dc86c423-92d8-43e7-a330-b1ebe656885a. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:26:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-05afbf80-60b4-4f51-97a0-fcce6e166393 req-23f3d00b-a68d-4cd2-b43a-26ec62108d17 service nova] Acquiring lock "refresh_cache-07831159-aab3-4f4a-8cc9-25d74e254ae2" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:26:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-05afbf80-60b4-4f51-97a0-fcce6e166393 req-23f3d00b-a68d-4cd2-b43a-26ec62108d17 service nova] Acquired lock "refresh_cache-07831159-aab3-4f4a-8cc9-25d74e254ae2" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:26:35 user nova-compute[74805]: DEBUG nova.network.neutron [req-05afbf80-60b4-4f51-97a0-fcce6e166393 req-23f3d00b-a68d-4cd2-b43a-26ec62108d17 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Refreshing network info cache for port dc86c423-92d8-43e7-a330-b1ebe656885a {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:26:35 user nova-compute[74805]: DEBUG nova.network.neutron [req-05afbf80-60b4-4f51-97a0-fcce6e166393 req-23f3d00b-a68d-4cd2-b43a-26ec62108d17 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:26:35 user nova-compute[74805]: DEBUG nova.network.neutron [req-05afbf80-60b4-4f51-97a0-fcce6e166393 req-23f3d00b-a68d-4cd2-b43a-26ec62108d17 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:26:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-05afbf80-60b4-4f51-97a0-fcce6e166393 req-23f3d00b-a68d-4cd2-b43a-26ec62108d17 service nova] Releasing lock "refresh_cache-07831159-aab3-4f4a-8cc9-25d74e254ae2" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:26:35 user nova-compute[74805]: DEBUG nova.network.neutron [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Successfully updated port: e7e7afc5-68c4-4483-848e-7a08e6ad2495 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:26:36 user nova-compute[74805]: DEBUG nova.network.neutron [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Successfully updated port: 01ea0e4b-c98f-4380-9dd9-0b8a33f784f1 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:26:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:37 user nova-compute[74805]: DEBUG nova.compute.manager [req-e760b1f1-18b6-464c-be8e-c5bb6c413c38 req-a06f3571-0e3b-4989-9ba7-c83ccadeb02d service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-changed-e7e7afc5-68c4-4483-848e-7a08e6ad2495 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:26:37 user nova-compute[74805]: DEBUG nova.compute.manager [req-e760b1f1-18b6-464c-be8e-c5bb6c413c38 req-a06f3571-0e3b-4989-9ba7-c83ccadeb02d service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Refreshing instance network info cache due to event network-changed-e7e7afc5-68c4-4483-848e-7a08e6ad2495. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:26:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e760b1f1-18b6-464c-be8e-c5bb6c413c38 req-a06f3571-0e3b-4989-9ba7-c83ccadeb02d service nova] Acquiring lock "refresh_cache-07831159-aab3-4f4a-8cc9-25d74e254ae2" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:26:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e760b1f1-18b6-464c-be8e-c5bb6c413c38 req-a06f3571-0e3b-4989-9ba7-c83ccadeb02d service nova] Acquired lock "refresh_cache-07831159-aab3-4f4a-8cc9-25d74e254ae2" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:26:37 user nova-compute[74805]: DEBUG nova.network.neutron [req-e760b1f1-18b6-464c-be8e-c5bb6c413c38 req-a06f3571-0e3b-4989-9ba7-c83ccadeb02d service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Refreshing network info cache for port e7e7afc5-68c4-4483-848e-7a08e6ad2495 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:26:37 user nova-compute[74805]: DEBUG nova.network.neutron [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Successfully updated port: 9e1f2018-b2ed-4d3c-8557-159094954698 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:26:37 user nova-compute[74805]: DEBUG nova.network.neutron [req-e760b1f1-18b6-464c-be8e-c5bb6c413c38 req-a06f3571-0e3b-4989-9ba7-c83ccadeb02d service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:26:37 user nova-compute[74805]: DEBUG nova.network.neutron [req-e760b1f1-18b6-464c-be8e-c5bb6c413c38 req-a06f3571-0e3b-4989-9ba7-c83ccadeb02d service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:26:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e760b1f1-18b6-464c-be8e-c5bb6c413c38 req-a06f3571-0e3b-4989-9ba7-c83ccadeb02d service nova] Releasing lock "refresh_cache-07831159-aab3-4f4a-8cc9-25d74e254ae2" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:26:37 user nova-compute[74805]: DEBUG nova.compute.manager [req-e760b1f1-18b6-464c-be8e-c5bb6c413c38 req-a06f3571-0e3b-4989-9ba7-c83ccadeb02d service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-changed-01ea0e4b-c98f-4380-9dd9-0b8a33f784f1 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:26:37 user nova-compute[74805]: DEBUG nova.compute.manager [req-e760b1f1-18b6-464c-be8e-c5bb6c413c38 req-a06f3571-0e3b-4989-9ba7-c83ccadeb02d service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Refreshing instance network info cache due to event network-changed-01ea0e4b-c98f-4380-9dd9-0b8a33f784f1. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:26:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e760b1f1-18b6-464c-be8e-c5bb6c413c38 req-a06f3571-0e3b-4989-9ba7-c83ccadeb02d service nova] Acquiring lock "refresh_cache-07831159-aab3-4f4a-8cc9-25d74e254ae2" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:26:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e760b1f1-18b6-464c-be8e-c5bb6c413c38 req-a06f3571-0e3b-4989-9ba7-c83ccadeb02d service nova] Acquired lock "refresh_cache-07831159-aab3-4f4a-8cc9-25d74e254ae2" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:26:37 user nova-compute[74805]: DEBUG nova.network.neutron [req-e760b1f1-18b6-464c-be8e-c5bb6c413c38 req-a06f3571-0e3b-4989-9ba7-c83ccadeb02d service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Refreshing network info cache for port 01ea0e4b-c98f-4380-9dd9-0b8a33f784f1 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:26:37 user nova-compute[74805]: DEBUG nova.network.neutron [req-e760b1f1-18b6-464c-be8e-c5bb6c413c38 req-a06f3571-0e3b-4989-9ba7-c83ccadeb02d service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:26:37 user nova-compute[74805]: DEBUG nova.network.neutron [req-e760b1f1-18b6-464c-be8e-c5bb6c413c38 req-a06f3571-0e3b-4989-9ba7-c83ccadeb02d service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:26:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e760b1f1-18b6-464c-be8e-c5bb6c413c38 req-a06f3571-0e3b-4989-9ba7-c83ccadeb02d service nova] Releasing lock "refresh_cache-07831159-aab3-4f4a-8cc9-25d74e254ae2" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:26:38 user nova-compute[74805]: DEBUG nova.network.neutron [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Successfully updated port: f04eb3fe-3f8c-45d9-91f2-2f96f3757755 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:26:38 user nova-compute[74805]: DEBUG nova.network.neutron [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Successfully updated port: b2b44c84-229d-451e-b81c-e45ca53d6ef5 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:26:39 user nova-compute[74805]: DEBUG nova.network.neutron [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Successfully updated port: 3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:26:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Acquiring lock "refresh_cache-07831159-aab3-4f4a-8cc9-25d74e254ae2" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:26:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Acquired lock "refresh_cache-07831159-aab3-4f4a-8cc9-25d74e254ae2" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:26:39 user nova-compute[74805]: DEBUG nova.network.neutron [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:26:39 user nova-compute[74805]: DEBUG nova.network.neutron [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:26:39 user nova-compute[74805]: DEBUG nova.compute.manager [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-changed-9e1f2018-b2ed-4d3c-8557-159094954698 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:26:39 user nova-compute[74805]: DEBUG nova.compute.manager [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Refreshing instance network info cache due to event network-changed-9e1f2018-b2ed-4d3c-8557-159094954698. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:26:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] Acquiring lock "refresh_cache-07831159-aab3-4f4a-8cc9-25d74e254ae2" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CmlyARUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:26:40 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:26:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:26:40 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:26:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:26:40 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5918a6-a890-4ccc-8b29-afa513edefbf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:26:40 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0518a247-69b6-4000-8926-cddd0c87ff44]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b] added
Nov 15 04:26:40 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:40 user nova-compute[74805]: INFO nova.virt.block_device [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Booting with volume 21bdb111-72fd-476f-9401-4904721d3745 at /dev/vdb
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac3b3db-1f5a-45d9-9419-24d8376365d8]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cedcf8-a5c0-4367-8f29-24e44b86a2c3]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CmlyARUp {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG os_brick.utils [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CmlyARUp" returned: 0 in 0.028s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d032ca87-dbdb-468c-bd1f-de61120bed60]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CmlyARUp'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d8bba5-fbfa-465a-954a-06f17ff4aa50]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9f631c-fcac-4c93-81e9-439252bb272d]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6394dbd2-6458-4915-9663-b617d872dacb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbc34d5-2e97-4e98-88fe-087522747445]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:26:40 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:26:40 user nova-compute[74805]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 (non-flash)
Nov 15 04:26:40 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:26:40 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:26:40 user nova-compute[74805]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 (non-flash)
Nov 15 04:26:40 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32b9a05-e360-44b8-9d43-f4da162229ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4a1bad-1222-459a-b7b8-ac2a0d9ab4ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[16324c58-dd3c-4a5d-be70-65547663f434]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b, portal: 172.16.0.220,3260]
Nov 15 04:26:40 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b, portal: 172.16.0.220,3260] successful.
Nov 15 04:26:40 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:26:40 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8924510-025f-434b-91e9-dff8c0535dd2]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG os_brick.utils [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Updating existing volume attachment record: 2c517e31-572c-4d8e-b067-6a0f0303f627 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[469c1e34-fba3-4112-af31-c00b77c27e1a]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5f019d-d7b6-4887-a117-1e060834b62f]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:26:41 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:26:41 user nova-compute[74805]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 (non-flash)
Nov 15 04:26:41 user nova-compute[74805]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)
Nov 15 04:26:41 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:26:41 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:26:41 user nova-compute[74805]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 (non-flash)
Nov 15 04:26:41 user nova-compute[74805]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)
Nov 15 04:26:41 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c47b9e1-956e-4562-a650-4f91fd16948f]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CmlyARUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG nova.network.neutron [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Updating instance_info_cache with network_info: [{"id": "dc86c423-92d8-43e7-a330-b1ebe656885a", "address": "fa:16:3e:97:a8:ea", "network": {"id": "139930e8-4754-4236-a668-4afcacf2fed1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-127286933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc86c423-92", "ovs_interfaceid": "dc86c423-92d8-43e7-a330-b1ebe656885a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "address": "fa:16:3e:50:4d:3b", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e7afc5-68", "ovs_interfaceid": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "address": "fa:16:3e:21:14:f4", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01ea0e4b-c9", "ovs_interfaceid": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e1f2018-b2ed-4d3c-8557-159094954698", "address": "fa:16:3e:23:69:29", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1f2018-b2", "ovs_interfaceid": "9e1f2018-b2ed-4d3c-8557-159094954698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "address": "fa:16:3e:d0:e7:b1", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04eb3fe-3f", "ovs_interfaceid": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2b44c84-229d-451e-b81c-e45ca53d6ef5", "address": "fa:16:3e:b4:2b:28", "network": {"id": "378a82b9-cfdf-45a5-82cb-25308188ce8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1809740597", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b44c84-22", "ovs_interfaceid": "b2b44c84-229d-451e-b81c-e45ca53d6ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "address": "fa:16:3e:90:ce:b7", "network": {"id": "378a82b9-cfdf-45a5-82cb-25308188ce8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1809740597", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dcaad31-1b", "ovs_interfaceid": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Releasing lock "refresh_cache-07831159-aab3-4f4a-8cc9-25d74e254ae2" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG nova.compute.manager [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Instance network_info: |[{"id": "dc86c423-92d8-43e7-a330-b1ebe656885a", "address": "fa:16:3e:97:a8:ea", "network": {"id": "139930e8-4754-4236-a668-4afcacf2fed1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-127286933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc86c423-92", "ovs_interfaceid": "dc86c423-92d8-43e7-a330-b1ebe656885a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "address": "fa:16:3e:50:4d:3b", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e7afc5-68", "ovs_interfaceid": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "address": "fa:16:3e:21:14:f4", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01ea0e4b-c9", "ovs_interfaceid": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e1f2018-b2ed-4d3c-8557-159094954698", "address": "fa:16:3e:23:69:29", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1f2018-b2", "ovs_interfaceid": "9e1f2018-b2ed-4d3c-8557-159094954698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "address": "fa:16:3e:d0:e7:b1", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04eb3fe-3f", "ovs_interfaceid": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2b44c84-229d-451e-b81c-e45ca53d6ef5", "address": "fa:16:3e:b4:2b:28", "network": {"id": "378a82b9-cfdf-45a5-82cb-25308188ce8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1809740597", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b44c84-22", "ovs_interfaceid": "b2b44c84-229d-451e-b81c-e45ca53d6ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "address": "fa:16:3e:90:ce:b7", "network": {"id": "378a82b9-cfdf-45a5-82cb-25308188ce8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1809740597", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dcaad31-1b", "ovs_interfaceid": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] Acquired lock "refresh_cache-07831159-aab3-4f4a-8cc9-25d74e254ae2" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG nova.network.neutron [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Refreshing network info cache for port 9e1f2018-b2ed-4d3c-8557-159094954698 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG nova.network.neutron [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Updated VIF entry in instance network info cache for port 9e1f2018-b2ed-4d3c-8557-159094954698. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG nova.network.neutron [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Updating instance_info_cache with network_info: [{"id": "dc86c423-92d8-43e7-a330-b1ebe656885a", "address": "fa:16:3e:97:a8:ea", "network": {"id": "139930e8-4754-4236-a668-4afcacf2fed1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-127286933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc86c423-92", "ovs_interfaceid": "dc86c423-92d8-43e7-a330-b1ebe656885a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "address": "fa:16:3e:50:4d:3b", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e7afc5-68", "ovs_interfaceid": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "address": "fa:16:3e:21:14:f4", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01ea0e4b-c9", "ovs_interfaceid": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e1f2018-b2ed-4d3c-8557-159094954698", "address": "fa:16:3e:23:69:29", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1f2018-b2", "ovs_interfaceid": "9e1f2018-b2ed-4d3c-8557-159094954698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "address": "fa:16:3e:d0:e7:b1", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04eb3fe-3f", "ovs_interfaceid": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2b44c84-229d-451e-b81c-e45ca53d6ef5", "address": "fa:16:3e:b4:2b:28", "network": {"id": "378a82b9-cfdf-45a5-82cb-25308188ce8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1809740597", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b44c84-22", "ovs_interfaceid": "b2b44c84-229d-451e-b81c-e45ca53d6ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "address": "fa:16:3e:90:ce:b7", "network": {"id": "378a82b9-cfdf-45a5-82cb-25308188ce8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1809740597", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dcaad31-1b", "ovs_interfaceid": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] Releasing lock "refresh_cache-07831159-aab3-4f4a-8cc9-25d74e254ae2" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG nova.compute.manager [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-changed-f04eb3fe-3f8c-45d9-91f2-2f96f3757755 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG nova.compute.manager [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Refreshing instance network info cache due to event network-changed-f04eb3fe-3f8c-45d9-91f2-2f96f3757755. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] Acquiring lock "refresh_cache-07831159-aab3-4f4a-8cc9-25d74e254ae2" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] Acquired lock "refresh_cache-07831159-aab3-4f4a-8cc9-25d74e254ae2" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG nova.network.neutron [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Refreshing network info cache for port f04eb3fe-3f8c-45d9-91f2-2f96f3757755 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG nova.network.neutron [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Updated VIF entry in instance network info cache for port f04eb3fe-3f8c-45d9-91f2-2f96f3757755. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG nova.network.neutron [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Updating instance_info_cache with network_info: [{"id": "dc86c423-92d8-43e7-a330-b1ebe656885a", "address": "fa:16:3e:97:a8:ea", "network": {"id": "139930e8-4754-4236-a668-4afcacf2fed1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-127286933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc86c423-92", "ovs_interfaceid": "dc86c423-92d8-43e7-a330-b1ebe656885a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "address": "fa:16:3e:50:4d:3b", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e7afc5-68", "ovs_interfaceid": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "address": "fa:16:3e:21:14:f4", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01ea0e4b-c9", "ovs_interfaceid": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e1f2018-b2ed-4d3c-8557-159094954698", "address": "fa:16:3e:23:69:29", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1f2018-b2", "ovs_interfaceid": "9e1f2018-b2ed-4d3c-8557-159094954698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "address": "fa:16:3e:d0:e7:b1", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04eb3fe-3f", "ovs_interfaceid": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2b44c84-229d-451e-b81c-e45ca53d6ef5", "address": "fa:16:3e:b4:2b:28", "network": {"id": "378a82b9-cfdf-45a5-82cb-25308188ce8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1809740597", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b44c84-22", "ovs_interfaceid": "b2b44c84-229d-451e-b81c-e45ca53d6ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "address": "fa:16:3e:90:ce:b7", "network": {"id": "378a82b9-cfdf-45a5-82cb-25308188ce8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1809740597", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dcaad31-1b", "ovs_interfaceid": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] Releasing lock "refresh_cache-07831159-aab3-4f4a-8cc9-25d74e254ae2" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG nova.compute.manager [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-changed-b2b44c84-229d-451e-b81c-e45ca53d6ef5 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:26:41 user nova-compute[74805]: DEBUG nova.compute.manager [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Refreshing instance network info cache due to event network-changed-b2b44c84-229d-451e-b81c-e45ca53d6ef5. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:26:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] Acquiring lock "refresh_cache-07831159-aab3-4f4a-8cc9-25d74e254ae2" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:26:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] Acquired lock "refresh_cache-07831159-aab3-4f4a-8cc9-25d74e254ae2" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:26:42 user nova-compute[74805]: DEBUG nova.network.neutron [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Refreshing network info cache for port b2b44c84-229d-451e-b81c-e45ca53d6ef5 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:26:42 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:26:42 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23333366333323765', 'path': '/dev/sde'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:26:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333366333323765', 'path': '/dev/sde'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:26:42 user nova-compute[74805]: DEBUG nova.objects.instance [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lazy-loading 'flavor' on Instance uuid 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:26:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:26:42 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:26:42 user nova-compute[74805]:   <source dev="/dev/sde"/>
Nov 15 04:26:42 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:26:42 user nova-compute[74805]:   <serial>ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b</serial>
Nov 15 04:26:42 user nova-compute[74805]: </disk>
Nov 15 04:26:42 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:26:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:42 user nova-compute[74805]: DEBUG nova.network.neutron [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Updated VIF entry in instance network info cache for port b2b44c84-229d-451e-b81c-e45ca53d6ef5. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:26:42 user nova-compute[74805]: DEBUG nova.network.neutron [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Updating instance_info_cache with network_info: [{"id": "dc86c423-92d8-43e7-a330-b1ebe656885a", "address": "fa:16:3e:97:a8:ea", "network": {"id": "139930e8-4754-4236-a668-4afcacf2fed1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-127286933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc86c423-92", "ovs_interfaceid": "dc86c423-92d8-43e7-a330-b1ebe656885a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "address": "fa:16:3e:50:4d:3b", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e7afc5-68", "ovs_interfaceid": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "address": "fa:16:3e:21:14:f4", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01ea0e4b-c9", "ovs_interfaceid": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e1f2018-b2ed-4d3c-8557-159094954698", "address": "fa:16:3e:23:69:29", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1f2018-b2", "ovs_interfaceid": "9e1f2018-b2ed-4d3c-8557-159094954698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "address": "fa:16:3e:d0:e7:b1", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04eb3fe-3f", "ovs_interfaceid": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2b44c84-229d-451e-b81c-e45ca53d6ef5", "address": "fa:16:3e:b4:2b:28", "network": {"id": "378a82b9-cfdf-45a5-82cb-25308188ce8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1809740597", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b44c84-22", "ovs_interfaceid": "b2b44c84-229d-451e-b81c-e45ca53d6ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "address": "fa:16:3e:90:ce:b7", "network": {"id": "378a82b9-cfdf-45a5-82cb-25308188ce8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1809740597", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dcaad31-1b", "ovs_interfaceid": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:26:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] Releasing lock "refresh_cache-07831159-aab3-4f4a-8cc9-25d74e254ae2" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:26:42 user nova-compute[74805]: DEBUG nova.compute.manager [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-changed-3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:26:42 user nova-compute[74805]: DEBUG nova.compute.manager [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Refreshing instance network info cache due to event network-changed-3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:26:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] Acquiring lock "refresh_cache-07831159-aab3-4f4a-8cc9-25d74e254ae2" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:26:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] Acquired lock "refresh_cache-07831159-aab3-4f4a-8cc9-25d74e254ae2" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:26:42 user nova-compute[74805]: DEBUG nova.network.neutron [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Refreshing network info cache for port 3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:26:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:26:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:26:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] No VIF found with MAC fa:16:3e:7f:dc:30, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:26:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-68c2498c-fa8b-4837-8502-54c806cbae23 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.020s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:42 user nova-compute[74805]: DEBUG nova.network.neutron [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Updated VIF entry in instance network info cache for port 3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:26:42 user nova-compute[74805]: DEBUG nova.network.neutron [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Updating instance_info_cache with network_info: [{"id": "dc86c423-92d8-43e7-a330-b1ebe656885a", "address": "fa:16:3e:97:a8:ea", "network": {"id": "139930e8-4754-4236-a668-4afcacf2fed1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-127286933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc86c423-92", "ovs_interfaceid": "dc86c423-92d8-43e7-a330-b1ebe656885a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "address": "fa:16:3e:50:4d:3b", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e7afc5-68", "ovs_interfaceid": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "address": "fa:16:3e:21:14:f4", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01ea0e4b-c9", "ovs_interfaceid": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e1f2018-b2ed-4d3c-8557-159094954698", "address": "fa:16:3e:23:69:29", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1f2018-b2", "ovs_interfaceid": "9e1f2018-b2ed-4d3c-8557-159094954698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "address": "fa:16:3e:d0:e7:b1", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04eb3fe-3f", "ovs_interfaceid": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2b44c84-229d-451e-b81c-e45ca53d6ef5", "address": "fa:16:3e:b4:2b:28", "network": {"id": "378a82b9-cfdf-45a5-82cb-25308188ce8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1809740597", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b44c84-22", "ovs_interfaceid": "b2b44c84-229d-451e-b81c-e45ca53d6ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "address": "fa:16:3e:90:ce:b7", "network": {"id": "378a82b9-cfdf-45a5-82cb-25308188ce8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1809740597", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dcaad31-1b", "ovs_interfaceid": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:26:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-520f3494-16b6-4a71-938a-46d17b78f11e req-f99e4eaf-5d61-40b2-a9d6-4bdd054da0f7 service nova] Releasing lock "refresh_cache-07831159-aab3-4f4a-8cc9-25d74e254ae2" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:26:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:45 user nova-compute[74805]: INFO nova.compute.manager [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Detaching volume ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b
Nov 15 04:26:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:45 user nova-compute[74805]: INFO nova.virt.block_device [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Attempting to driver detach volume ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b from mountpoint /dev/vdb
Nov 15 04:26:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Attempting to detach device vdb from instance 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:26:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:26:45 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:26:45 user nova-compute[74805]:   <source dev="/dev/sde"/>
Nov 15 04:26:45 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:26:45 user nova-compute[74805]:   <serial>ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b</serial>
Nov 15 04:26:45 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:26:45 user nova-compute[74805]: </disk>
Nov 15 04:26:45 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:26:45 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Successfully detached device vdb from instance 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c from the persistent domain config.
Nov 15 04:26:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:26:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:26:45 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:26:45 user nova-compute[74805]:   <source dev="/dev/sde"/>
Nov 15 04:26:45 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:26:45 user nova-compute[74805]:   <serial>ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b</serial>
Nov 15 04:26:45 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:26:45 user nova-compute[74805]: </disk>
Nov 15 04:26:45 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:26:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:26:45 user nova-compute[74805]: INFO nova.virt.block_device [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Booting with volume 2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf at /dev/vdc
Nov 15 04:26:46 user nova-compute[74805]: DEBUG os_brick.utils [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:26:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d452e611-dba7-4295-ba43-e914f702e139]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8961427-c3f6-4016-9b9c-80e2bbd01387]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45a0716-0a21-4195-b802-37cd329ba627]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc35e46-7c37-464a-936c-67bba5e52630]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:26:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:26:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:26:46 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:26:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f6e0a0-4acf-4a1f-a9ba-195ebb1f8433]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:26:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:26:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:26:46 user nova-compute[74805]: DEBUG os_brick.utils [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:26:46 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Updating existing volume attachment record: 93b8a7f3-0494-4438-bfc1-53038f504b98 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:26:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG nova.compute.manager [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:26:50 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Creating image(s)
Nov 15 04:26:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Did not create local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Ensure instance console log exists: /opt/stack/data/nova/instances/07831159-aab3-4f4a-8cc9-25d74e254ae2/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Start _get_guest_xml network_info=[{"id": "dc86c423-92d8-43e7-a330-b1ebe656885a", "address": "fa:16:3e:97:a8:ea", "network": {"id": "139930e8-4754-4236-a668-4afcacf2fed1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-127286933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc86c423-92", "ovs_interfaceid": "dc86c423-92d8-43e7-a330-b1ebe656885a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "address": "fa:16:3e:50:4d:3b", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e7afc5-68", "ovs_interfaceid": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "address": "fa:16:3e:21:14:f4", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01ea0e4b-c9", "ovs_interfaceid": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e1f2018-b2ed-4d3c-8557-159094954698", "address": "fa:16:3e:23:69:29", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1f2018-b2", "ovs_interfaceid": "9e1f2018-b2ed-4d3c-8557-159094954698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "address": "fa:16:3e:d0:e7:b1", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04eb3fe-3f", "ovs_interfaceid": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2b44c84-229d-451e-b81c-e45ca53d6ef5", "address": "fa:16:3e:b4:2b:28", "network": {"id": "378a82b9-cfdf-45a5-82cb-25308188ce8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1809740597", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b44c84-22", "ovs_interfaceid": "b2b44c84-229d-451e-b81c-e45ca53d6ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "address": "fa:16:3e:90:ce:b7", "network": {"id": "378a82b9-cfdf-45a5-82cb-25308188ce8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1809740597", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dcaad31-1b", "ovs_interfaceid": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsQulWoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '07831159-aab3-4f4a-8cc9-25d74e254ae2', 'attached_at': '', 'detached_at': '', 'volume_id': '96a565fc-6821-43c6-a60d-1a6863c86b13', 'serial': '96a565fc-6821-43c6-a60d-1a6863c86b13'}, 'delete_on_termination': False, 'attachment_id': '6c927608-740d-4f12-8ee1-ba2838ebcbe1', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKHgnywb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '07831159-aab3-4f4a-8cc9-25d74e254ae2', 'attached_at': '', 'detached_at': '', 'volume_id': '21bdb111-72fd-476f-9401-4904721d3745', 'serial': '21bdb111-72fd-476f-9401-4904721d3745'}, 'delete_on_termination': False, 'attachment_id': '2c517e31-572c-4d8e-b067-6a0f0303f627', 'guest_format': None, 'device_type': 'disk', 'boot_index': 1, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gdiAECQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '07831159-aab3-4f4a-8cc9-25d74e254ae2', 'attached_at': '', 'detached_at': '', 'volume_id': '2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf', 'serial': '2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf'}, 'delete_on_termination': False, 'attachment_id': '93b8a7f3-0494-4438-bfc1-53038f504b98', 'guest_format': None, 'device_type': 'disk', 'boot_index': 2, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:26:50 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:26:50 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:26:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsQulWoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:26:50 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:26:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:26:50 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:26:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:26:50 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:26:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b5e354-33be-445e-8826-a79c7fd0c678]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:26:50 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f738095-78c7-4aea-9e32-05735b5b3ce7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13] added
Nov 15 04:26:50 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:50 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6594aaea-3698-4d56-babf-95f9654138f1 is timed out.
Nov 15 04:26:50 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Successfully detached device vdb from instance 6594aaea-3698-4d56-babf-95f9654138f1 from the live domain config.
Nov 15 04:26:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjvFgqBK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:26:50 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:26:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a90931-1b30-4918-843f-a94b9cba1ebd]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cc3411-ebdd-45d9-9185-39d35d3f762f]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fsQulWoP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fsQulWoP" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[782ba70f-f5ac-4de3-8fe1-3cb4ad89c60c]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fsQulWoP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb30ae7-2c26-4500-807d-1c59f503d1b1]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc12f2a4-ccde-4633-805c-08ff3bfd5cb7]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:26:51 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:26:51 user nova-compute[74805]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 (non-flash)
Nov 15 04:26:51 user nova-compute[74805]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)
Nov 15 04:26:51 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:26:51 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:26:51 user nova-compute[74805]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 (non-flash)
Nov 15 04:26:51 user nova-compute[74805]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)
Nov 15 04:26:51 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3875b2-2775-43dc-877e-7eec1b1b029d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13, portal: 172.16.0.220,3260]
Nov 15 04:26:51 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13, portal: 172.16.0.220,3260] successful.
Nov 15 04:26:51 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd028b3-c7de-4a2e-b023-69b893b3206c]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b343552-badb-4816-9729-34eebd945114]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:26:51 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:26:51 user nova-compute[74805]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 (non-flash)
Nov 15 04:26:51 user nova-compute[74805]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)
Nov 15 04:26:51 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:26:51 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:26:51 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:26:51 user nova-compute[74805]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 (non-flash)
Nov 15 04:26:51 user nova-compute[74805]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)
Nov 15 04:26:51 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:26:51 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca6131e-440b-4175-b5f0-61f9fabe29e0]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:51 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: None {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsQulWoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26665623132313736', 'path': '/dev/sdf'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665623132313736', 'path': '/dev/sdf'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.266s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[19abd1f7-569c-4636-a4f4-28f3e2f7f94f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:26:52 user nova-compute[74805]: No targets found.
Nov 15 04:26:52 user nova-compute[74805]: iSNS:
Nov 15 04:26:52 user nova-compute[74805]: No targets found.
Nov 15 04:26:52 user nova-compute[74805]: STATIC:
Nov 15 04:26:52 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9
Nov 15 04:26:52 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:26:52 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:26:52 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83
Nov 15 04:26:52 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:26:52 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:26:52 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b
Nov 15 04:26:52 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:26:52 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:26:52 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13
Nov 15 04:26:52 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:26:52 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:26:52 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312
Nov 15 04:26:52 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:26:52 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:26:52 user nova-compute[74805]: FIRMWARE:
Nov 15 04:26:52 user nova-compute[74805]: No targets found.
Nov 15 04:26:52 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:26:52 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:26:52 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKHgnywb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:26:52 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2278c607-4a30-438d-a558-09a1a9ff9cb3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3709b0fa-8589-4248-8e3d-d8876ccda666]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:26:52 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:26:52 user nova-compute[74805]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 (non-flash)
Nov 15 04:26:52 user nova-compute[74805]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)
Nov 15 04:26:52 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:26:52 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:26:52 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:26:52 user nova-compute[74805]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 (non-flash)
Nov 15 04:26:52 user nova-compute[74805]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)
Nov 15 04:26:52 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:26:52 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c130670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9'): ({'sdd'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Removing single pathed devices sdd {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[240c017f-f715-4ecd-ad2b-ee6eb2c5b827]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e31678d-b7f5-4762-9ca3-b2ef9b99929a]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Flushing IO for device /dev/sdd {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[85797f39-e506-480b-b9c1-0cd32626e88d]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe901a25-a8a3-4ae0-92e7-feecab3b8d7d]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] SCSI volumes sdd have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3376bd-8fcf-4079-9394-bae80da0e0aa]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd1ef82-ff6c-41f3-a755-87190d7da408]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9, portal: 172.16.0.220,3260]
Nov 15 04:26:52 user nova-compute[74805]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9, portal: 172.16.0.220,3260] successful.
Nov 15 04:26:52 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12236321-ec91-436f-b281-3ccc300750e9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a83424-6f54-4f34-bbe6-676c6b8bc707]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] <== disconnect_volume: return (1575ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.284s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:26:52 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:26:52 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3a34a0-4072-4e08-9848-6fbf64690f45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:26:52 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[985b797e-1aae-4167-8c34-8f5eee99c833]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745] added
Nov 15 04:26:52 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e71a86-eafd-417b-a84c-93cbf7f020be]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea756c1f-5167-47e4-813a-333caf4a2d25]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cKHgnywb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cKHgnywb" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ffe5e4-7b7c-4141-bd4b-12b81038286b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cKHgnywb'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c43904-447a-4021-bbe0-b4b35e568444]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b62191a-4e7a-40da-9f63-d1420eee69a3]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:26:52 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:26:52 user nova-compute[74805]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)
Nov 15 04:26:52 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:26:52 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:26:52 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:26:52 user nova-compute[74805]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)
Nov 15 04:26:52 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:26:52 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2372c45d-2425-4335-a564-5c6e212c7af5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745, portal: 172.16.0.220,3260]
Nov 15 04:26:52 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745, portal: 172.16.0.220,3260] successful.
Nov 15 04:26:52 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bca5a0-13d3-44ea-bec5-534a271cf4fd]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a772ac7-b0db-4578-88e2-c33290226d40]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:26:52 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:26:52 user nova-compute[74805]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)
Nov 15 04:26:52 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:26:52 user nova-compute[74805]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)
Nov 15 04:26:52 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:26:52 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:26:52 user nova-compute[74805]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)
Nov 15 04:26:52 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:26:52 user nova-compute[74805]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)
Nov 15 04:26:52 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f268a525-a115-44a4-8052-378be6a14484]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:52 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: None {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:26:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "38196606-a9c9-4604-ad21-2ec7511a8b28" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:53 user nova-compute[74805]: DEBUG nova.compute.manager [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:26:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:53 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:26:53 user nova-compute[74805]: INFO nova.compute.claims [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Claim successful on node user
Nov 15 04:26:53 user nova-compute[74805]: DEBUG nova.objects.instance [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lazy-loading 'flavor' on Instance uuid 6594aaea-3698-4d56-babf-95f9654138f1 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:26:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f3546fee-b58b-4db9-93cd-a7953c64888b tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "6594aaea-3698-4d56-babf-95f9654138f1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.061s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:53 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:26:53 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:26:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:53 user nova-compute[74805]: DEBUG nova.compute.manager [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:26:53 user nova-compute[74805]: DEBUG nova.compute.manager [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:26:53 user nova-compute[74805]: DEBUG nova.network.neutron [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:26:53 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:26:53 user nova-compute[74805]: DEBUG nova.compute.manager [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:26:53 user nova-compute[74805]: DEBUG nova.policy [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8cba9273daa1478fa6cc8274443b4f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11645073d58476491d101b9f3ee4052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:26:53 user nova-compute[74805]: INFO nova.virt.block_device [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Booting with blank volume at /dev/vda
Nov 15 04:26:53 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:26:53 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKHgnywb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:26:53 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:26:53 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] <== connect_volume: return (1644ms) {'type': 'block', 'scsi_wwn': '26131313763643439', 'path': '/dev/sdd'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:26:53 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131313763643439', 'path': '/dev/sdd'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:26:53 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:26:53 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gdiAECQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:26:53 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:26:53 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:26:53 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:26:53 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:26:53 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:26:53 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:26:53 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:26:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[615f3eec-1993-4380-9935-0b5259502946]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:26:54 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93e3f44-258b-4023-82a8-29e0c0478d16]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf] added
Nov 15 04:26:54 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e1b51b-52de-4ccc-b1c7-a1a13f0676b1]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f8e4b4-50bc-4b55-a38e-10357c18780a]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gdiAECQb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gdiAECQb" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8300c6-9cea-40d5-9f38-458492706ff9]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gdiAECQb'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0019b7d7-1644-496e-9bf0-3191bd3b9de7]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f6ece9-2505-4873-b1a4-eaa7f4a46372]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:26:54 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:26:54 user nova-compute[74805]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)
Nov 15 04:26:54 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:26:54 user nova-compute[74805]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)
Nov 15 04:26:54 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:26:54 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:26:54 user nova-compute[74805]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)
Nov 15 04:26:54 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:26:54 user nova-compute[74805]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)
Nov 15 04:26:54 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[244d7407-5656-4ed8-8c2f-565e165f65bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf, portal: 172.16.0.220,3260]
Nov 15 04:26:54 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf, portal: 172.16.0.220,3260] successful.
Nov 15 04:26:54 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba460b75-1835-46b5-ac50-5ae8f78abc6d]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cda8ad-e2e6-4177-a27a-43ae88802a84]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:26:54 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:26:54 user nova-compute[74805]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)
Nov 15 04:26:54 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:26:54 user nova-compute[74805]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)
Nov 15 04:26:54 user nova-compute[74805]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)
Nov 15 04:26:54 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:26:54 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:26:54 user nova-compute[74805]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)
Nov 15 04:26:54 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:26:54 user nova-compute[74805]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)
Nov 15 04:26:54 user nova-compute[74805]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)
Nov 15 04:26:54 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] HCTL ('38', '-', '-', 0) found on session 37 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG nova.network.neutron [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Successfully created port: 23517101-97ec-4772-ab6b-6f626a6547bc {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d38e5f-3806-4276-8897-7afc0fdece6d]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gdiAECQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG nova.network.neutron [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Successfully updated port: 23517101-97ec-4772-ab6b-6f626a6547bc {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "refresh_cache-38196606-a9c9-4604-ad21-2ec7511a8b28" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquired lock "refresh_cache-38196606-a9c9-4604-ad21-2ec7511a8b28" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG nova.network.neutron [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG nova.compute.manager [req-5539b94e-7fc6-4bb8-ac17-9b141b6671cd req-a872ba03-defb-4537-b8f8-2f5b8a5af92f service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Received event network-changed-23517101-97ec-4772-ab6b-6f626a6547bc {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG nova.compute.manager [req-5539b94e-7fc6-4bb8-ac17-9b141b6671cd req-a872ba03-defb-4537-b8f8-2f5b8a5af92f service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Refreshing instance network info cache due to event network-changed-23517101-97ec-4772-ab6b-6f626a6547bc. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5539b94e-7fc6-4bb8-ac17-9b141b6671cd req-a872ba03-defb-4537-b8f8-2f5b8a5af92f service nova] Acquiring lock "refresh_cache-38196606-a9c9-4604-ad21-2ec7511a8b28" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:26:54 user nova-compute[74805]: DEBUG nova.network.neutron [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.neutron [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Updating instance_info_cache with network_info: [{"id": "23517101-97ec-4772-ab6b-6f626a6547bc", "address": "fa:16:3e:da:ef:08", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23517101-97", "ovs_interfaceid": "23517101-97ec-4772-ab6b-6f626a6547bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Releasing lock "refresh_cache-38196606-a9c9-4604-ad21-2ec7511a8b28" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.compute.manager [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Instance network_info: |[{"id": "23517101-97ec-4772-ab6b-6f626a6547bc", "address": "fa:16:3e:da:ef:08", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23517101-97", "ovs_interfaceid": "23517101-97ec-4772-ab6b-6f626a6547bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5539b94e-7fc6-4bb8-ac17-9b141b6671cd req-a872ba03-defb-4537-b8f8-2f5b8a5af92f service nova] Acquired lock "refresh_cache-38196606-a9c9-4604-ad21-2ec7511a8b28" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.neutron [req-5539b94e-7fc6-4bb8-ac17-9b141b6671cd req-a872ba03-defb-4537-b8f8-2f5b8a5af92f service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Refreshing network info cache for port 23517101-97ec-4772-ab6b-6f626a6547bc {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26434643761663430', 'path': '/dev/sdg'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434643761663430', 'path': '/dev/sdg'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1873844826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1873844826',id=32,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqZkCUSoOrMa7ifMuGw6KskYm0ddSPTuC5l2fF8XxmzROteC0oBjHEzid9TYILC5ffFia4MmQDokK+XpN/+t424KLYwLutvEODoNkq9qNzPxtfd4Hfr+nfzxcQDZyj/ZQ==',key_name='tempest-keypair-1974570634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d96d68212bfd495db1630d31eb10c5ff',ramdisk_id='',reservation_id='r-i2dle74p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-307297502',owner_user_name='tempest-TaggedBootDevicesTest_v242-307297502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:26:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='061709b977974ab0bc342e0cbf4bb842',uuid=07831159-aab3-4f4a-8cc9-25d74e254ae2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc86c423-92d8-43e7-a330-b1ebe656885a", "address": "fa:16:3e:97:a8:ea", "network": {"id": "139930e8-4754-4236-a668-4afcacf2fed1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-127286933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc86c423-92", "ovs_interfaceid": "dc86c423-92d8-43e7-a330-b1ebe656885a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converting VIF {"id": "dc86c423-92d8-43e7-a330-b1ebe656885a", "address": "fa:16:3e:97:a8:ea", "network": {"id": "139930e8-4754-4236-a668-4afcacf2fed1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-127286933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc86c423-92", "ovs_interfaceid": "dc86c423-92d8-43e7-a330-b1ebe656885a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:a8:ea,bridge_name='br-int',has_traffic_filtering=True,id=dc86c423-92d8-43e7-a330-b1ebe656885a,network=Network(139930e8-4754-4236-a668-4afcacf2fed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc86c423-92') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1873844826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1873844826',id=32,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqZkCUSoOrMa7ifMuGw6KskYm0ddSPTuC5l2fF8XxmzROteC0oBjHEzid9TYILC5ffFia4MmQDokK+XpN/+t424KLYwLutvEODoNkq9qNzPxtfd4Hfr+nfzxcQDZyj/ZQ==',key_name='tempest-keypair-1974570634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d96d68212bfd495db1630d31eb10c5ff',ramdisk_id='',reservation_id='r-i2dle74p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-307297502',owner_user_name='tempest-TaggedBootDevicesTest_v242-307297502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:26:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='061709b977974ab0bc342e0cbf4bb842',uuid=07831159-aab3-4f4a-8cc9-25d74e254ae2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "address": "fa:16:3e:50:4d:3b", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e7afc5-68", "ovs_interfaceid": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converting VIF {"id": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "address": "fa:16:3e:50:4d:3b", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e7afc5-68", "ovs_interfaceid": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:4d:3b,bridge_name='br-int',has_traffic_filtering=True,id=e7e7afc5-68c4-4483-848e-7a08e6ad2495,network=Network(98a0ba70-e465-40f4-8e47-aaed0b8beac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape7e7afc5-68') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1873844826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1873844826',id=32,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqZkCUSoOrMa7ifMuGw6KskYm0ddSPTuC5l2fF8XxmzROteC0oBjHEzid9TYILC5ffFia4MmQDokK+XpN/+t424KLYwLutvEODoNkq9qNzPxtfd4Hfr+nfzxcQDZyj/ZQ==',key_name='tempest-keypair-1974570634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d96d68212bfd495db1630d31eb10c5ff',ramdisk_id='',reservation_id='r-i2dle74p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-307297502',owner_user_name='tempest-TaggedBootDevicesTest_v242-307297502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:26:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='061709b977974ab0bc342e0cbf4bb842',uuid=07831159-aab3-4f4a-8cc9-25d74e254ae2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "address": "fa:16:3e:21:14:f4", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01ea0e4b-c9", "ovs_interfaceid": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converting VIF {"id": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "address": "fa:16:3e:21:14:f4", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01ea0e4b-c9", "ovs_interfaceid": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:14:f4,bridge_name='br-int',has_traffic_filtering=True,id=01ea0e4b-c98f-4380-9dd9-0b8a33f784f1,network=Network(98a0ba70-e465-40f4-8e47-aaed0b8beac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap01ea0e4b-c9') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1873844826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1873844826',id=32,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqZkCUSoOrMa7ifMuGw6KskYm0ddSPTuC5l2fF8XxmzROteC0oBjHEzid9TYILC5ffFia4MmQDokK+XpN/+t424KLYwLutvEODoNkq9qNzPxtfd4Hfr+nfzxcQDZyj/ZQ==',key_name='tempest-keypair-1974570634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d96d68212bfd495db1630d31eb10c5ff',ramdisk_id='',reservation_id='r-i2dle74p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-307297502',owner_user_name='tempest-TaggedBootDevicesTest_v242-307297502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:26:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='061709b977974ab0bc342e0cbf4bb842',uuid=07831159-aab3-4f4a-8cc9-25d74e254ae2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e1f2018-b2ed-4d3c-8557-159094954698", "address": "fa:16:3e:23:69:29", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1f2018-b2", "ovs_interfaceid": "9e1f2018-b2ed-4d3c-8557-159094954698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converting VIF {"id": "9e1f2018-b2ed-4d3c-8557-159094954698", "address": "fa:16:3e:23:69:29", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1f2018-b2", "ovs_interfaceid": "9e1f2018-b2ed-4d3c-8557-159094954698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:69:29,bridge_name='br-int',has_traffic_filtering=True,id=9e1f2018-b2ed-4d3c-8557-159094954698,network=Network(98a0ba70-e465-40f4-8e47-aaed0b8beac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e1f2018-b2') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1873844826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1873844826',id=32,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqZkCUSoOrMa7ifMuGw6KskYm0ddSPTuC5l2fF8XxmzROteC0oBjHEzid9TYILC5ffFia4MmQDokK+XpN/+t424KLYwLutvEODoNkq9qNzPxtfd4Hfr+nfzxcQDZyj/ZQ==',key_name='tempest-keypair-1974570634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d96d68212bfd495db1630d31eb10c5ff',ramdisk_id='',reservation_id='r-i2dle74p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-307297502',owner_user_name='tempest-TaggedBootDevicesTest_v242-307297502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:26:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='061709b977974ab0bc342e0cbf4bb842',uuid=07831159-aab3-4f4a-8cc9-25d74e254ae2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "address": "fa:16:3e:d0:e7:b1", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04eb3fe-3f", "ovs_interfaceid": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converting VIF {"id": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "address": "fa:16:3e:d0:e7:b1", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04eb3fe-3f", "ovs_interfaceid": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:e7:b1,bridge_name='br-int',has_traffic_filtering=True,id=f04eb3fe-3f8c-45d9-91f2-2f96f3757755,network=Network(98a0ba70-e465-40f4-8e47-aaed0b8beac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04eb3fe-3f') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1873844826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1873844826',id=32,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqZkCUSoOrMa7ifMuGw6KskYm0ddSPTuC5l2fF8XxmzROteC0oBjHEzid9TYILC5ffFia4MmQDokK+XpN/+t424KLYwLutvEODoNkq9qNzPxtfd4Hfr+nfzxcQDZyj/ZQ==',key_name='tempest-keypair-1974570634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d96d68212bfd495db1630d31eb10c5ff',ramdisk_id='',reservation_id='r-i2dle74p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-307297502',owner_user_name='tempest-TaggedBootDevicesTest_v242-307297502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:26:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='061709b977974ab0bc342e0cbf4bb842',uuid=07831159-aab3-4f4a-8cc9-25d74e254ae2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2b44c84-229d-451e-b81c-e45ca53d6ef5", "address": "fa:16:3e:b4:2b:28", "network": {"id": "378a82b9-cfdf-45a5-82cb-25308188ce8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1809740597", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b44c84-22", "ovs_interfaceid": "b2b44c84-229d-451e-b81c-e45ca53d6ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converting VIF {"id": "b2b44c84-229d-451e-b81c-e45ca53d6ef5", "address": "fa:16:3e:b4:2b:28", "network": {"id": "378a82b9-cfdf-45a5-82cb-25308188ce8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1809740597", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b44c84-22", "ovs_interfaceid": "b2b44c84-229d-451e-b81c-e45ca53d6ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:2b:28,bridge_name='br-int',has_traffic_filtering=True,id=b2b44c84-229d-451e-b81c-e45ca53d6ef5,network=Network(378a82b9-cfdf-45a5-82cb-25308188ce8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2b44c84-22') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1873844826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1873844826',id=32,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqZkCUSoOrMa7ifMuGw6KskYm0ddSPTuC5l2fF8XxmzROteC0oBjHEzid9TYILC5ffFia4MmQDokK+XpN/+t424KLYwLutvEODoNkq9qNzPxtfd4Hfr+nfzxcQDZyj/ZQ==',key_name='tempest-keypair-1974570634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d96d68212bfd495db1630d31eb10c5ff',ramdisk_id='',reservation_id='r-i2dle74p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-307297502',owner_user_name='tempest-TaggedBootDevicesTest_v242-307297502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:26:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='061709b977974ab0bc342e0cbf4bb842',uuid=07831159-aab3-4f4a-8cc9-25d74e254ae2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "address": "fa:16:3e:90:ce:b7", "network": {"id": "378a82b9-cfdf-45a5-82cb-25308188ce8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1809740597", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dcaad31-1b", "ovs_interfaceid": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converting VIF {"id": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "address": "fa:16:3e:90:ce:b7", "network": {"id": "378a82b9-cfdf-45a5-82cb-25308188ce8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1809740597", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dcaad31-1b", "ovs_interfaceid": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:ce:b7,bridge_name='br-int',has_traffic_filtering=True,id=3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d,network=Network(378a82b9-cfdf-45a5-82cb-25308188ce8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dcaad31-1b') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.objects.instance [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lazy-loading 'pci_devices' on Instance uuid 07831159-aab3-4f4a-8cc9-25d74e254ae2 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:26:55 user nova-compute[74805]:   <uuid>07831159-aab3-4f4a-8cc9-25d74e254ae2</uuid>
Nov 15 04:26:55 user nova-compute[74805]:   <name>instance-00000020</name>
Nov 15 04:26:55 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:26:55 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:26:55 user nova-compute[74805]:   <metadata>
Nov 15 04:26:55 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:26:55 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:26:55 user nova-compute[74805]:       <nova:name>tempest-device-tagging-server-1873844826</nova:name>
Nov 15 04:26:55 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:26:50</nova:creationTime>
Nov 15 04:26:55 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:26:55 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:26:55 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:26:55 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:26:55 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:26:55 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:26:55 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:26:55 user nova-compute[74805]:       <nova:owner>
Nov 15 04:26:55 user nova-compute[74805]:         <nova:user uuid="061709b977974ab0bc342e0cbf4bb842">tempest-TaggedBootDevicesTest_v242-307297502-project-member</nova:user>
Nov 15 04:26:55 user nova-compute[74805]:         <nova:project uuid="d96d68212bfd495db1630d31eb10c5ff">tempest-TaggedBootDevicesTest_v242-307297502</nova:project>
Nov 15 04:26:55 user nova-compute[74805]:       </nova:owner>
Nov 15 04:26:55 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:26:55 user nova-compute[74805]:       <nova:ports>
Nov 15 04:26:55 user nova-compute[74805]:         <nova:port uuid="dc86c423-92d8-43e7-a330-b1ebe656885a">
Nov 15 04:26:55 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 04:26:55 user nova-compute[74805]:         </nova:port>
Nov 15 04:26:55 user nova-compute[74805]:         <nova:port uuid="e7e7afc5-68c4-4483-848e-7a08e6ad2495">
Nov 15 04:26:55 user nova-compute[74805]:           <nova:ip type="fixed" address="10.1.1.30" ipVersion="4"/>
Nov 15 04:26:55 user nova-compute[74805]:         </nova:port>
Nov 15 04:26:55 user nova-compute[74805]:         <nova:port uuid="01ea0e4b-c98f-4380-9dd9-0b8a33f784f1">
Nov 15 04:26:55 user nova-compute[74805]:           <nova:ip type="fixed" address="10.1.1.32" ipVersion="4"/>
Nov 15 04:26:55 user nova-compute[74805]:         </nova:port>
Nov 15 04:26:55 user nova-compute[74805]:         <nova:port uuid="9e1f2018-b2ed-4d3c-8557-159094954698">
Nov 15 04:26:55 user nova-compute[74805]:           <nova:ip type="fixed" address="10.1.1.156" ipVersion="4"/>
Nov 15 04:26:55 user nova-compute[74805]:         </nova:port>
Nov 15 04:26:55 user nova-compute[74805]:         <nova:port uuid="f04eb3fe-3f8c-45d9-91f2-2f96f3757755">
Nov 15 04:26:55 user nova-compute[74805]:           <nova:ip type="fixed" address="10.1.1.253" ipVersion="4"/>
Nov 15 04:26:55 user nova-compute[74805]:         </nova:port>
Nov 15 04:26:55 user nova-compute[74805]:         <nova:port uuid="b2b44c84-229d-451e-b81c-e45ca53d6ef5">
Nov 15 04:26:55 user nova-compute[74805]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 15 04:26:55 user nova-compute[74805]:         </nova:port>
Nov 15 04:26:55 user nova-compute[74805]:         <nova:port uuid="3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d">
Nov 15 04:26:55 user nova-compute[74805]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 15 04:26:55 user nova-compute[74805]:         </nova:port>
Nov 15 04:26:55 user nova-compute[74805]:       </nova:ports>
Nov 15 04:26:55 user nova-compute[74805]:     </nova:instance>
Nov 15 04:26:55 user nova-compute[74805]:   </metadata>
Nov 15 04:26:55 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:26:55 user nova-compute[74805]:     <system>
Nov 15 04:26:55 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:26:55 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:26:55 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:26:55 user nova-compute[74805]:       <entry name="serial">07831159-aab3-4f4a-8cc9-25d74e254ae2</entry>
Nov 15 04:26:55 user nova-compute[74805]:       <entry name="uuid">07831159-aab3-4f4a-8cc9-25d74e254ae2</entry>
Nov 15 04:26:55 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:26:55 user nova-compute[74805]:     </system>
Nov 15 04:26:55 user nova-compute[74805]:   </sysinfo>
Nov 15 04:26:55 user nova-compute[74805]:   <os>
Nov 15 04:26:55 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:26:55 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:26:55 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:26:55 user nova-compute[74805]:   </os>
Nov 15 04:26:55 user nova-compute[74805]:   <features>
Nov 15 04:26:55 user nova-compute[74805]:     <acpi/>
Nov 15 04:26:55 user nova-compute[74805]:     <apic/>
Nov 15 04:26:55 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:26:55 user nova-compute[74805]:   </features>
Nov 15 04:26:55 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:26:55 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:26:55 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:26:55 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:26:55 user nova-compute[74805]:   </clock>
Nov 15 04:26:55 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:26:55 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:26:55 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:26:55 user nova-compute[74805]:   </cpu>
Nov 15 04:26:55 user nova-compute[74805]:   <devices>
Nov 15 04:26:55 user nova-compute[74805]:     <disk type="file" device="cdrom">
Nov 15 04:26:55 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 04:26:55 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/07831159-aab3-4f4a-8cc9-25d74e254ae2/disk.config"/>
Nov 15 04:26:55 user nova-compute[74805]:       <target dev="hda" bus="ide"/>
Nov 15 04:26:55 user nova-compute[74805]:     </disk>
Nov 15 04:26:55 user nova-compute[74805]:     <disk type="block" device="disk">
Nov 15 04:26:55 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:26:55 user nova-compute[74805]:       <source dev="/dev/sdf"/>
Nov 15 04:26:55 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:26:55 user nova-compute[74805]:       <serial>96a565fc-6821-43c6-a60d-1a6863c86b13</serial>
Nov 15 04:26:55 user nova-compute[74805]:     </disk>
Nov 15 04:26:55 user nova-compute[74805]:     <disk type="block" device="disk">
Nov 15 04:26:55 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:26:55 user nova-compute[74805]:       <source dev="/dev/sdd"/>
Nov 15 04:26:55 user nova-compute[74805]:       <target dev="vdb" bus="virtio"/>
Nov 15 04:26:55 user nova-compute[74805]:       <serial>21bdb111-72fd-476f-9401-4904721d3745</serial>
Nov 15 04:26:55 user nova-compute[74805]:     </disk>
Nov 15 04:26:55 user nova-compute[74805]:     <disk type="block" device="disk">
Nov 15 04:26:55 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:26:55 user nova-compute[74805]:       <source dev="/dev/sdg"/>
Nov 15 04:26:55 user nova-compute[74805]:       <target dev="vdc" bus="virtio"/>
Nov 15 04:26:55 user nova-compute[74805]:       <serial>2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf</serial>
Nov 15 04:26:55 user nova-compute[74805]:     </disk>
Nov 15 04:26:55 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:26:55 user nova-compute[74805]:       <mac address="fa:16:3e:97:a8:ea"/>
Nov 15 04:26:55 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:26:55 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:26:55 user nova-compute[74805]:       <target dev="tapdc86c423-92"/>
Nov 15 04:26:55 user nova-compute[74805]:     </interface>
Nov 15 04:26:55 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:26:55 user nova-compute[74805]:       <mac address="fa:16:3e:50:4d:3b"/>
Nov 15 04:26:55 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:26:55 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:26:55 user nova-compute[74805]:       <target dev="tape7e7afc5-68"/>
Nov 15 04:26:55 user nova-compute[74805]:     </interface>
Nov 15 04:26:55 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:26:55 user nova-compute[74805]:       <mac address="fa:16:3e:21:14:f4"/>
Nov 15 04:26:55 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:26:55 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:26:55 user nova-compute[74805]:       <target dev="tap01ea0e4b-c9"/>
Nov 15 04:26:55 user nova-compute[74805]:     </interface>
Nov 15 04:26:55 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:26:55 user nova-compute[74805]:       <mac address="fa:16:3e:23:69:29"/>
Nov 15 04:26:55 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:26:55 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:26:55 user nova-compute[74805]:       <target dev="tap9e1f2018-b2"/>
Nov 15 04:26:55 user nova-compute[74805]:     </interface>
Nov 15 04:26:55 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:26:55 user nova-compute[74805]:       <mac address="fa:16:3e:d0:e7:b1"/>
Nov 15 04:26:55 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:26:55 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:26:55 user nova-compute[74805]:       <target dev="tapf04eb3fe-3f"/>
Nov 15 04:26:55 user nova-compute[74805]:     </interface>
Nov 15 04:26:55 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:26:55 user nova-compute[74805]:       <mac address="fa:16:3e:b4:2b:28"/>
Nov 15 04:26:55 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:26:55 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:26:55 user nova-compute[74805]:       <target dev="tapb2b44c84-22"/>
Nov 15 04:26:55 user nova-compute[74805]:     </interface>
Nov 15 04:26:55 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:26:55 user nova-compute[74805]:       <mac address="fa:16:3e:90:ce:b7"/>
Nov 15 04:26:55 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:26:55 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:26:55 user nova-compute[74805]:       <target dev="tap3dcaad31-1b"/>
Nov 15 04:26:55 user nova-compute[74805]:     </interface>
Nov 15 04:26:55 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:26:55 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/07831159-aab3-4f4a-8cc9-25d74e254ae2/console.log" append="off"/>
Nov 15 04:26:55 user nova-compute[74805]:     </serial>
Nov 15 04:26:55 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:26:55 user nova-compute[74805]:     <video>
Nov 15 04:26:55 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:26:55 user nova-compute[74805]:     </video>
Nov 15 04:26:55 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:26:55 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:26:55 user nova-compute[74805]:     </rng>
Nov 15 04:26:55 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:26:55 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:26:55 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:26:55 user nova-compute[74805]:     </memballoon>
Nov 15 04:26:55 user nova-compute[74805]:   </devices>
Nov 15 04:26:55 user nova-compute[74805]: </domain>
Nov 15 04:26:55 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1873844826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1873844826',id=32,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqZkCUSoOrMa7ifMuGw6KskYm0ddSPTuC5l2fF8XxmzROteC0oBjHEzid9TYILC5ffFia4MmQDokK+XpN/+t424KLYwLutvEODoNkq9qNzPxtfd4Hfr+nfzxcQDZyj/ZQ==',key_name='tempest-keypair-1974570634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d96d68212bfd495db1630d31eb10c5ff',ramdisk_id='',reservation_id='r-i2dle74p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-307297502',owner_user_name='tempest-TaggedBootDevicesTest_v242-307297502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:26:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='061709b977974ab0bc342e0cbf4bb842',uuid=07831159-aab3-4f4a-8cc9-25d74e254ae2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc86c423-92d8-43e7-a330-b1ebe656885a", "address": "fa:16:3e:97:a8:ea", "network": {"id": "139930e8-4754-4236-a668-4afcacf2fed1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-127286933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc86c423-92", "ovs_interfaceid": "dc86c423-92d8-43e7-a330-b1ebe656885a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converting VIF {"id": "dc86c423-92d8-43e7-a330-b1ebe656885a", "address": "fa:16:3e:97:a8:ea", "network": {"id": "139930e8-4754-4236-a668-4afcacf2fed1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-127286933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc86c423-92", "ovs_interfaceid": "dc86c423-92d8-43e7-a330-b1ebe656885a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:a8:ea,bridge_name='br-int',has_traffic_filtering=True,id=dc86c423-92d8-43e7-a330-b1ebe656885a,network=Network(139930e8-4754-4236-a668-4afcacf2fed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc86c423-92') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG os_vif [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:a8:ea,bridge_name='br-int',has_traffic_filtering=True,id=dc86c423-92d8-43e7-a330-b1ebe656885a,network=Network(139930e8-4754-4236-a668-4afcacf2fed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc86c423-92') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eb8094b6-7a80-5f8b-9899-84fc42102240', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc86c423-92, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc86c423-92, col_values=(('qos', UUID('69ef834a-5e00-4d2e-a746-12f6bd3887d7')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc86c423-92, col_values=(('external_ids', {'iface-id': 'dc86c423-92d8-43e7-a330-b1ebe656885a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:a8:ea', 'vm-uuid': '07831159-aab3-4f4a-8cc9-25d74e254ae2'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: INFO os_vif [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:a8:ea,bridge_name='br-int',has_traffic_filtering=True,id=dc86c423-92d8-43e7-a330-b1ebe656885a,network=Network(139930e8-4754-4236-a668-4afcacf2fed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc86c423-92')
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1873844826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1873844826',id=32,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqZkCUSoOrMa7ifMuGw6KskYm0ddSPTuC5l2fF8XxmzROteC0oBjHEzid9TYILC5ffFia4MmQDokK+XpN/+t424KLYwLutvEODoNkq9qNzPxtfd4Hfr+nfzxcQDZyj/ZQ==',key_name='tempest-keypair-1974570634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d96d68212bfd495db1630d31eb10c5ff',ramdisk_id='',reservation_id='r-i2dle74p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-307297502',owner_user_name='tempest-TaggedBootDevicesTest_v242-307297502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:26:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='061709b977974ab0bc342e0cbf4bb842',uuid=07831159-aab3-4f4a-8cc9-25d74e254ae2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "address": "fa:16:3e:50:4d:3b", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e7afc5-68", "ovs_interfaceid": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converting VIF {"id": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "address": "fa:16:3e:50:4d:3b", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e7afc5-68", "ovs_interfaceid": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:4d:3b,bridge_name='br-int',has_traffic_filtering=True,id=e7e7afc5-68c4-4483-848e-7a08e6ad2495,network=Network(98a0ba70-e465-40f4-8e47-aaed0b8beac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape7e7afc5-68') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG os_vif [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:4d:3b,bridge_name='br-int',has_traffic_filtering=True,id=e7e7afc5-68c4-4483-848e-7a08e6ad2495,network=Network(98a0ba70-e465-40f4-8e47-aaed0b8beac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape7e7afc5-68') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fda19114-367d-540f-9279-233e0e3834cb', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7e7afc5-68, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape7e7afc5-68, col_values=(('qos', UUID('9b283a5f-d14b-4dd5-8197-1edf8f96628c')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape7e7afc5-68, col_values=(('external_ids', {'iface-id': 'e7e7afc5-68c4-4483-848e-7a08e6ad2495', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:4d:3b', 'vm-uuid': '07831159-aab3-4f4a-8cc9-25d74e254ae2'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: INFO os_vif [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:4d:3b,bridge_name='br-int',has_traffic_filtering=True,id=e7e7afc5-68c4-4483-848e-7a08e6ad2495,network=Network(98a0ba70-e465-40f4-8e47-aaed0b8beac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape7e7afc5-68')
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1873844826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1873844826',id=32,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqZkCUSoOrMa7ifMuGw6KskYm0ddSPTuC5l2fF8XxmzROteC0oBjHEzid9TYILC5ffFia4MmQDokK+XpN/+t424KLYwLutvEODoNkq9qNzPxtfd4Hfr+nfzxcQDZyj/ZQ==',key_name='tempest-keypair-1974570634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d96d68212bfd495db1630d31eb10c5ff',ramdisk_id='',reservation_id='r-i2dle74p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-307297502',owner_user_name='tempest-TaggedBootDevicesTest_v242-307297502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:26:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='061709b977974ab0bc342e0cbf4bb842',uuid=07831159-aab3-4f4a-8cc9-25d74e254ae2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "address": "fa:16:3e:21:14:f4", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01ea0e4b-c9", "ovs_interfaceid": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converting VIF {"id": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "address": "fa:16:3e:21:14:f4", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01ea0e4b-c9", "ovs_interfaceid": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:14:f4,bridge_name='br-int',has_traffic_filtering=True,id=01ea0e4b-c98f-4380-9dd9-0b8a33f784f1,network=Network(98a0ba70-e465-40f4-8e47-aaed0b8beac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap01ea0e4b-c9') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG os_vif [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:14:f4,bridge_name='br-int',has_traffic_filtering=True,id=01ea0e4b-c98f-4380-9dd9-0b8a33f784f1,network=Network(98a0ba70-e465-40f4-8e47-aaed0b8beac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap01ea0e4b-c9') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd59d959b-4ccd-5cd8-852e-67069939edf0', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01ea0e4b-c9, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01ea0e4b-c9, col_values=(('qos', UUID('53d48187-2186-4ce7-8d25-4014557f928c')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01ea0e4b-c9, col_values=(('external_ids', {'iface-id': '01ea0e4b-c98f-4380-9dd9-0b8a33f784f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:14:f4', 'vm-uuid': '07831159-aab3-4f4a-8cc9-25d74e254ae2'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.neutron [req-5539b94e-7fc6-4bb8-ac17-9b141b6671cd req-a872ba03-defb-4537-b8f8-2f5b8a5af92f service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Updated VIF entry in instance network info cache for port 23517101-97ec-4772-ab6b-6f626a6547bc. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.neutron [req-5539b94e-7fc6-4bb8-ac17-9b141b6671cd req-a872ba03-defb-4537-b8f8-2f5b8a5af92f service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Updating instance_info_cache with network_info: [{"id": "23517101-97ec-4772-ab6b-6f626a6547bc", "address": "fa:16:3e:da:ef:08", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23517101-97", "ovs_interfaceid": "23517101-97ec-4772-ab6b-6f626a6547bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: INFO os_vif [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:14:f4,bridge_name='br-int',has_traffic_filtering=True,id=01ea0e4b-c98f-4380-9dd9-0b8a33f784f1,network=Network(98a0ba70-e465-40f4-8e47-aaed0b8beac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap01ea0e4b-c9')
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1873844826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1873844826',id=32,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqZkCUSoOrMa7ifMuGw6KskYm0ddSPTuC5l2fF8XxmzROteC0oBjHEzid9TYILC5ffFia4MmQDokK+XpN/+t424KLYwLutvEODoNkq9qNzPxtfd4Hfr+nfzxcQDZyj/ZQ==',key_name='tempest-keypair-1974570634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d96d68212bfd495db1630d31eb10c5ff',ramdisk_id='',reservation_id='r-i2dle74p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-307297502',owner_user_name='tempest-TaggedBootDevicesTest_v242-307297502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:26:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='061709b977974ab0bc342e0cbf4bb842',uuid=07831159-aab3-4f4a-8cc9-25d74e254ae2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e1f2018-b2ed-4d3c-8557-159094954698", "address": "fa:16:3e:23:69:29", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1f2018-b2", "ovs_interfaceid": "9e1f2018-b2ed-4d3c-8557-159094954698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converting VIF {"id": "9e1f2018-b2ed-4d3c-8557-159094954698", "address": "fa:16:3e:23:69:29", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1f2018-b2", "ovs_interfaceid": "9e1f2018-b2ed-4d3c-8557-159094954698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:69:29,bridge_name='br-int',has_traffic_filtering=True,id=9e1f2018-b2ed-4d3c-8557-159094954698,network=Network(98a0ba70-e465-40f4-8e47-aaed0b8beac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e1f2018-b2') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG os_vif [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:69:29,bridge_name='br-int',has_traffic_filtering=True,id=9e1f2018-b2ed-4d3c-8557-159094954698,network=Network(98a0ba70-e465-40f4-8e47-aaed0b8beac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e1f2018-b2') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d3199ab-c72c-599d-b8b4-9df64157097c', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5539b94e-7fc6-4bb8-ac17-9b141b6671cd req-a872ba03-defb-4537-b8f8-2f5b8a5af92f service nova] Releasing lock "refresh_cache-38196606-a9c9-4604-ad21-2ec7511a8b28" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e1f2018-b2, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e1f2018-b2, col_values=(('qos', UUID('bf49827f-a892-43ec-9253-2dcaaa3c6b4e')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e1f2018-b2, col_values=(('external_ids', {'iface-id': '9e1f2018-b2ed-4d3c-8557-159094954698', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:69:29', 'vm-uuid': '07831159-aab3-4f4a-8cc9-25d74e254ae2'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: INFO os_vif [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:69:29,bridge_name='br-int',has_traffic_filtering=True,id=9e1f2018-b2ed-4d3c-8557-159094954698,network=Network(98a0ba70-e465-40f4-8e47-aaed0b8beac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e1f2018-b2')
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1873844826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1873844826',id=32,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqZkCUSoOrMa7ifMuGw6KskYm0ddSPTuC5l2fF8XxmzROteC0oBjHEzid9TYILC5ffFia4MmQDokK+XpN/+t424KLYwLutvEODoNkq9qNzPxtfd4Hfr+nfzxcQDZyj/ZQ==',key_name='tempest-keypair-1974570634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d96d68212bfd495db1630d31eb10c5ff',ramdisk_id='',reservation_id='r-i2dle74p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-307297502',owner_user_name='tempest-TaggedBootDevicesTest_v242-307297502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:26:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='061709b977974ab0bc342e0cbf4bb842',uuid=07831159-aab3-4f4a-8cc9-25d74e254ae2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "address": "fa:16:3e:d0:e7:b1", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04eb3fe-3f", "ovs_interfaceid": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converting VIF {"id": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "address": "fa:16:3e:d0:e7:b1", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04eb3fe-3f", "ovs_interfaceid": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:e7:b1,bridge_name='br-int',has_traffic_filtering=True,id=f04eb3fe-3f8c-45d9-91f2-2f96f3757755,network=Network(98a0ba70-e465-40f4-8e47-aaed0b8beac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04eb3fe-3f') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG os_vif [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:e7:b1,bridge_name='br-int',has_traffic_filtering=True,id=f04eb3fe-3f8c-45d9-91f2-2f96f3757755,network=Network(98a0ba70-e465-40f4-8e47-aaed0b8beac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04eb3fe-3f') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f831dbf-2125-53a0-8504-f233a701a2eb', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf04eb3fe-3f, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf04eb3fe-3f, col_values=(('qos', UUID('817adaa4-c546-4688-95c2-7ea54e01c492')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf04eb3fe-3f, col_values=(('external_ids', {'iface-id': 'f04eb3fe-3f8c-45d9-91f2-2f96f3757755', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:e7:b1', 'vm-uuid': '07831159-aab3-4f4a-8cc9-25d74e254ae2'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: INFO os_vif [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:e7:b1,bridge_name='br-int',has_traffic_filtering=True,id=f04eb3fe-3f8c-45d9-91f2-2f96f3757755,network=Network(98a0ba70-e465-40f4-8e47-aaed0b8beac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04eb3fe-3f')
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1873844826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1873844826',id=32,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqZkCUSoOrMa7ifMuGw6KskYm0ddSPTuC5l2fF8XxmzROteC0oBjHEzid9TYILC5ffFia4MmQDokK+XpN/+t424KLYwLutvEODoNkq9qNzPxtfd4Hfr+nfzxcQDZyj/ZQ==',key_name='tempest-keypair-1974570634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d96d68212bfd495db1630d31eb10c5ff',ramdisk_id='',reservation_id='r-i2dle74p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-307297502',owner_user_name='tempest-TaggedBootDevicesTest_v242-307297502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:26:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='061709b977974ab0bc342e0cbf4bb842',uuid=07831159-aab3-4f4a-8cc9-25d74e254ae2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2b44c84-229d-451e-b81c-e45ca53d6ef5", "address": "fa:16:3e:b4:2b:28", "network": {"id": "378a82b9-cfdf-45a5-82cb-25308188ce8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1809740597", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b44c84-22", "ovs_interfaceid": "b2b44c84-229d-451e-b81c-e45ca53d6ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converting VIF {"id": "b2b44c84-229d-451e-b81c-e45ca53d6ef5", "address": "fa:16:3e:b4:2b:28", "network": {"id": "378a82b9-cfdf-45a5-82cb-25308188ce8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1809740597", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b44c84-22", "ovs_interfaceid": "b2b44c84-229d-451e-b81c-e45ca53d6ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:2b:28,bridge_name='br-int',has_traffic_filtering=True,id=b2b44c84-229d-451e-b81c-e45ca53d6ef5,network=Network(378a82b9-cfdf-45a5-82cb-25308188ce8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2b44c84-22') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG os_vif [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:2b:28,bridge_name='br-int',has_traffic_filtering=True,id=b2b44c84-229d-451e-b81c-e45ca53d6ef5,network=Network(378a82b9-cfdf-45a5-82cb-25308188ce8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2b44c84-22') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5432e20-64d0-541c-b559-3abecb5a4a67', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2b44c84-22, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb2b44c84-22, col_values=(('qos', UUID('0e28dc6d-058f-46ce-91c0-e2aef5a366fc')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb2b44c84-22, col_values=(('external_ids', {'iface-id': 'b2b44c84-229d-451e-b81c-e45ca53d6ef5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:2b:28', 'vm-uuid': '07831159-aab3-4f4a-8cc9-25d74e254ae2'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: INFO os_vif [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:2b:28,bridge_name='br-int',has_traffic_filtering=True,id=b2b44c84-229d-451e-b81c-e45ca53d6ef5,network=Network(378a82b9-cfdf-45a5-82cb-25308188ce8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2b44c84-22')
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1873844826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1873844826',id=32,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqZkCUSoOrMa7ifMuGw6KskYm0ddSPTuC5l2fF8XxmzROteC0oBjHEzid9TYILC5ffFia4MmQDokK+XpN/+t424KLYwLutvEODoNkq9qNzPxtfd4Hfr+nfzxcQDZyj/ZQ==',key_name='tempest-keypair-1974570634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d96d68212bfd495db1630d31eb10c5ff',ramdisk_id='',reservation_id='r-i2dle74p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-307297502',owner_user_name='tempest-TaggedBootDevicesTest_v242-307297502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:26:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='061709b977974ab0bc342e0cbf4bb842',uuid=07831159-aab3-4f4a-8cc9-25d74e254ae2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "address": "fa:16:3e:90:ce:b7", "network": {"id": "378a82b9-cfdf-45a5-82cb-25308188ce8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1809740597", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dcaad31-1b", "ovs_interfaceid": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converting VIF {"id": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "address": "fa:16:3e:90:ce:b7", "network": {"id": "378a82b9-cfdf-45a5-82cb-25308188ce8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1809740597", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dcaad31-1b", "ovs_interfaceid": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:ce:b7,bridge_name='br-int',has_traffic_filtering=True,id=3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d,network=Network(378a82b9-cfdf-45a5-82cb-25308188ce8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dcaad31-1b') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG os_vif [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:ce:b7,bridge_name='br-int',has_traffic_filtering=True,id=3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d,network=Network(378a82b9-cfdf-45a5-82cb-25308188ce8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dcaad31-1b') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a172154d-22f0-5871-8e8c-c6426e389b59', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3dcaad31-1b, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3dcaad31-1b, col_values=(('qos', UUID('5deb82af-4846-4276-a761-842eb9d4242a')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3dcaad31-1b, col_values=(('external_ids', {'iface-id': '3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:ce:b7', 'vm-uuid': '07831159-aab3-4f4a-8cc9-25d74e254ae2'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:26:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:55 user nova-compute[74805]: INFO os_vif [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:ce:b7,bridge_name='br-int',has_traffic_filtering=True,id=3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d,network=Network(378a82b9-cfdf-45a5-82cb-25308188ce8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dcaad31-1b')
Nov 15 04:26:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] No BDM found with device name hda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:26:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:26:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] No VIF found with MAC fa:16:3e:97:a8:ea, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:26:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] No VIF found with MAC fa:16:3e:d0:e7:b1, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:26:56 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Using config drive
Nov 15 04:26:56 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Creating config drive at /opt/stack/data/nova/instances/07831159-aab3-4f4a-8cc9-25d74e254ae2/disk.config
Nov 15 04:26:56 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/07831159-aab3-4f4a-8cc9-25d74e254ae2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjqq6qvvv {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:56 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/07831159-aab3-4f4a-8cc9-25d74e254ae2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjqq6qvvv" returned: 0 in 0.054s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:57 user nova-compute[74805]: DEBUG nova.compute.manager [req-767ae6b1-ddc0-4752-b58e-6c064e267567 req-aa69ce16-90f7-4ecf-b66a-ffa1144517fa service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-plugged-dc86c423-92d8-43e7-a330-b1ebe656885a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:26:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-767ae6b1-ddc0-4752-b58e-6c064e267567 req-aa69ce16-90f7-4ecf-b66a-ffa1144517fa service nova] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-767ae6b1-ddc0-4752-b58e-6c064e267567 req-aa69ce16-90f7-4ecf-b66a-ffa1144517fa service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-767ae6b1-ddc0-4752-b58e-6c064e267567 req-aa69ce16-90f7-4ecf-b66a-ffa1144517fa service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:57 user nova-compute[74805]: DEBUG nova.compute.manager [req-767ae6b1-ddc0-4752-b58e-6c064e267567 req-aa69ce16-90f7-4ecf-b66a-ffa1144517fa service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] No waiting events found dispatching network-vif-plugged-dc86c423-92d8-43e7-a330-b1ebe656885a {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:26:57 user nova-compute[74805]: WARNING nova.compute.manager [req-767ae6b1-ddc0-4752-b58e-6c064e267567 req-aa69ce16-90f7-4ecf-b66a-ffa1144517fa service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received unexpected event network-vif-plugged-dc86c423-92d8-43e7-a330-b1ebe656885a for instance with vm_state building and task_state spawning.
Nov 15 04:26:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:58 user nova-compute[74805]: DEBUG nova.compute.manager [req-2aad9f72-421f-4c34-a3ea-c50deca361b4 req-a2e2dda1-979c-408c-a8f0-72b0bdbb1d4e service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-plugged-e7e7afc5-68c4-4483-848e-7a08e6ad2495 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:26:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2aad9f72-421f-4c34-a3ea-c50deca361b4 req-a2e2dda1-979c-408c-a8f0-72b0bdbb1d4e service nova] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2aad9f72-421f-4c34-a3ea-c50deca361b4 req-a2e2dda1-979c-408c-a8f0-72b0bdbb1d4e service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2aad9f72-421f-4c34-a3ea-c50deca361b4 req-a2e2dda1-979c-408c-a8f0-72b0bdbb1d4e service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:58 user nova-compute[74805]: DEBUG nova.compute.manager [req-2aad9f72-421f-4c34-a3ea-c50deca361b4 req-a2e2dda1-979c-408c-a8f0-72b0bdbb1d4e service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] No waiting events found dispatching network-vif-plugged-e7e7afc5-68c4-4483-848e-7a08e6ad2495 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:26:58 user nova-compute[74805]: WARNING nova.compute.manager [req-2aad9f72-421f-4c34-a3ea-c50deca361b4 req-a2e2dda1-979c-408c-a8f0-72b0bdbb1d4e service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received unexpected event network-vif-plugged-e7e7afc5-68c4-4483-848e-7a08e6ad2495 for instance with vm_state building and task_state spawning.
Nov 15 04:26:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:58 user nova-compute[74805]: DEBUG nova.compute.manager [req-f275d1c4-76fb-4314-9c45-090f375a4e3f req-a9fe02fd-a20b-469f-8d76-5d0fe14b231b service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-plugged-01ea0e4b-c98f-4380-9dd9-0b8a33f784f1 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:26:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f275d1c4-76fb-4314-9c45-090f375a4e3f req-a9fe02fd-a20b-469f-8d76-5d0fe14b231b service nova] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f275d1c4-76fb-4314-9c45-090f375a4e3f req-a9fe02fd-a20b-469f-8d76-5d0fe14b231b service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f275d1c4-76fb-4314-9c45-090f375a4e3f req-a9fe02fd-a20b-469f-8d76-5d0fe14b231b service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:58 user nova-compute[74805]: DEBUG nova.compute.manager [req-f275d1c4-76fb-4314-9c45-090f375a4e3f req-a9fe02fd-a20b-469f-8d76-5d0fe14b231b service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] No waiting events found dispatching network-vif-plugged-01ea0e4b-c98f-4380-9dd9-0b8a33f784f1 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:26:58 user nova-compute[74805]: WARNING nova.compute.manager [req-f275d1c4-76fb-4314-9c45-090f375a4e3f req-a9fe02fd-a20b-469f-8d76-5d0fe14b231b service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received unexpected event network-vif-plugged-01ea0e4b-c98f-4380-9dd9-0b8a33f784f1 for instance with vm_state building and task_state spawning.
Nov 15 04:26:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG os_brick.utils [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee35b726-99f5-4872-9ffe-665d5f476442]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[291038ae-32fd-4da9-869a-a7735b9423b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[947b477d-c731-4879-a700-5189909b01db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[093c0cf6-66ef-4619-87eb-a0c7f1afd298]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:26:59 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:26:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[08008db5-f998-4a7c-86b8-177b6df0ca49]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG os_brick.utils [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Updating existing volume attachment record: 92d131ac-1e4f-4f5b-81fd-0a3db31dbf6f {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG nova.compute.manager [req-769fe0e3-6dd8-479e-8bd1-feb9d1233b51 req-f26b1484-febb-4961-8f0d-7ad71b1ec43e service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-plugged-dc86c423-92d8-43e7-a330-b1ebe656885a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-769fe0e3-6dd8-479e-8bd1-feb9d1233b51 req-f26b1484-febb-4961-8f0d-7ad71b1ec43e service nova] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-769fe0e3-6dd8-479e-8bd1-feb9d1233b51 req-f26b1484-febb-4961-8f0d-7ad71b1ec43e service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-769fe0e3-6dd8-479e-8bd1-feb9d1233b51 req-f26b1484-febb-4961-8f0d-7ad71b1ec43e service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:26:59 user nova-compute[74805]: DEBUG nova.compute.manager [req-769fe0e3-6dd8-479e-8bd1-feb9d1233b51 req-f26b1484-febb-4961-8f0d-7ad71b1ec43e service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] No waiting events found dispatching network-vif-plugged-dc86c423-92d8-43e7-a330-b1ebe656885a {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:26:59 user nova-compute[74805]: WARNING nova.compute.manager [req-769fe0e3-6dd8-479e-8bd1-feb9d1233b51 req-f26b1484-febb-4961-8f0d-7ad71b1ec43e service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received unexpected event network-vif-plugged-dc86c423-92d8-43e7-a330-b1ebe656885a for instance with vm_state building and task_state spawning.
Nov 15 04:27:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-plugged-e7e7afc5-68c4-4483-848e-7a08e6ad2495 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] No waiting events found dispatching network-vif-plugged-e7e7afc5-68c4-4483-848e-7a08e6ad2495 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:27:00 user nova-compute[74805]: WARNING nova.compute.manager [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received unexpected event network-vif-plugged-e7e7afc5-68c4-4483-848e-7a08e6ad2495 for instance with vm_state building and task_state spawning.
Nov 15 04:27:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-plugged-9e1f2018-b2ed-4d3c-8557-159094954698 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] No waiting events found dispatching network-vif-plugged-9e1f2018-b2ed-4d3c-8557-159094954698 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:27:00 user nova-compute[74805]: WARNING nova.compute.manager [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received unexpected event network-vif-plugged-9e1f2018-b2ed-4d3c-8557-159094954698 for instance with vm_state building and task_state spawning.
Nov 15 04:27:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-plugged-9e1f2018-b2ed-4d3c-8557-159094954698 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] No waiting events found dispatching network-vif-plugged-9e1f2018-b2ed-4d3c-8557-159094954698 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:27:00 user nova-compute[74805]: WARNING nova.compute.manager [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received unexpected event network-vif-plugged-9e1f2018-b2ed-4d3c-8557-159094954698 for instance with vm_state building and task_state spawning.
Nov 15 04:27:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-plugged-f04eb3fe-3f8c-45d9-91f2-2f96f3757755 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] No waiting events found dispatching network-vif-plugged-f04eb3fe-3f8c-45d9-91f2-2f96f3757755 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:27:00 user nova-compute[74805]: WARNING nova.compute.manager [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received unexpected event network-vif-plugged-f04eb3fe-3f8c-45d9-91f2-2f96f3757755 for instance with vm_state building and task_state spawning.
Nov 15 04:27:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-plugged-f04eb3fe-3f8c-45d9-91f2-2f96f3757755 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] No waiting events found dispatching network-vif-plugged-f04eb3fe-3f8c-45d9-91f2-2f96f3757755 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:27:00 user nova-compute[74805]: WARNING nova.compute.manager [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received unexpected event network-vif-plugged-f04eb3fe-3f8c-45d9-91f2-2f96f3757755 for instance with vm_state building and task_state spawning.
Nov 15 04:27:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-plugged-b2b44c84-229d-451e-b81c-e45ca53d6ef5 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] No waiting events found dispatching network-vif-plugged-b2b44c84-229d-451e-b81c-e45ca53d6ef5 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:27:00 user nova-compute[74805]: WARNING nova.compute.manager [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received unexpected event network-vif-plugged-b2b44c84-229d-451e-b81c-e45ca53d6ef5 for instance with vm_state building and task_state spawning.
Nov 15 04:27:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-plugged-b2b44c84-229d-451e-b81c-e45ca53d6ef5 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] No waiting events found dispatching network-vif-plugged-b2b44c84-229d-451e-b81c-e45ca53d6ef5 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:27:00 user nova-compute[74805]: WARNING nova.compute.manager [req-f45fa9e5-ade3-4ece-89dd-907bc2a2efe0 req-c93e5e3e-ebee-417b-b55d-806a95546c43 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received unexpected event network-vif-plugged-b2b44c84-229d-451e-b81c-e45ca53d6ef5 for instance with vm_state building and task_state spawning.
Nov 15 04:27:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-af3a8d98-4f8b-4b5a-a1f5-0c2681146e6c req-a1d9898f-40e4-4af3-a467-08d6f6ee5239 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-plugged-01ea0e4b-c98f-4380-9dd9-0b8a33f784f1 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-af3a8d98-4f8b-4b5a-a1f5-0c2681146e6c req-a1d9898f-40e4-4af3-a467-08d6f6ee5239 service nova] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-af3a8d98-4f8b-4b5a-a1f5-0c2681146e6c req-a1d9898f-40e4-4af3-a467-08d6f6ee5239 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-af3a8d98-4f8b-4b5a-a1f5-0c2681146e6c req-a1d9898f-40e4-4af3-a467-08d6f6ee5239 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-af3a8d98-4f8b-4b5a-a1f5-0c2681146e6c req-a1d9898f-40e4-4af3-a467-08d6f6ee5239 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] No waiting events found dispatching network-vif-plugged-01ea0e4b-c98f-4380-9dd9-0b8a33f784f1 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:27:00 user nova-compute[74805]: WARNING nova.compute.manager [req-af3a8d98-4f8b-4b5a-a1f5-0c2681146e6c req-a1d9898f-40e4-4af3-a467-08d6f6ee5239 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received unexpected event network-vif-plugged-01ea0e4b-c98f-4380-9dd9-0b8a33f784f1 for instance with vm_state building and task_state spawning.
Nov 15 04:27:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-af3a8d98-4f8b-4b5a-a1f5-0c2681146e6c req-a1d9898f-40e4-4af3-a467-08d6f6ee5239 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-plugged-3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-af3a8d98-4f8b-4b5a-a1f5-0c2681146e6c req-a1d9898f-40e4-4af3-a467-08d6f6ee5239 service nova] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-af3a8d98-4f8b-4b5a-a1f5-0c2681146e6c req-a1d9898f-40e4-4af3-a467-08d6f6ee5239 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-af3a8d98-4f8b-4b5a-a1f5-0c2681146e6c req-a1d9898f-40e4-4af3-a467-08d6f6ee5239 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-af3a8d98-4f8b-4b5a-a1f5-0c2681146e6c req-a1d9898f-40e4-4af3-a467-08d6f6ee5239 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] No waiting events found dispatching network-vif-plugged-3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:27:00 user nova-compute[74805]: WARNING nova.compute.manager [req-af3a8d98-4f8b-4b5a-a1f5-0c2681146e6c req-a1d9898f-40e4-4af3-a467-08d6f6ee5239 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received unexpected event network-vif-plugged-3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d for instance with vm_state building and task_state spawning.
Nov 15 04:27:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-af3a8d98-4f8b-4b5a-a1f5-0c2681146e6c req-a1d9898f-40e4-4af3-a467-08d6f6ee5239 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-plugged-3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-af3a8d98-4f8b-4b5a-a1f5-0c2681146e6c req-a1d9898f-40e4-4af3-a467-08d6f6ee5239 service nova] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-af3a8d98-4f8b-4b5a-a1f5-0c2681146e6c req-a1d9898f-40e4-4af3-a467-08d6f6ee5239 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-af3a8d98-4f8b-4b5a-a1f5-0c2681146e6c req-a1d9898f-40e4-4af3-a467-08d6f6ee5239 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-af3a8d98-4f8b-4b5a-a1f5-0c2681146e6c req-a1d9898f-40e4-4af3-a467-08d6f6ee5239 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] No waiting events found dispatching network-vif-plugged-3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:27:00 user nova-compute[74805]: WARNING nova.compute.manager [req-af3a8d98-4f8b-4b5a-a1f5-0c2681146e6c req-a1d9898f-40e4-4af3-a467-08d6f6ee5239 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received unexpected event network-vif-plugged-3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d for instance with vm_state building and task_state spawning.
Nov 15 04:27:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:01 user nova-compute[74805]: DEBUG nova.compute.manager [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:27:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:27:01 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Instance spawned successfully.
Nov 15 04:27:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:27:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:27:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:27:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:27:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:27:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:27:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:27:02 user nova-compute[74805]: INFO nova.compute.manager [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Took 11.19 seconds to spawn the instance on the hypervisor.
Nov 15 04:27:02 user nova-compute[74805]: DEBUG nova.compute.manager [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:27:02 user nova-compute[74805]: INFO nova.compute.manager [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Took 31.91 seconds to build instance.
Nov 15 04:27:02 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3bee0494-9726-4d67-b98b-ffa6f6715012 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.009s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6d931685-cda1-41bd-bcb9-50c135a8019b tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "e5004557-00fa-4824-9233-343c2261588d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6d931685-cda1-41bd-bcb9-50c135a8019b tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "e5004557-00fa-4824-9233-343c2261588d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6d931685-cda1-41bd-bcb9-50c135a8019b tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "e5004557-00fa-4824-9233-343c2261588d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6d931685-cda1-41bd-bcb9-50c135a8019b tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "e5004557-00fa-4824-9233-343c2261588d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6d931685-cda1-41bd-bcb9-50c135a8019b tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "e5004557-00fa-4824-9233-343c2261588d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:04 user nova-compute[74805]: INFO nova.compute.manager [None req-6d931685-cda1-41bd-bcb9-50c135a8019b tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Terminating instance
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.compute.manager [None req-6d931685-cda1-41bd-bcb9-50c135a8019b tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.compute.manager [req-d6c88c2a-1c8f-4566-bf12-00feef6b10f5 req-89c6d917-5e4b-4aa9-ace8-08ea72e46122 service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Received event network-vif-unplugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d6c88c2a-1c8f-4566-bf12-00feef6b10f5 req-89c6d917-5e4b-4aa9-ace8-08ea72e46122 service nova] Acquiring lock "e5004557-00fa-4824-9233-343c2261588d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d6c88c2a-1c8f-4566-bf12-00feef6b10f5 req-89c6d917-5e4b-4aa9-ace8-08ea72e46122 service nova] Lock "e5004557-00fa-4824-9233-343c2261588d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d6c88c2a-1c8f-4566-bf12-00feef6b10f5 req-89c6d917-5e4b-4aa9-ace8-08ea72e46122 service nova] Lock "e5004557-00fa-4824-9233-343c2261588d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.compute.manager [req-d6c88c2a-1c8f-4566-bf12-00feef6b10f5 req-89c6d917-5e4b-4aa9-ace8-08ea72e46122 service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] No waiting events found dispatching network-vif-unplugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.compute.manager [req-d6c88c2a-1c8f-4566-bf12-00feef6b10f5 req-89c6d917-5e4b-4aa9-ace8-08ea72e46122 service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Received event network-vif-unplugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:27:04 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: e5004557-00fa-4824-9233-343c2261588d] Instance destroyed successfully.
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.objects.instance [None req-6d931685-cda1-41bd-bcb9-50c135a8019b tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'resources' on Instance uuid e5004557-00fa-4824-9233-343c2261588d {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-6d931685-cda1-41bd-bcb9-50c135a8019b tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:17:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1146298859',display_name='tempest-AttachVolumeTestJSON-server-1146298859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1146298859',id=15,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcDGmoSL9n6BzrErqwQE4CV+qAoPf9h8eN4+5EDz04bsyjTTZ4Sit9JWjEhWommytKEKkL3SeMOXxTqRGtePTLcAr9xdzbbxAAil9ruYGUIPqhf/tGyrXvLN/cCYSgOhg==',key_name='tempest-keypair-2130424993',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:17:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7ba201faadb461882c823f9bd895af9',ramdisk_id='',reservation_id='r-g45utcp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-17326548',owner_user_name='tempest-AttachVolumeTestJSON-17326548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:25:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50fe72dfe19f4c9792c4733f14b2d464',uuid=e5004557-00fa-4824-9233-343c2261588d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "address": "fa:16:3e:c8:0f:b4", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96104fe5-a8", "ovs_interfaceid": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-6d931685-cda1-41bd-bcb9-50c135a8019b tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Converting VIF {"id": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "address": "fa:16:3e:c8:0f:b4", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96104fe5-a8", "ovs_interfaceid": "96104fe5-a8a5-445d-9c2a-6631a15e4349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-6d931685-cda1-41bd-bcb9-50c135a8019b tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:0f:b4,bridge_name='br-int',has_traffic_filtering=True,id=96104fe5-a8a5-445d-9c2a-6631a15e4349,network=Network(5b2973a0-643c-4d30-a6cd-3d1391fe2cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96104fe5-a8') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG os_vif [None req-6d931685-cda1-41bd-bcb9-50c135a8019b tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:0f:b4,bridge_name='br-int',has_traffic_filtering=True,id=96104fe5-a8a5-445d-9c2a-6631a15e4349,network=Network(5b2973a0-643c-4d30-a6cd-3d1391fe2cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96104fe5-a8') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96104fe5-a8, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8126c449-a4ed-4d68-860d-c508bfbc4a33) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.compute.manager [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:27:04 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Creating image(s)
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Did not create local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Ensure instance console log exists: /opt/stack/data/nova/instances/38196606-a9c9-4604-ad21-2ec7511a8b28/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Start _get_guest_xml network_info=[{"id": "23517101-97ec-4772-ab6b-6f626a6547bc", "address": "fa:16:3e:da:ef:08", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23517101-97", "ovs_interfaceid": "23517101-97ec-4772-ab6b-6f626a6547bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qbpwgdVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '38196606-a9c9-4604-ad21-2ec7511a8b28', 'attached_at': '', 'detached_at': '', 'volume_id': 'bf8cdd86-a2fb-4387-a1e6-0e354edafa6f', 'serial': 'bf8cdd86-a2fb-4387-a1e6-0e354edafa6f'}, 'delete_on_termination': False, 'attachment_id': '92d131ac-1e4f-4f5b-81fd-0a3db31dbf6f', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:27:04 user nova-compute[74805]: INFO os_vif [None req-6d931685-cda1-41bd-bcb9-50c135a8019b tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:0f:b4,bridge_name='br-int',has_traffic_filtering=True,id=96104fe5-a8a5-445d-9c2a-6631a15e4349,network=Network(5b2973a0-643c-4d30-a6cd-3d1391fe2cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96104fe5-a8')
Nov 15 04:27:04 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-6d931685-cda1-41bd-bcb9-50c135a8019b tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Deleting instance files /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d_del
Nov 15 04:27:04 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-6d931685-cda1-41bd-bcb9-50c135a8019b tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Deletion of /opt/stack/data/nova/instances/e5004557-00fa-4824-9233-343c2261588d_del complete
Nov 15 04:27:04 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:27:04 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qbpwgdVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:27:04 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:27:04 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:27:04 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:27:04 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:27:04 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:27:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:04 user nova-compute[74805]: INFO nova.compute.manager [None req-6d931685-cda1-41bd-bcb9-50c135a8019b tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: e5004557-00fa-4824-9233-343c2261588d] Took 0.75 seconds to destroy the instance on the hypervisor.
Nov 15 04:27:04 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-6d931685-cda1-41bd-bcb9-50c135a8019b tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: e5004557-00fa-4824-9233-343c2261588d] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:27:04 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: e5004557-00fa-4824-9233-343c2261588d] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f16e241-d2dc-4f02-a3a0-7899e0204375]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:27:05 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ac87af-8c4b-4b3e-8d4d-3b8db4a18f02]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f] added
Nov 15 04:27:05 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e77e04-eb61-446c-89a0-05750ac24057]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[983b9d23-e4b9-4630-b2d1-dd5cb0dc0473]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qbpwgdVH {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qbpwgdVH" returned: 0 in 0.027s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba95c043-b70d-4a83-bccf-8cf2417e936a]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qbpwgdVH'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[31685822-035e-47cc-b671-cd4b8573a83d]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9297ae42-f7bf-4355-a572-b579d3c37ccc]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:27:05 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:27:05 user nova-compute[74805]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)
Nov 15 04:27:05 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:27:05 user nova-compute[74805]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)
Nov 15 04:27:05 user nova-compute[74805]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)
Nov 15 04:27:05 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:27:05 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:27:05 user nova-compute[74805]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)
Nov 15 04:27:05 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:27:05 user nova-compute[74805]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)
Nov 15 04:27:05 user nova-compute[74805]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)
Nov 15 04:27:05 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e67cd47-d7ac-45a1-8ce2-b08fd74da9dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f, portal: 172.16.0.220,3260]
Nov 15 04:27:05 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f, portal: 172.16.0.220,3260] successful.
Nov 15 04:27:05 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f72acba-7b40-4b2e-b6e9-a826dcba42c3]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea8c53a-3053-4a16-a687-d8d4ddf960c3]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:27:05 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:27:05 user nova-compute[74805]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)
Nov 15 04:27:05 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:27:05 user nova-compute[74805]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)
Nov 15 04:27:05 user nova-compute[74805]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)
Nov 15 04:27:05 user nova-compute[74805]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:27:05 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:27:05 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:27:05 user nova-compute[74805]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)
Nov 15 04:27:05 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:27:05 user nova-compute[74805]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)
Nov 15 04:27:05 user nova-compute[74805]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)
Nov 15 04:27:05 user nova-compute[74805]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:27:05 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] HCTL ('39', '-', '-', 0) found on session 38 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[466708f5-5c4b-4f2f-91ec-60dabf7a39a7]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Searching for a device in session 38 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qbpwgdVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:27:05 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c is timed out.
Nov 15 04:27:05 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Successfully detached device vdb from instance 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c from the live domain config.
Nov 15 04:27:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CmlyARUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:27:05 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:27:05 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: e5004557-00fa-4824-9233-343c2261588d] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:27:05 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: e5004557-00fa-4824-9233-343c2261588d] Took 0.92 seconds to deallocate network for instance.
Nov 15 04:27:05 user nova-compute[74805]: DEBUG nova.compute.manager [req-aae9cc59-03ac-427e-8736-99f5f0f43e2f req-a6e3a471-9d33-4b80-abae-cb77d920107c service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Received event network-vif-deleted-96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:05 user nova-compute[74805]: INFO nova.compute.manager [req-aae9cc59-03ac-427e-8736-99f5f0f43e2f req-a6e3a471-9d33-4b80-abae-cb77d920107c service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Neutron deleted interface 96104fe5-a8a5-445d-9c2a-6631a15e4349; detaching it from the instance and deleting it from the info cache
Nov 15 04:27:05 user nova-compute[74805]: DEBUG nova.network.neutron [req-aae9cc59-03ac-427e-8736-99f5f0f43e2f req-a6e3a471-9d33-4b80-abae-cb77d920107c service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:27:05 user nova-compute[74805]: DEBUG nova.compute.manager [req-aae9cc59-03ac-427e-8736-99f5f0f43e2f req-a6e3a471-9d33-4b80-abae-cb77d920107c service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Detach interface failed, port_id=96104fe5-a8a5-445d-9c2a-6631a15e4349, reason: Instance e5004557-00fa-4824-9233-343c2261588d could not be found. {{(pid=74805) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6d931685-cda1-41bd-bcb9-50c135a8019b tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6d931685-cda1-41bd-bcb9-50c135a8019b tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-6d931685-cda1-41bd-bcb9-50c135a8019b tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-6d931685-cda1-41bd-bcb9-50c135a8019b tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6d931685-cda1-41bd-bcb9-50c135a8019b tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:06 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-6d931685-cda1-41bd-bcb9-50c135a8019b tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Deleted allocations for instance e5004557-00fa-4824-9233-343c2261588d
Nov 15 04:27:06 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '26332383866366438', 'path': '/dev/sdh'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332383866366438', 'path': '/dev/sdh'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.551s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:26:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-839976471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-839976471',id=33,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d11645073d58476491d101b9f3ee4052',ramdisk_id='',reservation_id='r-vt73w83j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1297861260',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:26:54Z,user_data=None,user_id='8cba9273daa1478fa6cc8274443b4f40',uuid=38196606-a9c9-4604-ad21-2ec7511a8b28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23517101-97ec-4772-ab6b-6f626a6547bc", "address": "fa:16:3e:da:ef:08", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23517101-97", "ovs_interfaceid": "23517101-97ec-4772-ab6b-6f626a6547bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Converting VIF {"id": "23517101-97ec-4772-ab6b-6f626a6547bc", "address": "fa:16:3e:da:ef:08", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23517101-97", "ovs_interfaceid": "23517101-97ec-4772-ab6b-6f626a6547bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:ef:08,bridge_name='br-int',has_traffic_filtering=True,id=23517101-97ec-4772-ab6b-6f626a6547bc,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23517101-97') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG nova.objects.instance [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lazy-loading 'pci_devices' on Instance uuid 38196606-a9c9-4604-ad21-2ec7511a8b28 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05f7db7-03ba-4212-9480-2d3c1feddeaf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:27:06 user nova-compute[74805]: No targets found.
Nov 15 04:27:06 user nova-compute[74805]: iSNS:
Nov 15 04:27:06 user nova-compute[74805]: No targets found.
Nov 15 04:27:06 user nova-compute[74805]: STATIC:
Nov 15 04:27:06 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745
Nov 15 04:27:06 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:27:06 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:27:06 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f
Nov 15 04:27:06 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:27:06 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:27:06 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83
Nov 15 04:27:06 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:27:06 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:27:06 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf
Nov 15 04:27:06 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:27:06 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:27:06 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b
Nov 15 04:27:06 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:27:06 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:27:06 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13
Nov 15 04:27:06 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:27:06 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:27:06 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312
Nov 15 04:27:06 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:27:06 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:27:06 user nova-compute[74805]: FIRMWARE:
Nov 15 04:27:06 user nova-compute[74805]: No targets found.
Nov 15 04:27:06 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:27:06 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:27:06 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:27:06 user nova-compute[74805]:   <uuid>38196606-a9c9-4604-ad21-2ec7511a8b28</uuid>
Nov 15 04:27:06 user nova-compute[74805]:   <name>instance-00000021</name>
Nov 15 04:27:06 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:27:06 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:27:06 user nova-compute[74805]:   <metadata>
Nov 15 04:27:06 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:27:06 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:27:06 user nova-compute[74805]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-839976471</nova:name>
Nov 15 04:27:06 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:27:04</nova:creationTime>
Nov 15 04:27:06 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:27:06 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:27:06 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:27:06 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:27:06 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:27:06 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:27:06 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:27:06 user nova-compute[74805]:       <nova:owner>
Nov 15 04:27:06 user nova-compute[74805]:         <nova:user uuid="8cba9273daa1478fa6cc8274443b4f40">tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member</nova:user>
Nov 15 04:27:06 user nova-compute[74805]:         <nova:project uuid="d11645073d58476491d101b9f3ee4052">tempest-ServerBootFromVolumeStableRescueTest-1297861260</nova:project>
Nov 15 04:27:06 user nova-compute[74805]:       </nova:owner>
Nov 15 04:27:06 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:27:06 user nova-compute[74805]:       <nova:ports>
Nov 15 04:27:06 user nova-compute[74805]:         <nova:port uuid="23517101-97ec-4772-ab6b-6f626a6547bc">
Nov 15 04:27:06 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 04:27:06 user nova-compute[74805]:         </nova:port>
Nov 15 04:27:06 user nova-compute[74805]:       </nova:ports>
Nov 15 04:27:06 user nova-compute[74805]:     </nova:instance>
Nov 15 04:27:06 user nova-compute[74805]:   </metadata>
Nov 15 04:27:06 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:27:06 user nova-compute[74805]:     <system>
Nov 15 04:27:06 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:27:06 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:27:06 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:27:06 user nova-compute[74805]:       <entry name="serial">38196606-a9c9-4604-ad21-2ec7511a8b28</entry>
Nov 15 04:27:06 user nova-compute[74805]:       <entry name="uuid">38196606-a9c9-4604-ad21-2ec7511a8b28</entry>
Nov 15 04:27:06 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:27:06 user nova-compute[74805]:     </system>
Nov 15 04:27:06 user nova-compute[74805]:   </sysinfo>
Nov 15 04:27:06 user nova-compute[74805]:   <os>
Nov 15 04:27:06 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:27:06 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:27:06 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:27:06 user nova-compute[74805]:   </os>
Nov 15 04:27:06 user nova-compute[74805]:   <features>
Nov 15 04:27:06 user nova-compute[74805]:     <acpi/>
Nov 15 04:27:06 user nova-compute[74805]:     <apic/>
Nov 15 04:27:06 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:27:06 user nova-compute[74805]:   </features>
Nov 15 04:27:06 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:27:06 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:27:06 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:27:06 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:27:06 user nova-compute[74805]:   </clock>
Nov 15 04:27:06 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:27:06 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:27:06 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:27:06 user nova-compute[74805]:   </cpu>
Nov 15 04:27:06 user nova-compute[74805]:   <devices>
Nov 15 04:27:06 user nova-compute[74805]:     <disk type="block" device="disk">
Nov 15 04:27:06 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:27:06 user nova-compute[74805]:       <source dev="/dev/sdh"/>
Nov 15 04:27:06 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:27:06 user nova-compute[74805]:       <serial>bf8cdd86-a2fb-4387-a1e6-0e354edafa6f</serial>
Nov 15 04:27:06 user nova-compute[74805]:     </disk>
Nov 15 04:27:06 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:27:06 user nova-compute[74805]:       <mac address="fa:16:3e:da:ef:08"/>
Nov 15 04:27:06 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:27:06 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:27:06 user nova-compute[74805]:       <target dev="tap23517101-97"/>
Nov 15 04:27:06 user nova-compute[74805]:     </interface>
Nov 15 04:27:06 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:27:06 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/38196606-a9c9-4604-ad21-2ec7511a8b28/console.log" append="off"/>
Nov 15 04:27:06 user nova-compute[74805]:     </serial>
Nov 15 04:27:06 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:27:06 user nova-compute[74805]:     <video>
Nov 15 04:27:06 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:27:06 user nova-compute[74805]:     </video>
Nov 15 04:27:06 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:27:06 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:27:06 user nova-compute[74805]:     </rng>
Nov 15 04:27:06 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:27:06 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:27:06 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:27:06 user nova-compute[74805]:     </memballoon>
Nov 15 04:27:06 user nova-compute[74805]:   </devices>
Nov 15 04:27:06 user nova-compute[74805]: </domain>
Nov 15 04:27:06 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:26:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-839976471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-839976471',id=33,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d11645073d58476491d101b9f3ee4052',ramdisk_id='',reservation_id='r-vt73w83j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1297861260',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:26:54Z,user_data=None,user_id='8cba9273daa1478fa6cc8274443b4f40',uuid=38196606-a9c9-4604-ad21-2ec7511a8b28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23517101-97ec-4772-ab6b-6f626a6547bc", "address": "fa:16:3e:da:ef:08", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23517101-97", "ovs_interfaceid": "23517101-97ec-4772-ab6b-6f626a6547bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Converting VIF {"id": "23517101-97ec-4772-ab6b-6f626a6547bc", "address": "fa:16:3e:da:ef:08", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23517101-97", "ovs_interfaceid": "23517101-97ec-4772-ab6b-6f626a6547bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:ef:08,bridge_name='br-int',has_traffic_filtering=True,id=23517101-97ec-4772-ab6b-6f626a6547bc,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23517101-97') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG os_vif [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:ef:08,bridge_name='br-int',has_traffic_filtering=True,id=23517101-97ec-4772-ab6b-6f626a6547bc,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23517101-97') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f8b9c81f-d504-53b4-a229-9d2b2f73d988', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9776af12-b5d6-48f0-a689-ed736f9c5cce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23517101-97, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23517101-97, col_values=(('qos', UUID('9c2b23b7-3fb4-4ee6-8f06-50451a77fff7')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23517101-97, col_values=(('external_ids', {'iface-id': '23517101-97ec-4772-ab6b-6f626a6547bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:ef:08', 'vm-uuid': '38196606-a9c9-4604-ad21-2ec7511a8b28'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:06 user nova-compute[74805]: INFO os_vif [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:ef:08,bridge_name='br-int',has_traffic_filtering=True,id=23517101-97ec-4772-ab6b-6f626a6547bc,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23517101-97')
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[77393264-0726-435f-b4cb-26cbadc7c73b]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:27:06 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:27:06 user nova-compute[74805]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)
Nov 15 04:27:06 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:27:06 user nova-compute[74805]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)
Nov 15 04:27:06 user nova-compute[74805]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)
Nov 15 04:27:06 user nova-compute[74805]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:27:06 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:27:06 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:27:06 user nova-compute[74805]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b (non-flash)
Nov 15 04:27:06 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:27:06 user nova-compute[74805]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)
Nov 15 04:27:06 user nova-compute[74805]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)
Nov 15 04:27:06 user nova-compute[74805]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:27:06 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2fb4364d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b'): ({'sde'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Removing single pathed devices sde {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6d931685-cda1-41bd-bcb9-50c135a8019b tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "e5004557-00fa-4824-9233-343c2261588d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.290s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb12e515-5193-4a0b-be05-7bb48f69514b]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[501304e4-d64f-48a6-9539-b9fa7b8ab18c]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Flushing IO for device /dev/sde {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] No VIF found with MAC fa:16:3e:da:ef:08, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b42740-dbf1-4d87-8cf9-b1f13b8d8129]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG nova.compute.manager [req-fe66005f-549f-4575-af71-ba3135740f38 req-5c692414-c998-4966-ad8d-e8833ad68b27 service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Received event network-vif-plugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-fe66005f-549f-4575-af71-ba3135740f38 req-5c692414-c998-4966-ad8d-e8833ad68b27 service nova] Acquiring lock "e5004557-00fa-4824-9233-343c2261588d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-fe66005f-549f-4575-af71-ba3135740f38 req-5c692414-c998-4966-ad8d-e8833ad68b27 service nova] Lock "e5004557-00fa-4824-9233-343c2261588d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-fe66005f-549f-4575-af71-ba3135740f38 req-5c692414-c998-4966-ad8d-e8833ad68b27 service nova] Lock "e5004557-00fa-4824-9233-343c2261588d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG nova.compute.manager [req-fe66005f-549f-4575-af71-ba3135740f38 req-5c692414-c998-4966-ad8d-e8833ad68b27 service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] No waiting events found dispatching network-vif-plugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:27:06 user nova-compute[74805]: WARNING nova.compute.manager [req-fe66005f-549f-4575-af71-ba3135740f38 req-5c692414-c998-4966-ad8d-e8833ad68b27 service nova] [instance: e5004557-00fa-4824-9233-343c2261588d] Received unexpected event network-vif-plugged-96104fe5-a8a5-445d-9c2a-6631a15e4349 for instance with vm_state deleted and task_state None.
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a9a5d5-f84d-4bae-9591-4e143efe333e]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] SCSI volumes sde have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc5e9e3-8bdd-4998-a646-e5fede27219b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[19950a37-aec0-4c3a-9af2-0082dd163c8d]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b, portal: 172.16.0.220,3260]
Nov 15 04:27:06 user nova-compute[74805]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b, portal: 172.16.0.220,3260] successful.
Nov 15 04:27:06 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbcc35f-2ad4-4bd9-8942-057bbaa63a8b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[16851caa-0017-457d-b423-cb9f56c09aaf]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] <== disconnect_volume: return (941ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:27:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:27:07 user nova-compute[74805]: DEBUG nova.objects.instance [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lazy-loading 'flavor' on Instance uuid 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:27:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-62fed97f-9eb4-4f83-a70b-869fbb871dfa tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.508s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:08 user nova-compute[74805]: DEBUG nova.compute.manager [req-ce823f84-4859-4112-a43c-2be671b0ca9a req-676b278b-e825-4d76-a493-6fed24946d6f service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Received event network-vif-plugged-23517101-97ec-4772-ab6b-6f626a6547bc {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ce823f84-4859-4112-a43c-2be671b0ca9a req-676b278b-e825-4d76-a493-6fed24946d6f service nova] Acquiring lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ce823f84-4859-4112-a43c-2be671b0ca9a req-676b278b-e825-4d76-a493-6fed24946d6f service nova] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ce823f84-4859-4112-a43c-2be671b0ca9a req-676b278b-e825-4d76-a493-6fed24946d6f service nova] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:08 user nova-compute[74805]: DEBUG nova.compute.manager [req-ce823f84-4859-4112-a43c-2be671b0ca9a req-676b278b-e825-4d76-a493-6fed24946d6f service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] No waiting events found dispatching network-vif-plugged-23517101-97ec-4772-ab6b-6f626a6547bc {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:27:08 user nova-compute[74805]: WARNING nova.compute.manager [req-ce823f84-4859-4112-a43c-2be671b0ca9a req-676b278b-e825-4d76-a493-6fed24946d6f service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Received unexpected event network-vif-plugged-23517101-97ec-4772-ab6b-6f626a6547bc for instance with vm_state building and task_state spawning.
Nov 15 04:27:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:09 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:27:10 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:27:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:10 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:27:10 user nova-compute[74805]: DEBUG nova.compute.manager [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:27:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:27:10 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Instance spawned successfully.
Nov 15 04:27:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:27:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:27:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:27:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:27:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:27:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:27:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:27:10 user nova-compute[74805]: DEBUG nova.compute.manager [req-54a1bbc5-9182-4c70-96ff-15ceec5070cc req-2f99612d-9b90-4bc4-898f-6f3d66b2b654 service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Received event network-vif-plugged-23517101-97ec-4772-ab6b-6f626a6547bc {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-54a1bbc5-9182-4c70-96ff-15ceec5070cc req-2f99612d-9b90-4bc4-898f-6f3d66b2b654 service nova] Acquiring lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-54a1bbc5-9182-4c70-96ff-15ceec5070cc req-2f99612d-9b90-4bc4-898f-6f3d66b2b654 service nova] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-54a1bbc5-9182-4c70-96ff-15ceec5070cc req-2f99612d-9b90-4bc4-898f-6f3d66b2b654 service nova] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:10 user nova-compute[74805]: DEBUG nova.compute.manager [req-54a1bbc5-9182-4c70-96ff-15ceec5070cc req-2f99612d-9b90-4bc4-898f-6f3d66b2b654 service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] No waiting events found dispatching network-vif-plugged-23517101-97ec-4772-ab6b-6f626a6547bc {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:27:10 user nova-compute[74805]: WARNING nova.compute.manager [req-54a1bbc5-9182-4c70-96ff-15ceec5070cc req-2f99612d-9b90-4bc4-898f-6f3d66b2b654 service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Received unexpected event network-vif-plugged-23517101-97ec-4772-ab6b-6f626a6547bc for instance with vm_state building and task_state spawning.
Nov 15 04:27:10 user nova-compute[74805]: INFO nova.compute.manager [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Took 5.34 seconds to spawn the instance on the hypervisor.
Nov 15 04:27:10 user nova-compute[74805]: DEBUG nova.compute.manager [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:27:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:27:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:10 user nova-compute[74805]: INFO nova.compute.manager [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Took 17.13 seconds to build instance.
Nov 15 04:27:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f03d4f2f-959d-4b8c-9026-2fc28d0d7da5 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.224s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:27:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6594aaea-3698-4d56-babf-95f9654138f1/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6594aaea-3698-4d56-babf-95f9654138f1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6594aaea-3698-4d56-babf-95f9654138f1/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6594aaea-3698-4d56-babf-95f9654138f1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:12 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:27:12 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:27:12 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:27:12 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:27:12 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:27:12 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:27:12 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=7879MB free_disk=25.26903533935547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:27:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:12 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance d63f3726-27df-455f-bda0-3ddca95b70d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:27:12 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 9f267864-0b72-431d-9b0d-c63436002a4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:27:12 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 6594aaea-3698-4d56-babf-95f9654138f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:27:12 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:27:12 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance fda0e490-03e3-4cf5-b22d-aab83d715616 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:27:12 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 4a2d5475-04a4-414d-9ce9-d5204494f898 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:27:12 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 07831159-aab3-4f4a-8cc9-25d74e254ae2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:27:12 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 38196606-a9c9-4604-ad21-2ec7511a8b28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:27:12 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:27:12 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:27:13 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:27:13 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:27:13 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:27:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.589s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:14 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:27:14 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:27:14 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:27:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-9f267864-0b72-431d-9b0d-c63436002a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:27:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-9f267864-0b72-431d-9b0d-c63436002a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:27:14 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:27:14 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Updating instance_info_cache with network_info: [{"id": "bd5458e6-03d9-4fab-bbfb-23989a82c193", "address": "fa:16:3e:86:87:bc", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5458e6-03", "ovs_interfaceid": "bd5458e6-03d9-4fab-bbfb-23989a82c193", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:27:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-9f267864-0b72-431d-9b0d-c63436002a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:27:14 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:27:14 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:27:14 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:27:14 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:27:14 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:27:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:19 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:27:19 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:27:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f315aa49-6497-453f-b535-f7ffe0653319 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "6594aaea-3698-4d56-babf-95f9654138f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f315aa49-6497-453f-b535-f7ffe0653319 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "6594aaea-3698-4d56-babf-95f9654138f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f315aa49-6497-453f-b535-f7ffe0653319 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "6594aaea-3698-4d56-babf-95f9654138f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f315aa49-6497-453f-b535-f7ffe0653319 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "6594aaea-3698-4d56-babf-95f9654138f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f315aa49-6497-453f-b535-f7ffe0653319 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "6594aaea-3698-4d56-babf-95f9654138f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:20 user nova-compute[74805]: INFO nova.compute.manager [None req-f315aa49-6497-453f-b535-f7ffe0653319 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Terminating instance
Nov 15 04:27:20 user nova-compute[74805]: DEBUG nova.compute.manager [None req-f315aa49-6497-453f-b535-f7ffe0653319 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:27:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:21 user nova-compute[74805]: DEBUG nova.compute.manager [req-f82fbd20-8ab5-4324-abd0-8a9240098ac9 req-8225245c-2daa-4ce8-9eee-fa9e00dfd6f7 service nova] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Received event network-vif-unplugged-dd7dff22-92a5-49fa-a626-381e41aff96e {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f82fbd20-8ab5-4324-abd0-8a9240098ac9 req-8225245c-2daa-4ce8-9eee-fa9e00dfd6f7 service nova] Acquiring lock "6594aaea-3698-4d56-babf-95f9654138f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f82fbd20-8ab5-4324-abd0-8a9240098ac9 req-8225245c-2daa-4ce8-9eee-fa9e00dfd6f7 service nova] Lock "6594aaea-3698-4d56-babf-95f9654138f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f82fbd20-8ab5-4324-abd0-8a9240098ac9 req-8225245c-2daa-4ce8-9eee-fa9e00dfd6f7 service nova] Lock "6594aaea-3698-4d56-babf-95f9654138f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:21 user nova-compute[74805]: DEBUG nova.compute.manager [req-f82fbd20-8ab5-4324-abd0-8a9240098ac9 req-8225245c-2daa-4ce8-9eee-fa9e00dfd6f7 service nova] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] No waiting events found dispatching network-vif-unplugged-dd7dff22-92a5-49fa-a626-381e41aff96e {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:27:21 user nova-compute[74805]: DEBUG nova.compute.manager [req-f82fbd20-8ab5-4324-abd0-8a9240098ac9 req-8225245c-2daa-4ce8-9eee-fa9e00dfd6f7 service nova] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Received event network-vif-unplugged-dd7dff22-92a5-49fa-a626-381e41aff96e for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:27:21 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Instance destroyed successfully.
Nov 15 04:27:21 user nova-compute[74805]: DEBUG nova.objects.instance [None req-f315aa49-6497-453f-b535-f7ffe0653319 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lazy-loading 'resources' on Instance uuid 6594aaea-3698-4d56-babf-95f9654138f1 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:27:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-f315aa49-6497-453f-b535-f7ffe0653319 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:24:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1554897870',display_name='tempest-AttachVolumeNegativeTest-server-1554897870',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1554897870',id=29,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7q1MREnC2oa0490nBsqykazceRuECSy3eb/+EVFi7bhATwCVy9elm/cmDKDyK3aBbUGnuDuTZS/y+VD1Vv3YovVfgWofb6bxIMW0gzq8nJhLJgK0rxBeLiHXxTWIPJ0g==',key_name='tempest-keypair-1555135107',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:24:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8280c6302b2e42998c7c436522c47e79',ramdisk_id='',reservation_id='r-mm5s8exu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-6184130',owner_user_name='tempest-AttachVolumeNegativeTest-6184130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:24:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba1bcf1e429045129d379293cc490bde',uuid=6594aaea-3698-4d56-babf-95f9654138f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd7dff22-92a5-49fa-a626-381e41aff96e", "address": "fa:16:3e:b3:03:ad", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7dff22-92", "ovs_interfaceid": "dd7dff22-92a5-49fa-a626-381e41aff96e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:27:21 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-f315aa49-6497-453f-b535-f7ffe0653319 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Converting VIF {"id": "dd7dff22-92a5-49fa-a626-381e41aff96e", "address": "fa:16:3e:b3:03:ad", "network": {"id": "3454b4d8-1ff9-4f3c-9a93-499645affcab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1976491114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8280c6302b2e42998c7c436522c47e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7dff22-92", "ovs_interfaceid": "dd7dff22-92a5-49fa-a626-381e41aff96e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:27:21 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-f315aa49-6497-453f-b535-f7ffe0653319 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:03:ad,bridge_name='br-int',has_traffic_filtering=True,id=dd7dff22-92a5-49fa-a626-381e41aff96e,network=Network(3454b4d8-1ff9-4f3c-9a93-499645affcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd7dff22-92') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:27:21 user nova-compute[74805]: DEBUG os_vif [None req-f315aa49-6497-453f-b535-f7ffe0653319 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:03:ad,bridge_name='br-int',has_traffic_filtering=True,id=dd7dff22-92a5-49fa-a626-381e41aff96e,network=Network(3454b4d8-1ff9-4f3c-9a93-499645affcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd7dff22-92') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:27:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd7dff22-92, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:27:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=34528be6-6291-4b75-805a-a5c83441c11b) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:27:21 user nova-compute[74805]: INFO os_vif [None req-f315aa49-6497-453f-b535-f7ffe0653319 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:03:ad,bridge_name='br-int',has_traffic_filtering=True,id=dd7dff22-92a5-49fa-a626-381e41aff96e,network=Network(3454b4d8-1ff9-4f3c-9a93-499645affcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd7dff22-92')
Nov 15 04:27:21 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-f315aa49-6497-453f-b535-f7ffe0653319 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Deleting instance files /opt/stack/data/nova/instances/6594aaea-3698-4d56-babf-95f9654138f1_del
Nov 15 04:27:21 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-f315aa49-6497-453f-b535-f7ffe0653319 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Deletion of /opt/stack/data/nova/instances/6594aaea-3698-4d56-babf-95f9654138f1_del complete
Nov 15 04:27:21 user nova-compute[74805]: INFO nova.compute.manager [None req-f315aa49-6497-453f-b535-f7ffe0653319 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 04:27:21 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-f315aa49-6497-453f-b535-f7ffe0653319 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:27:21 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:27:21 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:27:22 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:27:22 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Took 0.75 seconds to deallocate network for instance.
Nov 15 04:27:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-41d19a97-6a21-486d-aceb-eac09f7ebe7d req-cfc45a5a-c3e3-4279-a296-7f600990e9b3 service nova] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Received event network-vif-deleted-dd7dff22-92a5-49fa-a626-381e41aff96e {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f315aa49-6497-453f-b535-f7ffe0653319 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f315aa49-6497-453f-b535-f7ffe0653319 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:22 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-f315aa49-6497-453f-b535-f7ffe0653319 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:27:22 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-f315aa49-6497-453f-b535-f7ffe0653319 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:27:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f315aa49-6497-453f-b535-f7ffe0653319 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.265s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:22 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-f315aa49-6497-453f-b535-f7ffe0653319 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Deleted allocations for instance 6594aaea-3698-4d56-babf-95f9654138f1
Nov 15 04:27:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f315aa49-6497-453f-b535-f7ffe0653319 tempest-AttachVolumeNegativeTest-6184130 tempest-AttachVolumeNegativeTest-6184130-project-member] Lock "6594aaea-3698-4d56-babf-95f9654138f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.057s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:23 user nova-compute[74805]: DEBUG nova.compute.manager [req-049c9530-a85b-40d6-b77c-73e575f3c7d3 req-d3070208-712d-4ec3-80e1-a27210b45f88 service nova] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Received event network-vif-plugged-dd7dff22-92a5-49fa-a626-381e41aff96e {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-049c9530-a85b-40d6-b77c-73e575f3c7d3 req-d3070208-712d-4ec3-80e1-a27210b45f88 service nova] Acquiring lock "6594aaea-3698-4d56-babf-95f9654138f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-049c9530-a85b-40d6-b77c-73e575f3c7d3 req-d3070208-712d-4ec3-80e1-a27210b45f88 service nova] Lock "6594aaea-3698-4d56-babf-95f9654138f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-049c9530-a85b-40d6-b77c-73e575f3c7d3 req-d3070208-712d-4ec3-80e1-a27210b45f88 service nova] Lock "6594aaea-3698-4d56-babf-95f9654138f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:23 user nova-compute[74805]: DEBUG nova.compute.manager [req-049c9530-a85b-40d6-b77c-73e575f3c7d3 req-d3070208-712d-4ec3-80e1-a27210b45f88 service nova] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] No waiting events found dispatching network-vif-plugged-dd7dff22-92a5-49fa-a626-381e41aff96e {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:27:23 user nova-compute[74805]: WARNING nova.compute.manager [req-049c9530-a85b-40d6-b77c-73e575f3c7d3 req-d3070208-712d-4ec3-80e1-a27210b45f88 service nova] [instance: 6594aaea-3698-4d56-babf-95f9654138f1] Received unexpected event network-vif-plugged-dd7dff22-92a5-49fa-a626-381e41aff96e for instance with vm_state deleted and task_state None.
Nov 15 04:27:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Acquiring lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:24 user nova-compute[74805]: INFO nova.compute.manager [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Unshelving
Nov 15 04:27:24 user nova-compute[74805]: INFO nova.virt.block_device [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Booting with volume 44a3adea-ac4e-44f2-935b-9d9c28f70afb at /dev/vda
Nov 15 04:27:24 user nova-compute[74805]: DEBUG os_brick.utils [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:27:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[557d8cba-c0ed-45b8-98a7-3a2aa3e2de0d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e83239e-5dd8-4f80-8c62-bb0bdc172e41]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bd7893-256f-48cb-8627-a59add5b8f9b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8003ba-53c7-45f3-b3a5-29fd1e83e03c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:27:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:27:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:27:24 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:27:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acf3cb0-4a9a-48e0-98c8-31cb99127122]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:27:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:27:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:27:24 user nova-compute[74805]: DEBUG os_brick.utils [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:27:24 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Updating existing volume attachment record: f2dc4e21-cc72-4733-8cf9-68fcb83afc2c {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:27:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:29 user nova-compute[74805]: DEBUG nova.objects.instance [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lazy-loading 'pci_requests' on Instance uuid bc2e6fef-e9b0-4413-ad26-e4a076cb0b49 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:27:29 user nova-compute[74805]: DEBUG nova.objects.instance [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lazy-loading 'numa_topology' on Instance uuid bc2e6fef-e9b0-4413-ad26-e4a076cb0b49 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:27:29 user nova-compute[74805]: DEBUG nova.compute.manager [req-df83611a-5da6-4480-8f8d-189117f035b7 req-fe0df377-249c-4787-8457-87596306a996 service nova] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Received event network-changed-0d0a11b6-25c5-4478-8c6f-40ac41f83b3d {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:29 user nova-compute[74805]: DEBUG nova.compute.manager [req-df83611a-5da6-4480-8f8d-189117f035b7 req-fe0df377-249c-4787-8457-87596306a996 service nova] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Refreshing instance network info cache due to event network-changed-0d0a11b6-25c5-4478-8c6f-40ac41f83b3d. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:27:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-df83611a-5da6-4480-8f8d-189117f035b7 req-fe0df377-249c-4787-8457-87596306a996 service nova] Acquiring lock "refresh_cache-d63f3726-27df-455f-bda0-3ddca95b70d9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:27:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-df83611a-5da6-4480-8f8d-189117f035b7 req-fe0df377-249c-4787-8457-87596306a996 service nova] Acquired lock "refresh_cache-d63f3726-27df-455f-bda0-3ddca95b70d9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:27:29 user nova-compute[74805]: DEBUG nova.network.neutron [req-df83611a-5da6-4480-8f8d-189117f035b7 req-fe0df377-249c-4787-8457-87596306a996 service nova] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Refreshing network info cache for port 0d0a11b6-25c5-4478-8c6f-40ac41f83b3d {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:27:29 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:27:29 user nova-compute[74805]: INFO nova.compute.claims [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Claim successful on node user
Nov 15 04:27:29 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:27:29 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:27:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:29 user nova-compute[74805]: INFO nova.network.neutron [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Updating port b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 04:27:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:30 user nova-compute[74805]: DEBUG nova.network.neutron [req-df83611a-5da6-4480-8f8d-189117f035b7 req-fe0df377-249c-4787-8457-87596306a996 service nova] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Updated VIF entry in instance network info cache for port 0d0a11b6-25c5-4478-8c6f-40ac41f83b3d. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:27:30 user nova-compute[74805]: DEBUG nova.network.neutron [req-df83611a-5da6-4480-8f8d-189117f035b7 req-fe0df377-249c-4787-8457-87596306a996 service nova] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Updating instance_info_cache with network_info: [{"id": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "address": "fa:16:3e:b1:3d:ff", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d0a11b6-25", "ovs_interfaceid": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:27:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-df83611a-5da6-4480-8f8d-189117f035b7 req-fe0df377-249c-4787-8457-87596306a996 service nova] Releasing lock "refresh_cache-d63f3726-27df-455f-bda0-3ddca95b70d9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:27:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Acquiring lock "refresh_cache-bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:27:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Acquired lock "refresh_cache-bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:27:30 user nova-compute[74805]: DEBUG nova.network.neutron [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG nova.network.neutron [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Updating instance_info_cache with network_info: [{"id": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "address": "fa:16:3e:48:b0:09", "network": {"id": "62c3a0d2-d7cf-41dd-adb6-f2331929ee00", "bridge": "br-int", "label": "tempest-TestShelveInstance-1115394549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec78f4baa84125864c0992ecfa6181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5818fba-ad", "ovs_interfaceid": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Releasing lock "refresh_cache-bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:27:31 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Creating image(s)
Nov 15 04:27:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Did not create local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Ensure instance console log exists: /opt/stack/data/nova/instances/bc2e6fef-e9b0-4413-ad26-e4a076cb0b49/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Start _get_guest_xml network_info=[{"id": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "address": "fa:16:3e:48:b0:09", "network": {"id": "62c3a0d2-d7cf-41dd-adb6-f2331929ee00", "bridge": "br-int", "label": "tempest-TestShelveInstance-1115394549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec78f4baa84125864c0992ecfa6181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5818fba-ad", "ovs_interfaceid": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'foiIdAtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bc2e6fef-e9b0-4413-ad26-e4a076cb0b49', 'attached_at': '', 'detached_at': '', 'volume_id': '44a3adea-ac4e-44f2-935b-9d9c28f70afb', 'serial': '44a3adea-ac4e-44f2-935b-9d9c28f70afb'}, 'delete_on_termination': True, 'attachment_id': 'f2dc4e21-cc72-4733-8cf9-68fcb83afc2c', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:27:31 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:27:31 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:27:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG nova.objects.instance [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lazy-loading 'vcpu_model' on Instance uuid bc2e6fef-e9b0-4413-ad26-e4a076cb0b49 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG nova.objects.base [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Object Instance<bc2e6fef-e9b0-4413-ad26-e4a076cb0b49> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'foiIdAtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:27:31 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:27:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:27:31 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:27:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:27:31 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[34920b3d-bca0-45dc-85c9-1988aca1cf31]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:27:31 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb95da34-c4a5-489a-8551-c8d504246ebe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb] added
Nov 15 04:27:31 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3074ffc4-deb5-4e75-b8c6-07f37c72411b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90efb43-73c6-4e6f-b5b4-18006bdf4d1b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v foiIdAtF {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v foiIdAtF" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[926bd71f-f98b-471e-b922-e22b569347c9]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'foiIdAtF'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[373c99a3-a5ba-4d96-a548-50eaff159ff3]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f89402-0b35-40e0-b11d-61d213bf44a3]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:27:31 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:27:31 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:27:31 user nova-compute[74805]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)
Nov 15 04:27:31 user nova-compute[74805]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)
Nov 15 04:27:31 user nova-compute[74805]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:27:31 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:27:31 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:27:31 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:27:31 user nova-compute[74805]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)
Nov 15 04:27:31 user nova-compute[74805]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)
Nov 15 04:27:31 user nova-compute[74805]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:27:31 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b433421d-d0a8-4184-b0d5-3663cd3af877]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb, portal: 172.16.0.220,3260]
Nov 15 04:27:31 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb, portal: 172.16.0.220,3260] successful.
Nov 15 04:27:31 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[211a2a97-0169-4a3e-8a10-2a753d599853]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7baea46-0f8e-45f0-b400-cc2b40e09e05]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:27:31 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:27:31 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:27:31 user nova-compute[74805]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)
Nov 15 04:27:31 user nova-compute[74805]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)
Nov 15 04:27:31 user nova-compute[74805]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:27:31 user nova-compute[74805]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)
Nov 15 04:27:31 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:27:31 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:27:31 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:27:31 user nova-compute[74805]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)
Nov 15 04:27:31 user nova-compute[74805]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)
Nov 15 04:27:31 user nova-compute[74805]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:27:31 user nova-compute[74805]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)
Nov 15 04:27:31 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG nova.compute.manager [req-8c68e0d9-4866-447f-bd28-8076953acc1b req-7efce0ed-3f74-4b45-b729-e9a928302c10 service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Received event network-changed-26c6a394-5344-46d4-abf8-e49600450a07 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG nova.compute.manager [req-8c68e0d9-4866-447f-bd28-8076953acc1b req-7efce0ed-3f74-4b45-b729-e9a928302c10 service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Refreshing instance network info cache due to event network-changed-26c6a394-5344-46d4-abf8-e49600450a07. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8c68e0d9-4866-447f-bd28-8076953acc1b req-7efce0ed-3f74-4b45-b729-e9a928302c10 service nova] Acquiring lock "refresh_cache-fda0e490-03e3-4cf5-b22d-aab83d715616" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8c68e0d9-4866-447f-bd28-8076953acc1b req-7efce0ed-3f74-4b45-b729-e9a928302c10 service nova] Acquired lock "refresh_cache-fda0e490-03e3-4cf5-b22d-aab83d715616" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG nova.network.neutron [req-8c68e0d9-4866-447f-bd28-8076953acc1b req-7efce0ed-3f74-4b45-b729-e9a928302c10 service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Refreshing network info cache for port 26c6a394-5344-46d4-abf8-e49600450a07 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fef8538-bdd3-4077-bd7d-12793737d487]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: None {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG nova.compute.manager [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Stashing vm_state: active {{(pid=74805) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:31 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:27:31 user nova-compute[74805]: INFO nova.compute.claims [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Claim successful on node user
Nov 15 04:27:32 user nova-compute[74805]: INFO nova.compute.resource_tracker [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Updating resource usage from migration 3138f4ce-86c5-4b8e-a7e5-1c9b46e64019
Nov 15 04:27:32 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG nova.network.neutron [req-8c68e0d9-4866-447f-bd28-8076953acc1b req-7efce0ed-3f74-4b45-b729-e9a928302c10 service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Updated VIF entry in instance network info cache for port 26c6a394-5344-46d4-abf8-e49600450a07. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG nova.network.neutron [req-8c68e0d9-4866-447f-bd28-8076953acc1b req-7efce0ed-3f74-4b45-b729-e9a928302c10 service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Updating instance_info_cache with network_info: [{"id": "26c6a394-5344-46d4-abf8-e49600450a07", "address": "fa:16:3e:e3:5f:9a", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c6a394-53", "ovs_interfaceid": "26c6a394-5344-46d4-abf8-e49600450a07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.410s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:32 user nova-compute[74805]: INFO nova.compute.manager [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Migrating
Nov 15 04:27:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8c68e0d9-4866-447f-bd28-8076953acc1b req-7efce0ed-3f74-4b45-b729-e9a928302c10 service nova] Releasing lock "refresh_cache-fda0e490-03e3-4cf5-b22d-aab83d715616" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG nova.compute.manager [req-8c68e0d9-4866-447f-bd28-8076953acc1b req-7efce0ed-3f74-4b45-b729-e9a928302c10 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Received event network-changed-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG nova.compute.manager [req-8c68e0d9-4866-447f-bd28-8076953acc1b req-7efce0ed-3f74-4b45-b729-e9a928302c10 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Refreshing instance network info cache due to event network-changed-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8c68e0d9-4866-447f-bd28-8076953acc1b req-7efce0ed-3f74-4b45-b729-e9a928302c10 service nova] Acquiring lock "refresh_cache-bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8c68e0d9-4866-447f-bd28-8076953acc1b req-7efce0ed-3f74-4b45-b729-e9a928302c10 service nova] Acquired lock "refresh_cache-bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG nova.network.neutron [req-8c68e0d9-4866-447f-bd28-8076953acc1b req-7efce0ed-3f74-4b45-b729-e9a928302c10 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Refreshing network info cache for port b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "refresh_cache-fda0e490-03e3-4cf5-b22d-aab83d715616" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquired lock "refresh_cache-fda0e490-03e3-4cf5-b22d-aab83d715616" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG nova.network.neutron [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'foiIdAtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23563363264333832', 'path': '/dev/sde'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563363264333832', 'path': '/dev/sde'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T04:23:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1631741636',display_name='tempest-TestShelveInstance-server-1631741636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1631741636',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-385247914',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:23:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ffec78f4baa84125864c0992ecfa6181',ramdisk_id='',reservation_id='r-il5y2g8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1222914404',owner_user_name='tempest-TestShelveInstance-1222914404-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:27:24Z,user_data=None,user_id='4de845d5de0a4cc880f29b4a522c81e1',uuid=bc2e6fef-e9b0-4413-ad26-e4a076cb0b49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "address": "fa:16:3e:48:b0:09", "network": {"id": "62c3a0d2-d7cf-41dd-adb6-f2331929ee00", "bridge": "br-int", "label": "tempest-TestShelveInstance-1115394549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec78f4baa84125864c0992ecfa6181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5818fba-ad", "ovs_interfaceid": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Converting VIF {"id": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "address": "fa:16:3e:48:b0:09", "network": {"id": "62c3a0d2-d7cf-41dd-adb6-f2331929ee00", "bridge": "br-int", "label": "tempest-TestShelveInstance-1115394549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec78f4baa84125864c0992ecfa6181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5818fba-ad", "ovs_interfaceid": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:b0:09,bridge_name='br-int',has_traffic_filtering=True,id=b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31,network=Network(62c3a0d2-d7cf-41dd-adb6-f2331929ee00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5818fba-ad') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG nova.objects.instance [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lazy-loading 'pci_devices' on Instance uuid bc2e6fef-e9b0-4413-ad26-e4a076cb0b49 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG nova.objects.base [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Object Instance<bc2e6fef-e9b0-4413-ad26-e4a076cb0b49> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:27:32 user nova-compute[74805]:   <uuid>bc2e6fef-e9b0-4413-ad26-e4a076cb0b49</uuid>
Nov 15 04:27:32 user nova-compute[74805]:   <name>instance-0000001a</name>
Nov 15 04:27:32 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:27:32 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:27:32 user nova-compute[74805]:   <metadata>
Nov 15 04:27:32 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:27:32 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:27:32 user nova-compute[74805]:       <nova:name>tempest-TestShelveInstance-server-1631741636</nova:name>
Nov 15 04:27:32 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:27:31</nova:creationTime>
Nov 15 04:27:32 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:27:32 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:27:32 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:27:32 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:27:32 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:27:32 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:27:32 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:27:32 user nova-compute[74805]:       <nova:owner>
Nov 15 04:27:32 user nova-compute[74805]:         <nova:user uuid="4de845d5de0a4cc880f29b4a522c81e1">tempest-TestShelveInstance-1222914404-project-member</nova:user>
Nov 15 04:27:32 user nova-compute[74805]:         <nova:project uuid="ffec78f4baa84125864c0992ecfa6181">tempest-TestShelveInstance-1222914404</nova:project>
Nov 15 04:27:32 user nova-compute[74805]:       </nova:owner>
Nov 15 04:27:32 user nova-compute[74805]:       <nova:ports>
Nov 15 04:27:32 user nova-compute[74805]:         <nova:port uuid="b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31">
Nov 15 04:27:32 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 04:27:32 user nova-compute[74805]:         </nova:port>
Nov 15 04:27:32 user nova-compute[74805]:       </nova:ports>
Nov 15 04:27:32 user nova-compute[74805]:     </nova:instance>
Nov 15 04:27:32 user nova-compute[74805]:   </metadata>
Nov 15 04:27:32 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:27:32 user nova-compute[74805]:     <system>
Nov 15 04:27:32 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:27:32 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:27:32 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:27:32 user nova-compute[74805]:       <entry name="serial">bc2e6fef-e9b0-4413-ad26-e4a076cb0b49</entry>
Nov 15 04:27:32 user nova-compute[74805]:       <entry name="uuid">bc2e6fef-e9b0-4413-ad26-e4a076cb0b49</entry>
Nov 15 04:27:32 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:27:32 user nova-compute[74805]:     </system>
Nov 15 04:27:32 user nova-compute[74805]:   </sysinfo>
Nov 15 04:27:32 user nova-compute[74805]:   <os>
Nov 15 04:27:32 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:27:32 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:27:32 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:27:32 user nova-compute[74805]:   </os>
Nov 15 04:27:32 user nova-compute[74805]:   <features>
Nov 15 04:27:32 user nova-compute[74805]:     <acpi/>
Nov 15 04:27:32 user nova-compute[74805]:     <apic/>
Nov 15 04:27:32 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:27:32 user nova-compute[74805]:   </features>
Nov 15 04:27:32 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:27:32 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:27:32 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:27:32 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:27:32 user nova-compute[74805]:   </clock>
Nov 15 04:27:32 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:27:32 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:27:32 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:27:32 user nova-compute[74805]:   </cpu>
Nov 15 04:27:32 user nova-compute[74805]:   <devices>
Nov 15 04:27:32 user nova-compute[74805]:     <disk type="block" device="disk">
Nov 15 04:27:32 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:27:32 user nova-compute[74805]:       <source dev="/dev/sde"/>
Nov 15 04:27:32 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:27:32 user nova-compute[74805]:       <serial>44a3adea-ac4e-44f2-935b-9d9c28f70afb</serial>
Nov 15 04:27:32 user nova-compute[74805]:     </disk>
Nov 15 04:27:32 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:27:32 user nova-compute[74805]:       <mac address="fa:16:3e:48:b0:09"/>
Nov 15 04:27:32 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:27:32 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:27:32 user nova-compute[74805]:       <target dev="tapb5818fba-ad"/>
Nov 15 04:27:32 user nova-compute[74805]:     </interface>
Nov 15 04:27:32 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:27:32 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/bc2e6fef-e9b0-4413-ad26-e4a076cb0b49/console.log" append="off"/>
Nov 15 04:27:32 user nova-compute[74805]:     </serial>
Nov 15 04:27:32 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:27:32 user nova-compute[74805]:     <video>
Nov 15 04:27:32 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:27:32 user nova-compute[74805]:     </video>
Nov 15 04:27:32 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:27:32 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:27:32 user nova-compute[74805]:     </rng>
Nov 15 04:27:32 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:27:32 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:27:32 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:27:32 user nova-compute[74805]:     </memballoon>
Nov 15 04:27:32 user nova-compute[74805]:   </devices>
Nov 15 04:27:32 user nova-compute[74805]: </domain>
Nov 15 04:27:32 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T04:23:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1631741636',display_name='tempest-TestShelveInstance-server-1631741636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1631741636',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-385247914',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:23:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ffec78f4baa84125864c0992ecfa6181',ramdisk_id='',reservation_id='r-il5y2g8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1222914404',owner_user_name='tempest-TestShelveInstance-1222914404-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:27:24Z,user_data=None,user_id='4de845d5de0a4cc880f29b4a522c81e1',uuid=bc2e6fef-e9b0-4413-ad26-e4a076cb0b49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "address": "fa:16:3e:48:b0:09", "network": {"id": "62c3a0d2-d7cf-41dd-adb6-f2331929ee00", "bridge": "br-int", "label": "tempest-TestShelveInstance-1115394549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec78f4baa84125864c0992ecfa6181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5818fba-ad", "ovs_interfaceid": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Converting VIF {"id": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "address": "fa:16:3e:48:b0:09", "network": {"id": "62c3a0d2-d7cf-41dd-adb6-f2331929ee00", "bridge": "br-int", "label": "tempest-TestShelveInstance-1115394549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec78f4baa84125864c0992ecfa6181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5818fba-ad", "ovs_interfaceid": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:b0:09,bridge_name='br-int',has_traffic_filtering=True,id=b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31,network=Network(62c3a0d2-d7cf-41dd-adb6-f2331929ee00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5818fba-ad') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG os_vif [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:b0:09,bridge_name='br-int',has_traffic_filtering=True,id=b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31,network=Network(62c3a0d2-d7cf-41dd-adb6-f2331929ee00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5818fba-ad') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '01a2484f-44ad-5a30-b4f4-b813f8c4448e', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5818fba-ad, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb5818fba-ad, col_values=(('qos', UUID('2f5f1dbc-38bb-4b52-b445-6d0f0273d1f5')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb5818fba-ad, col_values=(('external_ids', {'iface-id': 'b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:b0:09', 'vm-uuid': 'bc2e6fef-e9b0-4413-ad26-e4a076cb0b49'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:32 user nova-compute[74805]: INFO os_vif [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:b0:09,bridge_name='br-int',has_traffic_filtering=True,id=b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31,network=Network(62c3a0d2-d7cf-41dd-adb6-f2331929ee00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5818fba-ad')
Nov 15 04:27:32 user nova-compute[74805]: DEBUG nova.network.neutron [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Updating instance_info_cache with network_info: [{"id": "26c6a394-5344-46d4-abf8-e49600450a07", "address": "fa:16:3e:e3:5f:9a", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c6a394-53", "ovs_interfaceid": "26c6a394-5344-46d4-abf8-e49600450a07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] No VIF found with MAC fa:16:3e:48:b0:09, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Releasing lock "refresh_cache-fda0e490-03e3-4cf5-b22d-aab83d715616" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:27:32 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Starting migrate_disk_and_power_off {{(pid=74805) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 15 04:27:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:33 user nova-compute[74805]: DEBUG nova.network.neutron [req-8c68e0d9-4866-447f-bd28-8076953acc1b req-7efce0ed-3f74-4b45-b729-e9a928302c10 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Updated VIF entry in instance network info cache for port b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:27:33 user nova-compute[74805]: DEBUG nova.network.neutron [req-8c68e0d9-4866-447f-bd28-8076953acc1b req-7efce0ed-3f74-4b45-b729-e9a928302c10 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Updating instance_info_cache with network_info: [{"id": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "address": "fa:16:3e:48:b0:09", "network": {"id": "62c3a0d2-d7cf-41dd-adb6-f2331929ee00", "bridge": "br-int", "label": "tempest-TestShelveInstance-1115394549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec78f4baa84125864c0992ecfa6181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5818fba-ad", "ovs_interfaceid": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:27:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8c68e0d9-4866-447f-bd28-8076953acc1b req-7efce0ed-3f74-4b45-b729-e9a928302c10 service nova] Releasing lock "refresh_cache-bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:27:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:34 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Instance destroyed successfully.
Nov 15 04:27:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:25:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-741514273',display_name='tempest-ServerActionsTestOtherA-server-741514273',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-741514273',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGV8yvKXomaZF0BD7dR1o4bDaZdfuwtMvfH2u8DYsuFF6EZbmfxZGzCOIo9eDRbRFMNzHBU8sLiuRkxRud23xuRO+aBfUN0XRumVbmJ/zSOioI/76XwN4XIsuXVKkxna2w==',key_name='tempest-keypair-1041116715',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:25:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6dcdb40f067540dab36661ea0586f1d5',ramdisk_id='',reservation_id='r-7f40nzuc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1623992712',owner_user_name='tempest-ServerActionsTestOtherA-1623992712-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:27:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b6a8eff61f4d6ba2e83d7939143112',uuid=fda0e490-03e3-4cf5-b22d-aab83d715616,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26c6a394-5344-46d4-abf8-e49600450a07", "address": "fa:16:3e:e3:5f:9a", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-490336790-network", "vif_mac": "fa:16:3e:e3:5f:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c6a394-53", "ovs_interfaceid": "26c6a394-5344-46d4-abf8-e49600450a07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converting VIF {"id": "26c6a394-5344-46d4-abf8-e49600450a07", "address": "fa:16:3e:e3:5f:9a", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-490336790-network", "vif_mac": "fa:16:3e:e3:5f:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c6a394-53", "ovs_interfaceid": "26c6a394-5344-46d4-abf8-e49600450a07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:5f:9a,bridge_name='br-int',has_traffic_filtering=True,id=26c6a394-5344-46d4-abf8-e49600450a07,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c6a394-53') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG os_vif [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:5f:9a,bridge_name='br-int',has_traffic_filtering=True,id=26c6a394-5344-46d4-abf8-e49600450a07,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c6a394-53') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26c6a394-53, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=13120ad1-22c2-46d4-bd90-152305e7369e) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:34 user nova-compute[74805]: INFO os_vif [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:5f:9a,bridge_name='br-int',has_traffic_filtering=True,id=26c6a394-5344-46d4-abf8-e49600450a07,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c6a394-53')
Nov 15 04:27:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rBTNyREf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:27:34 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:27:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d8dc5f-61c2-4d2f-98ed-5d57ada06599]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:27:34 user nova-compute[74805]: No targets found.
Nov 15 04:27:34 user nova-compute[74805]: iSNS:
Nov 15 04:27:34 user nova-compute[74805]: No targets found.
Nov 15 04:27:34 user nova-compute[74805]: STATIC:
Nov 15 04:27:34 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745
Nov 15 04:27:34 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:27:34 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:27:34 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb
Nov 15 04:27:34 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:27:34 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:27:34 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f
Nov 15 04:27:34 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:27:34 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:27:34 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83
Nov 15 04:27:34 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:27:34 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:27:34 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf
Nov 15 04:27:34 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:27:34 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:27:34 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13
Nov 15 04:27:34 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:27:34 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:27:34 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312
Nov 15 04:27:34 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:27:34 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:27:34 user nova-compute[74805]: FIRMWARE:
Nov 15 04:27:34 user nova-compute[74805]: No targets found.
Nov 15 04:27:34 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:27:34 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:27:34 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[54909734-1b37-4bda-b4ed-b25dc131d994]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[59909365-2aa0-46e4-930e-a9addc4c95ac]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:27:34 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:27:34 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:27:34 user nova-compute[74805]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)
Nov 15 04:27:34 user nova-compute[74805]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)
Nov 15 04:27:34 user nova-compute[74805]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:27:34 user nova-compute[74805]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)
Nov 15 04:27:34 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:27:34 user nova-compute[74805]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:27:34 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:27:34 user nova-compute[74805]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)
Nov 15 04:27:34 user nova-compute[74805]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)
Nov 15 04:27:34 user nova-compute[74805]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:27:34 user nova-compute[74805]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)
Nov 15 04:27:34 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2fac2015a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83'): ({'sdb'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Removing single pathed devices sdb {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[222c06a7-a236-4c45-b9e3-8c73228e2d75]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3e9a00-fd1f-4609-bda9-690099fdb926]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Flushing IO for device /dev/sdb {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc862ba-a962-4b6c-a9b7-55d642fa2acd]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b85308-aac9-445d-865b-905d1581677c]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14d1cfd-9b98-4692-be3f-3e522862e6a6]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --logout" returned: 0 in 0.098s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8607d07d-0555-4b53-9a67-ab4aa6a2b1ed]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83, portal: 172.16.0.220,3260]
Nov 15 04:27:34 user nova-compute[74805]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83, portal: 172.16.0.220,3260] successful.
Nov 15 04:27:34 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e444667-792a-44e1-88b3-9291dd244746]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] <== disconnect_volume: return (372ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:27:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:27:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Acquiring lock "c4968663-4f4f-4db0-bd2c-278d271b8b35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "c4968663-4f4f-4db0-bd2c-278d271b8b35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:36 user nova-compute[74805]: DEBUG nova.compute.manager [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:27:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:36 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:27:36 user nova-compute[74805]: INFO nova.compute.claims [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Claim successful on node user
Nov 15 04:27:36 user nova-compute[74805]: DEBUG nova.network.neutron [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Port 26c6a394-5344-46d4-abf8-e49600450a07 binding to destination host user is already ACTIVE {{(pid=74805) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 04:27:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "refresh_cache-fda0e490-03e3-4cf5-b22d-aab83d715616" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:27:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquired lock "refresh_cache-fda0e490-03e3-4cf5-b22d-aab83d715616" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:27:36 user nova-compute[74805]: DEBUG nova.network.neutron [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:27:36 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:27:36 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:27:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:36 user nova-compute[74805]: DEBUG nova.compute.manager [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:27:36 user nova-compute[74805]: DEBUG nova.compute.manager [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:27:36 user nova-compute[74805]: DEBUG nova.network.neutron [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:27:36 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:27:36 user nova-compute[74805]: DEBUG nova.compute.manager [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:27:36 user nova-compute[74805]: DEBUG nova.policy [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de8e84dbb0854fdb913c900a34b404bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4790ff8a50a0448ebee83043e2fe764b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:27:36 user nova-compute[74805]: DEBUG nova.compute.manager [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:27:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:27:36 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Creating image(s)
Nov 15 04:27:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Acquiring lock "/opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "/opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "/opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:36 user nova-compute[74805]: DEBUG nova.network.neutron [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Updating instance_info_cache with network_info: [{"id": "26c6a394-5344-46d4-abf8-e49600450a07", "address": "fa:16:3e:e3:5f:9a", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c6a394-53", "ovs_interfaceid": "26c6a394-5344-46d4-abf8-e49600450a07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:27:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Releasing lock "refresh_cache-fda0e490-03e3-4cf5-b22d-aab83d715616" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG os_brick.utils [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbbde80-9e88-488e-9add-54c6e665270d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.180s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.080s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[34368910-d61e-4bc8-a231-4044c57ac46f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8160eba9-c372-4960-8934-28bc0c07f2dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3571f7-a221-44ea-9236-53c517a1b551]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:27:37 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.183s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d700d4-bd92-47cd-9018-324ff6b2d33e]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG os_brick.utils [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] <== get_connector_properties: return (253ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35/disk 1073741824" returned: 0 in 0.064s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG nova.compute.manager [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:27:37 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Instance spawned successfully.
Nov 15 04:27:37 user nova-compute[74805]: DEBUG nova.compute.manager [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-81864bdb-8947-49d7-a8da-4b97e438756e tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.192s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG nova.network.neutron [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Successfully created port: 2c5ba330-8197-41a2-8ab4-d967a03ec2fc {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Cannot resize image /opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Ensure instance console log exists: /opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.network.neutron [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Successfully updated port: 2c5ba330-8197-41a2-8ab4-d967a03ec2fc {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Acquiring lock "refresh_cache-c4968663-4f4f-4db0-bd2c-278d271b8b35" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Acquired lock "refresh_cache-c4968663-4f4f-4db0-bd2c-278d271b8b35" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.network.neutron [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.compute.manager [req-48654e14-b1cc-4467-88f7-547117acfbe8 req-3dc92786-544e-421a-b27b-acac3ac4ee12 service nova] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Received event network-changed-2c5ba330-8197-41a2-8ab4-d967a03ec2fc {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.compute.manager [req-48654e14-b1cc-4467-88f7-547117acfbe8 req-3dc92786-544e-421a-b27b-acac3ac4ee12 service nova] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Refreshing instance network info cache due to event network-changed-2c5ba330-8197-41a2-8ab4-d967a03ec2fc. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-48654e14-b1cc-4467-88f7-547117acfbe8 req-3dc92786-544e-421a-b27b-acac3ac4ee12 service nova] Acquiring lock "refresh_cache-c4968663-4f4f-4db0-bd2c-278d271b8b35" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.network.neutron [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.compute.manager [req-c48169e8-5921-4272-9798-5891ddc18d63 req-00f905f8-e705-4692-9a26-fd7b75517f29 service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Received event network-vif-unplugged-26c6a394-5344-46d4-abf8-e49600450a07 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c48169e8-5921-4272-9798-5891ddc18d63 req-00f905f8-e705-4692-9a26-fd7b75517f29 service nova] Acquiring lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c48169e8-5921-4272-9798-5891ddc18d63 req-00f905f8-e705-4692-9a26-fd7b75517f29 service nova] Lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c48169e8-5921-4272-9798-5891ddc18d63 req-00f905f8-e705-4692-9a26-fd7b75517f29 service nova] Lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.compute.manager [req-c48169e8-5921-4272-9798-5891ddc18d63 req-00f905f8-e705-4692-9a26-fd7b75517f29 service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] No waiting events found dispatching network-vif-unplugged-26c6a394-5344-46d4-abf8-e49600450a07 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:27:38 user nova-compute[74805]: WARNING nova.compute.manager [req-c48169e8-5921-4272-9798-5891ddc18d63 req-00f905f8-e705-4692-9a26-fd7b75517f29 service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Received unexpected event network-vif-unplugged-26c6a394-5344-46d4-abf8-e49600450a07 for instance with vm_state active and task_state resize_finish.
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.network.neutron [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Updating instance_info_cache with network_info: [{"id": "2c5ba330-8197-41a2-8ab4-d967a03ec2fc", "address": "fa:16:3e:66:db:14", "network": {"id": "3948912e-ebae-4493-938d-3cf6366cf59f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1304629230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4790ff8a50a0448ebee83043e2fe764b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c5ba330-81", "ovs_interfaceid": "2c5ba330-8197-41a2-8ab4-d967a03ec2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Releasing lock "refresh_cache-c4968663-4f4f-4db0-bd2c-278d271b8b35" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.compute.manager [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Instance network_info: |[{"id": "2c5ba330-8197-41a2-8ab4-d967a03ec2fc", "address": "fa:16:3e:66:db:14", "network": {"id": "3948912e-ebae-4493-938d-3cf6366cf59f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1304629230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4790ff8a50a0448ebee83043e2fe764b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c5ba330-81", "ovs_interfaceid": "2c5ba330-8197-41a2-8ab4-d967a03ec2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-48654e14-b1cc-4467-88f7-547117acfbe8 req-3dc92786-544e-421a-b27b-acac3ac4ee12 service nova] Acquired lock "refresh_cache-c4968663-4f4f-4db0-bd2c-278d271b8b35" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.network.neutron [req-48654e14-b1cc-4467-88f7-547117acfbe8 req-3dc92786-544e-421a-b27b-acac3ac4ee12 service nova] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Refreshing network info cache for port 2c5ba330-8197-41a2-8ab4-d967a03ec2fc {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Start _get_guest_xml network_info=[{"id": "2c5ba330-8197-41a2-8ab4-d967a03ec2fc", "address": "fa:16:3e:66:db:14", "network": {"id": "3948912e-ebae-4493-938d-3cf6366cf59f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1304629230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4790ff8a50a0448ebee83043e2fe764b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c5ba330-81", "ovs_interfaceid": "2c5ba330-8197-41a2-8ab4-d967a03ec2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:27:38 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:27:38 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:27:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1260660019',display_name='tempest-TestServerVolumeAttachmentScenario-server-1260660019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1260660019',id=34,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtSu5/6pqHRmNrszt7k7zYYiV3vxbfyDlRCX6lJzqnVrsozMJj+mTHNRGxgeD8Z9rYUEo3y8x8GUncUp84hIUWZMuDwfMLae7SR9ybL/WedIX4XMgPO06ehDdgZHbdaQg==',key_name='tempest-keypair-1606383151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4790ff8a50a0448ebee83043e2fe764b',ramdisk_id='',reservation_id='r-w270l28c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1993127584',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1993127584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:27:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de8e84dbb0854fdb913c900a34b404bf',uuid=c4968663-4f4f-4db0-bd2c-278d271b8b35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c5ba330-8197-41a2-8ab4-d967a03ec2fc", "address": "fa:16:3e:66:db:14", "network": {"id": "3948912e-ebae-4493-938d-3cf6366cf59f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1304629230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4790ff8a50a0448ebee83043e2fe764b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c5ba330-81", "ovs_interfaceid": "2c5ba330-8197-41a2-8ab4-d967a03ec2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Converting VIF {"id": "2c5ba330-8197-41a2-8ab4-d967a03ec2fc", "address": "fa:16:3e:66:db:14", "network": {"id": "3948912e-ebae-4493-938d-3cf6366cf59f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1304629230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4790ff8a50a0448ebee83043e2fe764b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c5ba330-81", "ovs_interfaceid": "2c5ba330-8197-41a2-8ab4-d967a03ec2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:db:14,bridge_name='br-int',has_traffic_filtering=True,id=2c5ba330-8197-41a2-8ab4-d967a03ec2fc,network=Network(3948912e-ebae-4493-938d-3cf6366cf59f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c5ba330-81') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.objects.instance [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lazy-loading 'pci_devices' on Instance uuid c4968663-4f4f-4db0-bd2c-278d271b8b35 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:27:38 user nova-compute[74805]:   <uuid>c4968663-4f4f-4db0-bd2c-278d271b8b35</uuid>
Nov 15 04:27:38 user nova-compute[74805]:   <name>instance-00000022</name>
Nov 15 04:27:38 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:27:38 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:27:38 user nova-compute[74805]:   <metadata>
Nov 15 04:27:38 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:27:38 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:27:38 user nova-compute[74805]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1260660019</nova:name>
Nov 15 04:27:38 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:27:38</nova:creationTime>
Nov 15 04:27:38 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:27:38 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:27:38 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:27:38 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:27:38 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:27:38 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:27:38 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:27:38 user nova-compute[74805]:       <nova:owner>
Nov 15 04:27:38 user nova-compute[74805]:         <nova:user uuid="de8e84dbb0854fdb913c900a34b404bf">tempest-TestServerVolumeAttachmentScenario-1993127584-project-member</nova:user>
Nov 15 04:27:38 user nova-compute[74805]:         <nova:project uuid="4790ff8a50a0448ebee83043e2fe764b">tempest-TestServerVolumeAttachmentScenario-1993127584</nova:project>
Nov 15 04:27:38 user nova-compute[74805]:       </nova:owner>
Nov 15 04:27:38 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:27:38 user nova-compute[74805]:       <nova:ports>
Nov 15 04:27:38 user nova-compute[74805]:         <nova:port uuid="2c5ba330-8197-41a2-8ab4-d967a03ec2fc">
Nov 15 04:27:38 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 04:27:38 user nova-compute[74805]:         </nova:port>
Nov 15 04:27:38 user nova-compute[74805]:       </nova:ports>
Nov 15 04:27:38 user nova-compute[74805]:     </nova:instance>
Nov 15 04:27:38 user nova-compute[74805]:   </metadata>
Nov 15 04:27:38 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:27:38 user nova-compute[74805]:     <system>
Nov 15 04:27:38 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:27:38 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:27:38 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:27:38 user nova-compute[74805]:       <entry name="serial">c4968663-4f4f-4db0-bd2c-278d271b8b35</entry>
Nov 15 04:27:38 user nova-compute[74805]:       <entry name="uuid">c4968663-4f4f-4db0-bd2c-278d271b8b35</entry>
Nov 15 04:27:38 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:27:38 user nova-compute[74805]:     </system>
Nov 15 04:27:38 user nova-compute[74805]:   </sysinfo>
Nov 15 04:27:38 user nova-compute[74805]:   <os>
Nov 15 04:27:38 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:27:38 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:27:38 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:27:38 user nova-compute[74805]:   </os>
Nov 15 04:27:38 user nova-compute[74805]:   <features>
Nov 15 04:27:38 user nova-compute[74805]:     <acpi/>
Nov 15 04:27:38 user nova-compute[74805]:     <apic/>
Nov 15 04:27:38 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:27:38 user nova-compute[74805]:   </features>
Nov 15 04:27:38 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:27:38 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:27:38 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:27:38 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:27:38 user nova-compute[74805]:   </clock>
Nov 15 04:27:38 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:27:38 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:27:38 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:27:38 user nova-compute[74805]:   </cpu>
Nov 15 04:27:38 user nova-compute[74805]:   <devices>
Nov 15 04:27:38 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:27:38 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:27:38 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35/disk"/>
Nov 15 04:27:38 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:27:38 user nova-compute[74805]:     </disk>
Nov 15 04:27:38 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:27:38 user nova-compute[74805]:       <mac address="fa:16:3e:66:db:14"/>
Nov 15 04:27:38 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:27:38 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:27:38 user nova-compute[74805]:       <target dev="tap2c5ba330-81"/>
Nov 15 04:27:38 user nova-compute[74805]:     </interface>
Nov 15 04:27:38 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:27:38 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35/console.log" append="off"/>
Nov 15 04:27:38 user nova-compute[74805]:     </serial>
Nov 15 04:27:38 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:27:38 user nova-compute[74805]:     <video>
Nov 15 04:27:38 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:27:38 user nova-compute[74805]:     </video>
Nov 15 04:27:38 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:27:38 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:27:38 user nova-compute[74805]:     </rng>
Nov 15 04:27:38 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:27:38 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:27:38 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:27:38 user nova-compute[74805]:     </memballoon>
Nov 15 04:27:38 user nova-compute[74805]:   </devices>
Nov 15 04:27:38 user nova-compute[74805]: </domain>
Nov 15 04:27:38 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:27:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1260660019',display_name='tempest-TestServerVolumeAttachmentScenario-server-1260660019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1260660019',id=34,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtSu5/6pqHRmNrszt7k7zYYiV3vxbfyDlRCX6lJzqnVrsozMJj+mTHNRGxgeD8Z9rYUEo3y8x8GUncUp84hIUWZMuDwfMLae7SR9ybL/WedIX4XMgPO06ehDdgZHbdaQg==',key_name='tempest-keypair-1606383151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4790ff8a50a0448ebee83043e2fe764b',ramdisk_id='',reservation_id='r-w270l28c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1993127584',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1993127584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:27:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de8e84dbb0854fdb913c900a34b404bf',uuid=c4968663-4f4f-4db0-bd2c-278d271b8b35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c5ba330-8197-41a2-8ab4-d967a03ec2fc", "address": "fa:16:3e:66:db:14", "network": {"id": "3948912e-ebae-4493-938d-3cf6366cf59f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1304629230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4790ff8a50a0448ebee83043e2fe764b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c5ba330-81", "ovs_interfaceid": "2c5ba330-8197-41a2-8ab4-d967a03ec2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Converting VIF {"id": "2c5ba330-8197-41a2-8ab4-d967a03ec2fc", "address": "fa:16:3e:66:db:14", "network": {"id": "3948912e-ebae-4493-938d-3cf6366cf59f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1304629230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4790ff8a50a0448ebee83043e2fe764b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c5ba330-81", "ovs_interfaceid": "2c5ba330-8197-41a2-8ab4-d967a03ec2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:db:14,bridge_name='br-int',has_traffic_filtering=True,id=2c5ba330-8197-41a2-8ab4-d967a03ec2fc,network=Network(3948912e-ebae-4493-938d-3cf6366cf59f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c5ba330-81') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG os_vif [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:db:14,bridge_name='br-int',has_traffic_filtering=True,id=2c5ba330-8197-41a2-8ab4-d967a03ec2fc,network=Network(3948912e-ebae-4493-938d-3cf6366cf59f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c5ba330-81') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c6cf3837-b0af-55da-8028-7023da2eb588', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c5ba330-81, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c5ba330-81, col_values=(('qos', UUID('7842d5e6-bdbe-4f7d-86f0-e25a2f765bb6')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c5ba330-81, col_values=(('external_ids', {'iface-id': '2c5ba330-8197-41a2-8ab4-d967a03ec2fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:db:14', 'vm-uuid': 'c4968663-4f4f-4db0-bd2c-278d271b8b35'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:38 user nova-compute[74805]: INFO os_vif [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:db:14,bridge_name='br-int',has_traffic_filtering=True,id=2c5ba330-8197-41a2-8ab4-d967a03ec2fc,network=Network(3948912e-ebae-4493-938d-3cf6366cf59f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c5ba330-81')
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:27:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] No VIF found with MAC fa:16:3e:66:db:14, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:27:39 user nova-compute[74805]: DEBUG nova.network.neutron [req-48654e14-b1cc-4467-88f7-547117acfbe8 req-3dc92786-544e-421a-b27b-acac3ac4ee12 service nova] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Updated VIF entry in instance network info cache for port 2c5ba330-8197-41a2-8ab4-d967a03ec2fc. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:27:39 user nova-compute[74805]: DEBUG nova.network.neutron [req-48654e14-b1cc-4467-88f7-547117acfbe8 req-3dc92786-544e-421a-b27b-acac3ac4ee12 service nova] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Updating instance_info_cache with network_info: [{"id": "2c5ba330-8197-41a2-8ab4-d967a03ec2fc", "address": "fa:16:3e:66:db:14", "network": {"id": "3948912e-ebae-4493-938d-3cf6366cf59f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1304629230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4790ff8a50a0448ebee83043e2fe764b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c5ba330-81", "ovs_interfaceid": "2c5ba330-8197-41a2-8ab4-d967a03ec2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:27:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-48654e14-b1cc-4467-88f7-547117acfbe8 req-3dc92786-544e-421a-b27b-acac3ac4ee12 service nova] Releasing lock "refresh_cache-c4968663-4f4f-4db0-bd2c-278d271b8b35" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:27:39 user nova-compute[74805]: DEBUG nova.compute.manager [None req-1c8f4e70-54d4-4e0b-bb33-e0c2eccefd0b tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:27:39 user nova-compute[74805]: INFO nova.compute.manager [None req-1c8f4e70-54d4-4e0b-bb33-e0c2eccefd0b tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] instance snapshotting
Nov 15 04:27:39 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-1c8f4e70-54d4-4e0b-bb33-e0c2eccefd0b tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Beginning live snapshot process
Nov 15 04:27:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1c8f4e70-54d4-4e0b-bb33-e0c2eccefd0b tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json -f qcow2 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1c8f4e70-54d4-4e0b-bb33-e0c2eccefd0b tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1c8f4e70-54d4-4e0b-bb33-e0c2eccefd0b tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json -f qcow2 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1c8f4e70-54d4-4e0b-bb33-e0c2eccefd0b tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1c8f4e70-54d4-4e0b-bb33-e0c2eccefd0b tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1c8f4e70-54d4-4e0b-bb33-e0c2eccefd0b tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.184s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1c8f4e70-54d4-4e0b-bb33-e0c2eccefd0b tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpepx0w4nq/e2bd9c81c7ef4a88964cacc54135ec87.delta 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1c8f4e70-54d4-4e0b-bb33-e0c2eccefd0b tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpepx0w4nq/e2bd9c81c7ef4a88964cacc54135ec87.delta 1073741824" returned: 0 in 0.069s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:40 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-1c8f4e70-54d4-4e0b-bb33-e0c2eccefd0b tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 04:27:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:40 user nova-compute[74805]: DEBUG nova.compute.manager [req-6ef356a5-2d23-4f3b-b6e5-45fa69031314 req-2a36af6f-b060-4a76-9044-480115e2a57e service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Received event network-vif-plugged-26c6a394-5344-46d4-abf8-e49600450a07 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6ef356a5-2d23-4f3b-b6e5-45fa69031314 req-2a36af6f-b060-4a76-9044-480115e2a57e service nova] Acquiring lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6ef356a5-2d23-4f3b-b6e5-45fa69031314 req-2a36af6f-b060-4a76-9044-480115e2a57e service nova] Lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6ef356a5-2d23-4f3b-b6e5-45fa69031314 req-2a36af6f-b060-4a76-9044-480115e2a57e service nova] Lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:40 user nova-compute[74805]: DEBUG nova.compute.manager [req-6ef356a5-2d23-4f3b-b6e5-45fa69031314 req-2a36af6f-b060-4a76-9044-480115e2a57e service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] No waiting events found dispatching network-vif-plugged-26c6a394-5344-46d4-abf8-e49600450a07 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:27:40 user nova-compute[74805]: WARNING nova.compute.manager [req-6ef356a5-2d23-4f3b-b6e5-45fa69031314 req-2a36af6f-b060-4a76-9044-480115e2a57e service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Received unexpected event network-vif-plugged-26c6a394-5344-46d4-abf8-e49600450a07 for instance with vm_state active and task_state resize_finish.
Nov 15 04:27:40 user nova-compute[74805]: DEBUG nova.compute.manager [req-6ef356a5-2d23-4f3b-b6e5-45fa69031314 req-2a36af6f-b060-4a76-9044-480115e2a57e service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Received event network-vif-plugged-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6ef356a5-2d23-4f3b-b6e5-45fa69031314 req-2a36af6f-b060-4a76-9044-480115e2a57e service nova] Acquiring lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6ef356a5-2d23-4f3b-b6e5-45fa69031314 req-2a36af6f-b060-4a76-9044-480115e2a57e service nova] Lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6ef356a5-2d23-4f3b-b6e5-45fa69031314 req-2a36af6f-b060-4a76-9044-480115e2a57e service nova] Lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:40 user nova-compute[74805]: DEBUG nova.compute.manager [req-6ef356a5-2d23-4f3b-b6e5-45fa69031314 req-2a36af6f-b060-4a76-9044-480115e2a57e service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] No waiting events found dispatching network-vif-plugged-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:27:40 user nova-compute[74805]: WARNING nova.compute.manager [req-6ef356a5-2d23-4f3b-b6e5-45fa69031314 req-2a36af6f-b060-4a76-9044-480115e2a57e service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Received unexpected event network-vif-plugged-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 for instance with vm_state active and task_state None.
Nov 15 04:27:40 user nova-compute[74805]: DEBUG nova.compute.manager [req-6ef356a5-2d23-4f3b-b6e5-45fa69031314 req-2a36af6f-b060-4a76-9044-480115e2a57e service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Received event network-vif-plugged-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6ef356a5-2d23-4f3b-b6e5-45fa69031314 req-2a36af6f-b060-4a76-9044-480115e2a57e service nova] Acquiring lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6ef356a5-2d23-4f3b-b6e5-45fa69031314 req-2a36af6f-b060-4a76-9044-480115e2a57e service nova] Lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6ef356a5-2d23-4f3b-b6e5-45fa69031314 req-2a36af6f-b060-4a76-9044-480115e2a57e service nova] Lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:40 user nova-compute[74805]: DEBUG nova.compute.manager [req-6ef356a5-2d23-4f3b-b6e5-45fa69031314 req-2a36af6f-b060-4a76-9044-480115e2a57e service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] No waiting events found dispatching network-vif-plugged-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:27:40 user nova-compute[74805]: WARNING nova.compute.manager [req-6ef356a5-2d23-4f3b-b6e5-45fa69031314 req-2a36af6f-b060-4a76-9044-480115e2a57e service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Received unexpected event network-vif-plugged-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 for instance with vm_state active and task_state None.
Nov 15 04:27:40 user nova-compute[74805]: DEBUG nova.compute.manager [req-6ef356a5-2d23-4f3b-b6e5-45fa69031314 req-2a36af6f-b060-4a76-9044-480115e2a57e service nova] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Received event network-vif-plugged-2c5ba330-8197-41a2-8ab4-d967a03ec2fc {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6ef356a5-2d23-4f3b-b6e5-45fa69031314 req-2a36af6f-b060-4a76-9044-480115e2a57e service nova] Acquiring lock "c4968663-4f4f-4db0-bd2c-278d271b8b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6ef356a5-2d23-4f3b-b6e5-45fa69031314 req-2a36af6f-b060-4a76-9044-480115e2a57e service nova] Lock "c4968663-4f4f-4db0-bd2c-278d271b8b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6ef356a5-2d23-4f3b-b6e5-45fa69031314 req-2a36af6f-b060-4a76-9044-480115e2a57e service nova] Lock "c4968663-4f4f-4db0-bd2c-278d271b8b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:40 user nova-compute[74805]: DEBUG nova.compute.manager [req-6ef356a5-2d23-4f3b-b6e5-45fa69031314 req-2a36af6f-b060-4a76-9044-480115e2a57e service nova] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] No waiting events found dispatching network-vif-plugged-2c5ba330-8197-41a2-8ab4-d967a03ec2fc {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:27:40 user nova-compute[74805]: WARNING nova.compute.manager [req-6ef356a5-2d23-4f3b-b6e5-45fa69031314 req-2a36af6f-b060-4a76-9044-480115e2a57e service nova] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Received unexpected event network-vif-plugged-2c5ba330-8197-41a2-8ab4-d967a03ec2fc for instance with vm_state building and task_state spawning.
Nov 15 04:27:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-1c8f4e70-54d4-4e0b-bb33-e0c2eccefd0b tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] COPY block job progress, current cursor: 65536 final cursor: 75563008 {{(pid=74805) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 04:27:41 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-1c8f4e70-54d4-4e0b-bb33-e0c2eccefd0b tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74805) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 04:27:41 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-1c8f4e70-54d4-4e0b-bb33-e0c2eccefd0b tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 04:27:41 user nova-compute[74805]: DEBUG nova.privsep.utils [None req-1c8f4e70-54d4-4e0b-bb33-e0c2eccefd0b tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74805) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 04:27:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1c8f4e70-54d4-4e0b-bb33-e0c2eccefd0b tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpepx0w4nq/e2bd9c81c7ef4a88964cacc54135ec87.delta /opt/stack/data/nova/instances/snapshots/tmpepx0w4nq/e2bd9c81c7ef4a88964cacc54135ec87 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1c8f4e70-54d4-4e0b-bb33-e0c2eccefd0b tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpepx0w4nq/e2bd9c81c7ef4a88964cacc54135ec87.delta /opt/stack/data/nova/instances/snapshots/tmpepx0w4nq/e2bd9c81c7ef4a88964cacc54135ec87" returned: 0 in 0.605s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:42 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-1c8f4e70-54d4-4e0b-bb33-e0c2eccefd0b tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Snapshot extracted, beginning image upload
Nov 15 04:27:42 user nova-compute[74805]: DEBUG nova.compute.manager [req-90701cc3-b06e-498e-943e-861c6f6fa26e req-8200eba6-3c3a-4648-bdb6-16f5c5481134 service nova] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Received event network-vif-plugged-2c5ba330-8197-41a2-8ab4-d967a03ec2fc {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-90701cc3-b06e-498e-943e-861c6f6fa26e req-8200eba6-3c3a-4648-bdb6-16f5c5481134 service nova] Acquiring lock "c4968663-4f4f-4db0-bd2c-278d271b8b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-90701cc3-b06e-498e-943e-861c6f6fa26e req-8200eba6-3c3a-4648-bdb6-16f5c5481134 service nova] Lock "c4968663-4f4f-4db0-bd2c-278d271b8b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-90701cc3-b06e-498e-943e-861c6f6fa26e req-8200eba6-3c3a-4648-bdb6-16f5c5481134 service nova] Lock "c4968663-4f4f-4db0-bd2c-278d271b8b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG nova.compute.manager [req-90701cc3-b06e-498e-943e-861c6f6fa26e req-8200eba6-3c3a-4648-bdb6-16f5c5481134 service nova] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] No waiting events found dispatching network-vif-plugged-2c5ba330-8197-41a2-8ab4-d967a03ec2fc {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:27:42 user nova-compute[74805]: WARNING nova.compute.manager [req-90701cc3-b06e-498e-943e-861c6f6fa26e req-8200eba6-3c3a-4648-bdb6-16f5c5481134 service nova] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Received unexpected event network-vif-plugged-2c5ba330-8197-41a2-8ab4-d967a03ec2fc for instance with vm_state building and task_state spawning.
Nov 15 04:27:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Starting finish_migration {{(pid=74805) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Instance directory exists: not creating {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 04:27:42 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Creating image(s)
Nov 15 04:27:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Did not create local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Ensure instance console log exists: /opt/stack/data/nova/instances/fda0e490-03e3-4cf5-b22d-aab83d715616/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Start _get_guest_xml network_info=[{"id": "26c6a394-5344-46d4-abf8-e49600450a07", "address": "fa:16:3e:e3:5f:9a", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-490336790-network", "vif_mac": "fa:16:3e:e3:5f:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c6a394-53", "ovs_interfaceid": "26c6a394-5344-46d4-abf8-e49600450a07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rBTNyREf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'fda0e490-03e3-4cf5-b22d-aab83d715616', 'attached_at': '2023-11-15T04:27:43.000000', 'detached_at': '', 'volume_id': 'bdf88a15-d65a-43d6-aea2-07c232ecfd83', 'serial': 'bdf88a15-d65a-43d6-aea2-07c232ecfd83'}, 'delete_on_termination': True, 'attachment_id': '5eb9b3e2-692a-4e9b-8e8c-d108ea26c077', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:27:42 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:27:42 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:27:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:17Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rBTNyREf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:27:42 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:27:42 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:27:42 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:27:42 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:27:42 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:27:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3feb2f7e-0ac0-4a2b-8402-4c23eb247fce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:27:42 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9e798f-9d40-403b-8a2f-f4d06ec7e0b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83] added
Nov 15 04:27:42 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[147e52f2-a3bd-4d1e-8d87-e0998f21eaf5]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[22852e37-e370-4375-bdf3-e0b8d4c60d4a]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rBTNyREf {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rBTNyREf" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[076d5ed2-c87d-40ad-9175-2f6f7115875b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rBTNyREf'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[61566925-4423-4c59-be69-bec551f8fa35]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ebaaf0-0212-487f-a3fe-7ab3fe90f817]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:27:42 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:27:42 user nova-compute[74805]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)
Nov 15 04:27:42 user nova-compute[74805]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)
Nov 15 04:27:42 user nova-compute[74805]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:27:42 user nova-compute[74805]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)
Nov 15 04:27:42 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:27:42 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:27:42 user nova-compute[74805]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)
Nov 15 04:27:42 user nova-compute[74805]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)
Nov 15 04:27:42 user nova-compute[74805]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:27:42 user nova-compute[74805]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)
Nov 15 04:27:42 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:27:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e962feb-182d-4b9e-bc32-7fbb5c55f8dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83, portal: 172.16.0.220,3260]
Nov 15 04:27:43 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83, portal: 172.16.0.220,3260] successful.
Nov 15 04:27:43 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1a6440-a92f-4414-8be3-c8e1c347b3e1]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f1d5e0-5cbb-46a4-8b3e-91f582e591a4]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:27:43 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:27:43 user nova-compute[74805]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)
Nov 15 04:27:43 user nova-compute[74805]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)
Nov 15 04:27:43 user nova-compute[74805]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:27:43 user nova-compute[74805]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)
Nov 15 04:27:43 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:27:43 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:27:43 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:27:43 user nova-compute[74805]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)
Nov 15 04:27:43 user nova-compute[74805]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)
Nov 15 04:27:43 user nova-compute[74805]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:27:43 user nova-compute[74805]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)
Nov 15 04:27:43 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:27:43 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a78f04-2e89-4d83-845f-644bc3a776e1]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rBTNyREf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG nova.compute.manager [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:27:43 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Instance spawned successfully.
Nov 15 04:27:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:27:43 user nova-compute[74805]: INFO nova.compute.manager [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Took 6.67 seconds to spawn the instance on the hypervisor.
Nov 15 04:27:43 user nova-compute[74805]: DEBUG nova.compute.manager [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:27:43 user nova-compute[74805]: INFO nova.compute.manager [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Took 7.47 seconds to build instance.
Nov 15 04:27:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a888c6d3-6f37-4a4c-b1a6-b57cc1608595 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "c4968663-4f4f-4db0-bd2c-278d271b8b35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.626s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:27:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '26338356166633835', 'path': '/dev/sdb'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:27:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338356166633835', 'path': '/dev/sdb'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:27:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:25:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-741514273',display_name='tempest-ServerActionsTestOtherA-server-741514273',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-741514273',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGV8yvKXomaZF0BD7dR1o4bDaZdfuwtMvfH2u8DYsuFF6EZbmfxZGzCOIo9eDRbRFMNzHBU8sLiuRkxRud23xuRO+aBfUN0XRumVbmJ/zSOioI/76XwN4XIsuXVKkxna2w==',key_name='tempest-keypair-1041116715',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:25:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6dcdb40f067540dab36661ea0586f1d5',ramdisk_id='',reservation_id='r-7f40nzuc',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1623992712',owner_user_name='tempest-ServerActionsTestOtherA-1623992712-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:27:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b6a8eff61f4d6ba2e83d7939143112',uuid=fda0e490-03e3-4cf5-b22d-aab83d715616,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26c6a394-5344-46d4-abf8-e49600450a07", "address": "fa:16:3e:e3:5f:9a", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-490336790-network", "vif_mac": "fa:16:3e:e3:5f:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c6a394-53", "ovs_interfaceid": "26c6a394-5344-46d4-abf8-e49600450a07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:27:44 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converting VIF {"id": "26c6a394-5344-46d4-abf8-e49600450a07", "address": "fa:16:3e:e3:5f:9a", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-490336790-network", "vif_mac": "fa:16:3e:e3:5f:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c6a394-53", "ovs_interfaceid": "26c6a394-5344-46d4-abf8-e49600450a07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:27:44 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:5f:9a,bridge_name='br-int',has_traffic_filtering=True,id=26c6a394-5344-46d4-abf8-e49600450a07,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c6a394-53') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:27:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:27:44 user nova-compute[74805]:   <uuid>fda0e490-03e3-4cf5-b22d-aab83d715616</uuid>
Nov 15 04:27:44 user nova-compute[74805]:   <name>instance-0000001f</name>
Nov 15 04:27:44 user nova-compute[74805]:   <memory>2097152</memory>
Nov 15 04:27:44 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:27:44 user nova-compute[74805]:   <metadata>
Nov 15 04:27:44 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:27:44 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:27:44 user nova-compute[74805]:       <nova:name>tempest-ServerActionsTestOtherA-server-741514273</nova:name>
Nov 15 04:27:44 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:27:42</nova:creationTime>
Nov 15 04:27:44 user nova-compute[74805]:       <nova:flavor name="m1.small">
Nov 15 04:27:44 user nova-compute[74805]:         <nova:memory>2048</nova:memory>
Nov 15 04:27:44 user nova-compute[74805]:         <nova:disk>20</nova:disk>
Nov 15 04:27:44 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:27:44 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:27:44 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:27:44 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:27:44 user nova-compute[74805]:       <nova:owner>
Nov 15 04:27:44 user nova-compute[74805]:         <nova:user uuid="d0b6a8eff61f4d6ba2e83d7939143112">tempest-ServerActionsTestOtherA-1623992712-project-member</nova:user>
Nov 15 04:27:44 user nova-compute[74805]:         <nova:project uuid="6dcdb40f067540dab36661ea0586f1d5">tempest-ServerActionsTestOtherA-1623992712</nova:project>
Nov 15 04:27:44 user nova-compute[74805]:       </nova:owner>
Nov 15 04:27:44 user nova-compute[74805]:       <nova:ports>
Nov 15 04:27:44 user nova-compute[74805]:         <nova:port uuid="26c6a394-5344-46d4-abf8-e49600450a07">
Nov 15 04:27:44 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 04:27:44 user nova-compute[74805]:         </nova:port>
Nov 15 04:27:44 user nova-compute[74805]:       </nova:ports>
Nov 15 04:27:44 user nova-compute[74805]:     </nova:instance>
Nov 15 04:27:44 user nova-compute[74805]:   </metadata>
Nov 15 04:27:44 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:27:44 user nova-compute[74805]:     <system>
Nov 15 04:27:44 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:27:44 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:27:44 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:27:44 user nova-compute[74805]:       <entry name="serial">fda0e490-03e3-4cf5-b22d-aab83d715616</entry>
Nov 15 04:27:44 user nova-compute[74805]:       <entry name="uuid">fda0e490-03e3-4cf5-b22d-aab83d715616</entry>
Nov 15 04:27:44 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:27:44 user nova-compute[74805]:     </system>
Nov 15 04:27:44 user nova-compute[74805]:   </sysinfo>
Nov 15 04:27:44 user nova-compute[74805]:   <os>
Nov 15 04:27:44 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:27:44 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:27:44 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:27:44 user nova-compute[74805]:   </os>
Nov 15 04:27:44 user nova-compute[74805]:   <features>
Nov 15 04:27:44 user nova-compute[74805]:     <acpi/>
Nov 15 04:27:44 user nova-compute[74805]:     <apic/>
Nov 15 04:27:44 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:27:44 user nova-compute[74805]:   </features>
Nov 15 04:27:44 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:27:44 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:27:44 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:27:44 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:27:44 user nova-compute[74805]:   </clock>
Nov 15 04:27:44 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:27:44 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:27:44 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:27:44 user nova-compute[74805]:   </cpu>
Nov 15 04:27:44 user nova-compute[74805]:   <devices>
Nov 15 04:27:44 user nova-compute[74805]:     <disk type="block" device="disk">
Nov 15 04:27:44 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:27:44 user nova-compute[74805]:       <source dev="/dev/sdb"/>
Nov 15 04:27:44 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:27:44 user nova-compute[74805]:       <serial>bdf88a15-d65a-43d6-aea2-07c232ecfd83</serial>
Nov 15 04:27:44 user nova-compute[74805]:     </disk>
Nov 15 04:27:44 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:27:44 user nova-compute[74805]:       <mac address="fa:16:3e:e3:5f:9a"/>
Nov 15 04:27:44 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:27:44 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:27:44 user nova-compute[74805]:       <target dev="tap26c6a394-53"/>
Nov 15 04:27:44 user nova-compute[74805]:     </interface>
Nov 15 04:27:44 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:27:44 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/fda0e490-03e3-4cf5-b22d-aab83d715616/console.log" append="off"/>
Nov 15 04:27:44 user nova-compute[74805]:     </serial>
Nov 15 04:27:44 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:27:44 user nova-compute[74805]:     <video>
Nov 15 04:27:44 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:27:44 user nova-compute[74805]:     </video>
Nov 15 04:27:44 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:27:44 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:27:44 user nova-compute[74805]:     </rng>
Nov 15 04:27:44 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:27:44 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:27:44 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:27:44 user nova-compute[74805]:     </memballoon>
Nov 15 04:27:44 user nova-compute[74805]:   </devices>
Nov 15 04:27:44 user nova-compute[74805]: </domain>
Nov 15 04:27:44 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:27:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:25:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-741514273',display_name='tempest-ServerActionsTestOtherA-server-741514273',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-741514273',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGV8yvKXomaZF0BD7dR1o4bDaZdfuwtMvfH2u8DYsuFF6EZbmfxZGzCOIo9eDRbRFMNzHBU8sLiuRkxRud23xuRO+aBfUN0XRumVbmJ/zSOioI/76XwN4XIsuXVKkxna2w==',key_name='tempest-keypair-1041116715',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:25:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6dcdb40f067540dab36661ea0586f1d5',ramdisk_id='',reservation_id='r-7f40nzuc',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1623992712',owner_user_name='tempest-ServerActionsTestOtherA-1623992712-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:27:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b6a8eff61f4d6ba2e83d7939143112',uuid=fda0e490-03e3-4cf5-b22d-aab83d715616,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26c6a394-5344-46d4-abf8-e49600450a07", "address": "fa:16:3e:e3:5f:9a", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-490336790-network", "vif_mac": "fa:16:3e:e3:5f:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c6a394-53", "ovs_interfaceid": "26c6a394-5344-46d4-abf8-e49600450a07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:27:44 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converting VIF {"id": "26c6a394-5344-46d4-abf8-e49600450a07", "address": "fa:16:3e:e3:5f:9a", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-490336790-network", "vif_mac": "fa:16:3e:e3:5f:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c6a394-53", "ovs_interfaceid": "26c6a394-5344-46d4-abf8-e49600450a07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:27:44 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:5f:9a,bridge_name='br-int',has_traffic_filtering=True,id=26c6a394-5344-46d4-abf8-e49600450a07,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c6a394-53') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:27:44 user nova-compute[74805]: DEBUG os_vif [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:5f:9a,bridge_name='br-int',has_traffic_filtering=True,id=26c6a394-5344-46d4-abf8-e49600450a07,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c6a394-53') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:27:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:27:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6819de47-e976-5cb5-a9d8-ee48066962d0', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:27:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26c6a394-53, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26c6a394-53, col_values=(('qos', UUID('20fdf42e-4043-48a5-8cc1-2fac026cdbcb')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26c6a394-53, col_values=(('external_ids', {'iface-id': '26c6a394-5344-46d4-abf8-e49600450a07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:5f:9a', 'vm-uuid': 'fda0e490-03e3-4cf5-b22d-aab83d715616'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:27:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:44 user nova-compute[74805]: INFO os_vif [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:5f:9a,bridge_name='br-int',has_traffic_filtering=True,id=26c6a394-5344-46d4-abf8-e49600450a07,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c6a394-53')
Nov 15 04:27:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:27:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] No VIF found with MAC fa:16:3e:e3:5f:9a, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:27:44 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-1c8f4e70-54d4-4e0b-bb33-e0c2eccefd0b tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Snapshot image upload complete
Nov 15 04:27:44 user nova-compute[74805]: INFO nova.compute.manager [None req-1c8f4e70-54d4-4e0b-bb33-e0c2eccefd0b tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Took 5.82 seconds to snapshot the instance on the hypervisor.
Nov 15 04:27:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-876f4719-401e-4459-bbe6-650358c4a106 req-72744613-f3c9-4941-99b8-77e9e6589ce4 service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Received event network-vif-plugged-26c6a394-5344-46d4-abf8-e49600450a07 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-876f4719-401e-4459-bbe6-650358c4a106 req-72744613-f3c9-4941-99b8-77e9e6589ce4 service nova] Acquiring lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-876f4719-401e-4459-bbe6-650358c4a106 req-72744613-f3c9-4941-99b8-77e9e6589ce4 service nova] Lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-876f4719-401e-4459-bbe6-650358c4a106 req-72744613-f3c9-4941-99b8-77e9e6589ce4 service nova] Lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-876f4719-401e-4459-bbe6-650358c4a106 req-72744613-f3c9-4941-99b8-77e9e6589ce4 service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] No waiting events found dispatching network-vif-plugged-26c6a394-5344-46d4-abf8-e49600450a07 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:27:45 user nova-compute[74805]: WARNING nova.compute.manager [req-876f4719-401e-4459-bbe6-650358c4a106 req-72744613-f3c9-4941-99b8-77e9e6589ce4 service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Received unexpected event network-vif-plugged-26c6a394-5344-46d4-abf8-e49600450a07 for instance with vm_state active and task_state resize_finish.
Nov 15 04:27:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "ce0502da-6afb-47b3-a6f0-de5885b52f30" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "ce0502da-6afb-47b3-a6f0-de5885b52f30" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:47 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:27:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:47 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:27:47 user nova-compute[74805]: INFO nova.compute.claims [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Claim successful on node user
Nov 15 04:27:47 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:27:47 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:27:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:47 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:27:47 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:27:47 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:27:47 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:27:47 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:27:47 user nova-compute[74805]: DEBUG nova.policy [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '147187e3ec664f869db966f1e47a2445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '464531969a244952b436e763f17ab970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:27:47 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:27:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:27:47 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Creating image(s)
Nov 15 04:27:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce0502da-6afb-47b3-a6f0-de5885b52f30/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "/opt/stack/data/nova/instances/ce0502da-6afb-47b3-a6f0-de5885b52f30/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "/opt/stack/data/nova/instances/ce0502da-6afb-47b3-a6f0-de5885b52f30/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "03f15382947f82eb984e779fd7253d44eaec1b92" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "03f15382947f82eb984e779fd7253d44eaec1b92" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:47 user nova-compute[74805]: DEBUG nova.compute.manager [req-aecc6bf0-08d5-471a-bcb6-33ec9a730287 req-9c1aaedb-c839-48ed-a48f-f882478597bd service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Received event network-vif-plugged-26c6a394-5344-46d4-abf8-e49600450a07 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-aecc6bf0-08d5-471a-bcb6-33ec9a730287 req-9c1aaedb-c839-48ed-a48f-f882478597bd service nova] Acquiring lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-aecc6bf0-08d5-471a-bcb6-33ec9a730287 req-9c1aaedb-c839-48ed-a48f-f882478597bd service nova] Lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-aecc6bf0-08d5-471a-bcb6-33ec9a730287 req-9c1aaedb-c839-48ed-a48f-f882478597bd service nova] Lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:47 user nova-compute[74805]: DEBUG nova.compute.manager [req-aecc6bf0-08d5-471a-bcb6-33ec9a730287 req-9c1aaedb-c839-48ed-a48f-f882478597bd service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] No waiting events found dispatching network-vif-plugged-26c6a394-5344-46d4-abf8-e49600450a07 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:27:47 user nova-compute[74805]: WARNING nova.compute.manager [req-aecc6bf0-08d5-471a-bcb6-33ec9a730287 req-9c1aaedb-c839-48ed-a48f-f882478597bd service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Received unexpected event network-vif-plugged-26c6a394-5344-46d4-abf8-e49600450a07 for instance with vm_state active and task_state resize_finish.
Nov 15 04:27:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f15382947f82eb984e779fd7253d44eaec1b92.part --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:48 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Successfully created port: 135c9269-201d-4f8d-958e-8ef2a3e0e375 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:27:48 user nova-compute[74805]: DEBUG nova.compute.manager [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:27:48 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Instance running successfully.
Nov 15 04:27:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Failed to set time: agent not configured {{(pid=74805) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 15 04:27:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3464147a-6446-4ada-8404-d0f89891393f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] finish_migration finished successfully. {{(pid=74805) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 15 04:27:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f15382947f82eb984e779fd7253d44eaec1b92.part --force-share --output=json" returned: 0 in 0.202s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:49 user nova-compute[74805]: DEBUG nova.virt.images [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] af7f66de-f8c0-4ae5-a1f3-1893d3606b05 was qcow2, converting to raw {{(pid=74805) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 04:27:49 user nova-compute[74805]: DEBUG nova.privsep.utils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74805) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 04:27:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/03f15382947f82eb984e779fd7253d44eaec1b92.part /opt/stack/data/nova/instances/_base/03f15382947f82eb984e779fd7253d44eaec1b92.converted {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/03f15382947f82eb984e779fd7253d44eaec1b92.part /opt/stack/data/nova/instances/_base/03f15382947f82eb984e779fd7253d44eaec1b92.converted" returned: 0 in 0.822s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f15382947f82eb984e779fd7253d44eaec1b92.converted --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:49 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Successfully updated port: 135c9269-201d-4f8d-958e-8ef2a3e0e375 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:27:49 user nova-compute[74805]: DEBUG nova.compute.manager [req-f0c58d2c-0f73-430a-9745-87f97d0428d7 req-666e689e-e557-47e1-91ba-e1fe29fc5400 service nova] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Received event network-changed-135c9269-201d-4f8d-958e-8ef2a3e0e375 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:49 user nova-compute[74805]: DEBUG nova.compute.manager [req-f0c58d2c-0f73-430a-9745-87f97d0428d7 req-666e689e-e557-47e1-91ba-e1fe29fc5400 service nova] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Refreshing instance network info cache due to event network-changed-135c9269-201d-4f8d-958e-8ef2a3e0e375. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:27:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f0c58d2c-0f73-430a-9745-87f97d0428d7 req-666e689e-e557-47e1-91ba-e1fe29fc5400 service nova] Acquiring lock "refresh_cache-ce0502da-6afb-47b3-a6f0-de5885b52f30" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:27:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f0c58d2c-0f73-430a-9745-87f97d0428d7 req-666e689e-e557-47e1-91ba-e1fe29fc5400 service nova] Acquired lock "refresh_cache-ce0502da-6afb-47b3-a6f0-de5885b52f30" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:27:49 user nova-compute[74805]: DEBUG nova.network.neutron [req-f0c58d2c-0f73-430a-9745-87f97d0428d7 req-666e689e-e557-47e1-91ba-e1fe29fc5400 service nova] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Refreshing network info cache for port 135c9269-201d-4f8d-958e-8ef2a3e0e375 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:27:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "refresh_cache-ce0502da-6afb-47b3-a6f0-de5885b52f30" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.network.neutron [req-f0c58d2c-0f73-430a-9745-87f97d0428d7 req-666e689e-e557-47e1-91ba-e1fe29fc5400 service nova] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f15382947f82eb984e779fd7253d44eaec1b92.converted --force-share --output=json" returned: 0 in 0.248s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "03f15382947f82eb984e779fd7253d44eaec1b92" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.323s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f15382947f82eb984e779fd7253d44eaec1b92 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.network.neutron [req-f0c58d2c-0f73-430a-9745-87f97d0428d7 req-666e689e-e557-47e1-91ba-e1fe29fc5400 service nova] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f0c58d2c-0f73-430a-9745-87f97d0428d7 req-666e689e-e557-47e1-91ba-e1fe29fc5400 service nova] Releasing lock "refresh_cache-ce0502da-6afb-47b3-a6f0-de5885b52f30" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquired lock "refresh_cache-ce0502da-6afb-47b3-a6f0-de5885b52f30" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f15382947f82eb984e779fd7253d44eaec1b92 --force-share --output=json" returned: 0 in 0.199s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "03f15382947f82eb984e779fd7253d44eaec1b92" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "03f15382947f82eb984e779fd7253d44eaec1b92" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f15382947f82eb984e779fd7253d44eaec1b92 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f15382947f82eb984e779fd7253d44eaec1b92 --force-share --output=json" returned: 0 in 0.202s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/03f15382947f82eb984e779fd7253d44eaec1b92,backing_fmt=raw /opt/stack/data/nova/instances/ce0502da-6afb-47b3-a6f0-de5885b52f30/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Updating instance_info_cache with network_info: [{"id": "135c9269-201d-4f8d-958e-8ef2a3e0e375", "address": "fa:16:3e:a3:b6:e0", "network": {"id": "a06a4001-e7e0-4991-b68a-0a0395d22e19", "bridge": "br-int", "label": "tempest-TestStampPattern-341788822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464531969a244952b436e763f17ab970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135c9269-20", "ovs_interfaceid": "135c9269-201d-4f8d-958e-8ef2a3e0e375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/03f15382947f82eb984e779fd7253d44eaec1b92,backing_fmt=raw /opt/stack/data/nova/instances/ce0502da-6afb-47b3-a6f0-de5885b52f30/disk 1073741824" returned: 0 in 0.062s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "03f15382947f82eb984e779fd7253d44eaec1b92" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f15382947f82eb984e779fd7253d44eaec1b92 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Releasing lock "refresh_cache-ce0502da-6afb-47b3-a6f0-de5885b52f30" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Instance network_info: |[{"id": "135c9269-201d-4f8d-958e-8ef2a3e0e375", "address": "fa:16:3e:a3:b6:e0", "network": {"id": "a06a4001-e7e0-4991-b68a-0a0395d22e19", "bridge": "br-int", "label": "tempest-TestStampPattern-341788822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464531969a244952b436e763f17ab970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135c9269-20", "ovs_interfaceid": "135c9269-201d-4f8d-958e-8ef2a3e0e375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f15382947f82eb984e779fd7253d44eaec1b92 --force-share --output=json" returned: 0 in 0.187s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Ensure instance console log exists: /opt/stack/data/nova/instances/ce0502da-6afb-47b3-a6f0-de5885b52f30/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Start _get_guest_xml network_info=[{"id": "135c9269-201d-4f8d-958e-8ef2a3e0e375", "address": "fa:16:3e:a3:b6:e0", "network": {"id": "a06a4001-e7e0-4991-b68a-0a0395d22e19", "bridge": "br-int", "label": "tempest-TestStampPattern-341788822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464531969a244952b436e763f17ab970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135c9269-20", "ovs_interfaceid": "135c9269-201d-4f8d-958e-8ef2a3e0e375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='07d84f1124d8f74e19f8f3d826b73b0b',container_format='bare',created_at=2023-11-15T04:27:39Z,direct_url=<?>,disk_format='qcow2',id=af7f66de-f8c0-4ae5-a1f3-1893d3606b05,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1224157835',owner='464531969a244952b436e763f17ab970',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T04:27:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'af7f66de-f8c0-4ae5-a1f3-1893d3606b05'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:27:50 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:27:50 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='07d84f1124d8f74e19f8f3d826b73b0b',container_format='bare',created_at=2023-11-15T04:27:39Z,direct_url=<?>,disk_format='qcow2',id=af7f66de-f8c0-4ae5-a1f3-1893d3606b05,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1224157835',owner='464531969a244952b436e763f17ab970',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T04:27:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:27:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-707806317',display_name='tempest-TestStampPattern-server-707806317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-707806317',id=35,image_ref='af7f66de-f8c0-4ae5-a1f3-1893d3606b05',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0NRAQgDbUZf0EbqtKAGHs4GX+/AbapMrSMTst3yG7lWtxqhChiIE0p667dQ9MtVVa6R0YR0OFwR3oN8tOTGfWd9b0OvJqkw2muo0XPuAEVruetlLFRHgQ9v/OWONwx2w==',key_name='tempest-TestStampPattern-1861490322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='464531969a244952b436e763f17ab970',ramdisk_id='',reservation_id='r-zr673lyw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8d27a3c7-54c7-45fd-85ab-05aa3d375a4c',image_min_disk='1',image_min_ram='0',image_owner_id='464531969a244952b436e763f17ab970',image_owner_project_name='tempest-TestStampPattern-1523333335',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1523333335-project-member',image_user_id='147187e3ec664f869db966f1e47a2445',network_allocated='True',owner_project_name='tempest-TestStampPattern-1523333335',owner_user_name='tempest-TestStampPattern-1523333335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:27:48Z,user_data=None,user_id='147187e3ec664f869db966f1e47a2445',uuid=ce0502da-6afb-47b3-a6f0-de5885b52f30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "135c9269-201d-4f8d-958e-8ef2a3e0e375", "address": "fa:16:3e:a3:b6:e0", "network": {"id": "a06a4001-e7e0-4991-b68a-0a0395d22e19", "bridge": "br-int", "label": "tempest-TestStampPattern-341788822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464531969a244952b436e763f17ab970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135c9269-20", "ovs_interfaceid": "135c9269-201d-4f8d-958e-8ef2a3e0e375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Converting VIF {"id": "135c9269-201d-4f8d-958e-8ef2a3e0e375", "address": "fa:16:3e:a3:b6:e0", "network": {"id": "a06a4001-e7e0-4991-b68a-0a0395d22e19", "bridge": "br-int", "label": "tempest-TestStampPattern-341788822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464531969a244952b436e763f17ab970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135c9269-20", "ovs_interfaceid": "135c9269-201d-4f8d-958e-8ef2a3e0e375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b6:e0,bridge_name='br-int',has_traffic_filtering=True,id=135c9269-201d-4f8d-958e-8ef2a3e0e375,network=Network(a06a4001-e7e0-4991-b68a-0a0395d22e19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135c9269-20') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.objects.instance [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lazy-loading 'pci_devices' on Instance uuid ce0502da-6afb-47b3-a6f0-de5885b52f30 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:27:50 user nova-compute[74805]:   <uuid>ce0502da-6afb-47b3-a6f0-de5885b52f30</uuid>
Nov 15 04:27:50 user nova-compute[74805]:   <name>instance-00000023</name>
Nov 15 04:27:50 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:27:50 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:27:50 user nova-compute[74805]:   <metadata>
Nov 15 04:27:50 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:27:50 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:27:50 user nova-compute[74805]:       <nova:name>tempest-TestStampPattern-server-707806317</nova:name>
Nov 15 04:27:50 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:27:50</nova:creationTime>
Nov 15 04:27:50 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:27:50 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:27:50 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:27:50 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:27:50 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:27:50 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:27:50 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:27:50 user nova-compute[74805]:       <nova:owner>
Nov 15 04:27:50 user nova-compute[74805]:         <nova:user uuid="147187e3ec664f869db966f1e47a2445">tempest-TestStampPattern-1523333335-project-member</nova:user>
Nov 15 04:27:50 user nova-compute[74805]:         <nova:project uuid="464531969a244952b436e763f17ab970">tempest-TestStampPattern-1523333335</nova:project>
Nov 15 04:27:50 user nova-compute[74805]:       </nova:owner>
Nov 15 04:27:50 user nova-compute[74805]:       <nova:root type="image" uuid="af7f66de-f8c0-4ae5-a1f3-1893d3606b05"/>
Nov 15 04:27:50 user nova-compute[74805]:       <nova:ports>
Nov 15 04:27:50 user nova-compute[74805]:         <nova:port uuid="135c9269-201d-4f8d-958e-8ef2a3e0e375">
Nov 15 04:27:50 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 04:27:50 user nova-compute[74805]:         </nova:port>
Nov 15 04:27:50 user nova-compute[74805]:       </nova:ports>
Nov 15 04:27:50 user nova-compute[74805]:     </nova:instance>
Nov 15 04:27:50 user nova-compute[74805]:   </metadata>
Nov 15 04:27:50 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:27:50 user nova-compute[74805]:     <system>
Nov 15 04:27:50 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:27:50 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:27:50 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:27:50 user nova-compute[74805]:       <entry name="serial">ce0502da-6afb-47b3-a6f0-de5885b52f30</entry>
Nov 15 04:27:50 user nova-compute[74805]:       <entry name="uuid">ce0502da-6afb-47b3-a6f0-de5885b52f30</entry>
Nov 15 04:27:50 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:27:50 user nova-compute[74805]:     </system>
Nov 15 04:27:50 user nova-compute[74805]:   </sysinfo>
Nov 15 04:27:50 user nova-compute[74805]:   <os>
Nov 15 04:27:50 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:27:50 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:27:50 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:27:50 user nova-compute[74805]:   </os>
Nov 15 04:27:50 user nova-compute[74805]:   <features>
Nov 15 04:27:50 user nova-compute[74805]:     <acpi/>
Nov 15 04:27:50 user nova-compute[74805]:     <apic/>
Nov 15 04:27:50 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:27:50 user nova-compute[74805]:   </features>
Nov 15 04:27:50 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:27:50 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:27:50 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:27:50 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:27:50 user nova-compute[74805]:   </clock>
Nov 15 04:27:50 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:27:50 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:27:50 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:27:50 user nova-compute[74805]:   </cpu>
Nov 15 04:27:50 user nova-compute[74805]:   <devices>
Nov 15 04:27:50 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:27:50 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:27:50 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/ce0502da-6afb-47b3-a6f0-de5885b52f30/disk"/>
Nov 15 04:27:50 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:27:50 user nova-compute[74805]:     </disk>
Nov 15 04:27:50 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:27:50 user nova-compute[74805]:       <mac address="fa:16:3e:a3:b6:e0"/>
Nov 15 04:27:50 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:27:50 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:27:50 user nova-compute[74805]:       <target dev="tap135c9269-20"/>
Nov 15 04:27:50 user nova-compute[74805]:     </interface>
Nov 15 04:27:50 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:27:50 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/ce0502da-6afb-47b3-a6f0-de5885b52f30/console.log" append="off"/>
Nov 15 04:27:50 user nova-compute[74805]:     </serial>
Nov 15 04:27:50 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:27:50 user nova-compute[74805]:     <video>
Nov 15 04:27:50 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:27:50 user nova-compute[74805]:     </video>
Nov 15 04:27:50 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:27:50 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:27:50 user nova-compute[74805]:     </rng>
Nov 15 04:27:50 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:27:50 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:27:50 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:27:50 user nova-compute[74805]:     </memballoon>
Nov 15 04:27:50 user nova-compute[74805]:   </devices>
Nov 15 04:27:50 user nova-compute[74805]: </domain>
Nov 15 04:27:50 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:27:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-707806317',display_name='tempest-TestStampPattern-server-707806317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-707806317',id=35,image_ref='af7f66de-f8c0-4ae5-a1f3-1893d3606b05',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0NRAQgDbUZf0EbqtKAGHs4GX+/AbapMrSMTst3yG7lWtxqhChiIE0p667dQ9MtVVa6R0YR0OFwR3oN8tOTGfWd9b0OvJqkw2muo0XPuAEVruetlLFRHgQ9v/OWONwx2w==',key_name='tempest-TestStampPattern-1861490322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='464531969a244952b436e763f17ab970',ramdisk_id='',reservation_id='r-zr673lyw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8d27a3c7-54c7-45fd-85ab-05aa3d375a4c',image_min_disk='1',image_min_ram='0',image_owner_id='464531969a244952b436e763f17ab970',image_owner_project_name='tempest-TestStampPattern-1523333335',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1523333335-project-member',image_user_id='147187e3ec664f869db966f1e47a2445',network_allocated='True',owner_project_name='tempest-TestStampPattern-1523333335',owner_user_name='tempest-TestStampPattern-1523333335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:27:48Z,user_data=None,user_id='147187e3ec664f869db966f1e47a2445',uuid=ce0502da-6afb-47b3-a6f0-de5885b52f30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "135c9269-201d-4f8d-958e-8ef2a3e0e375", "address": "fa:16:3e:a3:b6:e0", "network": {"id": "a06a4001-e7e0-4991-b68a-0a0395d22e19", "bridge": "br-int", "label": "tempest-TestStampPattern-341788822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464531969a244952b436e763f17ab970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135c9269-20", "ovs_interfaceid": "135c9269-201d-4f8d-958e-8ef2a3e0e375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Converting VIF {"id": "135c9269-201d-4f8d-958e-8ef2a3e0e375", "address": "fa:16:3e:a3:b6:e0", "network": {"id": "a06a4001-e7e0-4991-b68a-0a0395d22e19", "bridge": "br-int", "label": "tempest-TestStampPattern-341788822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464531969a244952b436e763f17ab970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135c9269-20", "ovs_interfaceid": "135c9269-201d-4f8d-958e-8ef2a3e0e375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b6:e0,bridge_name='br-int',has_traffic_filtering=True,id=135c9269-201d-4f8d-958e-8ef2a3e0e375,network=Network(a06a4001-e7e0-4991-b68a-0a0395d22e19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135c9269-20') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG os_vif [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b6:e0,bridge_name='br-int',has_traffic_filtering=True,id=135c9269-201d-4f8d-958e-8ef2a3e0e375,network=Network(a06a4001-e7e0-4991-b68a-0a0395d22e19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135c9269-20') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7c8eda4-6b0d-5ff8-b0fe-7df465646690', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap135c9269-20, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap135c9269-20, col_values=(('qos', UUID('c451f0b7-9a55-444d-af72-d4d1efda6961')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap135c9269-20, col_values=(('external_ids', {'iface-id': '135c9269-201d-4f8d-958e-8ef2a3e0e375', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:b6:e0', 'vm-uuid': 'ce0502da-6afb-47b3-a6f0-de5885b52f30'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:27:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:50 user nova-compute[74805]: INFO os_vif [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b6:e0,bridge_name='br-int',has_traffic_filtering=True,id=135c9269-201d-4f8d-958e-8ef2a3e0e375,network=Network(a06a4001-e7e0-4991-b68a-0a0395d22e19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135c9269-20')
Nov 15 04:27:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:27:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] No VIF found with MAC fa:16:3e:a3:b6:e0, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:27:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:52 user nova-compute[74805]: DEBUG nova.compute.manager [req-63a5f24e-bfd1-45f9-9da9-cc773ff60498 req-9cb1ab75-4eaa-42c8-be2e-c927c3b9f786 service nova] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Received event network-vif-plugged-135c9269-201d-4f8d-958e-8ef2a3e0e375 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-63a5f24e-bfd1-45f9-9da9-cc773ff60498 req-9cb1ab75-4eaa-42c8-be2e-c927c3b9f786 service nova] Acquiring lock "ce0502da-6afb-47b3-a6f0-de5885b52f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-63a5f24e-bfd1-45f9-9da9-cc773ff60498 req-9cb1ab75-4eaa-42c8-be2e-c927c3b9f786 service nova] Lock "ce0502da-6afb-47b3-a6f0-de5885b52f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-63a5f24e-bfd1-45f9-9da9-cc773ff60498 req-9cb1ab75-4eaa-42c8-be2e-c927c3b9f786 service nova] Lock "ce0502da-6afb-47b3-a6f0-de5885b52f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:52 user nova-compute[74805]: DEBUG nova.compute.manager [req-63a5f24e-bfd1-45f9-9da9-cc773ff60498 req-9cb1ab75-4eaa-42c8-be2e-c927c3b9f786 service nova] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] No waiting events found dispatching network-vif-plugged-135c9269-201d-4f8d-958e-8ef2a3e0e375 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:27:52 user nova-compute[74805]: WARNING nova.compute.manager [req-63a5f24e-bfd1-45f9-9da9-cc773ff60498 req-9cb1ab75-4eaa-42c8-be2e-c927c3b9f786 service nova] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Received unexpected event network-vif-plugged-135c9269-201d-4f8d-958e-8ef2a3e0e375 for instance with vm_state building and task_state spawning.
Nov 15 04:27:54 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:27:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:27:54 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Instance spawned successfully.
Nov 15 04:27:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:27:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:27:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:27:54 user nova-compute[74805]: INFO nova.compute.manager [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Took 7.00 seconds to spawn the instance on the hypervisor.
Nov 15 04:27:54 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:27:54 user nova-compute[74805]: DEBUG nova.compute.manager [req-b8293f0e-c1fa-46b8-bdae-324368068759 req-64d943e3-f311-4ff2-adb4-430d834b7491 service nova] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Received event network-vif-plugged-135c9269-201d-4f8d-958e-8ef2a3e0e375 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:27:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b8293f0e-c1fa-46b8-bdae-324368068759 req-64d943e3-f311-4ff2-adb4-430d834b7491 service nova] Acquiring lock "ce0502da-6afb-47b3-a6f0-de5885b52f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b8293f0e-c1fa-46b8-bdae-324368068759 req-64d943e3-f311-4ff2-adb4-430d834b7491 service nova] Lock "ce0502da-6afb-47b3-a6f0-de5885b52f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b8293f0e-c1fa-46b8-bdae-324368068759 req-64d943e3-f311-4ff2-adb4-430d834b7491 service nova] Lock "ce0502da-6afb-47b3-a6f0-de5885b52f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:54 user nova-compute[74805]: DEBUG nova.compute.manager [req-b8293f0e-c1fa-46b8-bdae-324368068759 req-64d943e3-f311-4ff2-adb4-430d834b7491 service nova] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] No waiting events found dispatching network-vif-plugged-135c9269-201d-4f8d-958e-8ef2a3e0e375 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:27:54 user nova-compute[74805]: WARNING nova.compute.manager [req-b8293f0e-c1fa-46b8-bdae-324368068759 req-64d943e3-f311-4ff2-adb4-430d834b7491 service nova] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Received unexpected event network-vif-plugged-135c9269-201d-4f8d-958e-8ef2a3e0e375 for instance with vm_state building and task_state spawning.
Nov 15 04:27:54 user nova-compute[74805]: INFO nova.compute.manager [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Took 7.85 seconds to build instance.
Nov 15 04:27:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ca3c5ced-7b3c-492e-b578-da3e3adc8b13 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "ce0502da-6afb-47b3-a6f0-de5885b52f30" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.957s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:27:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "6500dfcd-24fb-4683-aa90-3c17420f44c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "6500dfcd-24fb-4683-aa90-3c17420f44c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:58 user nova-compute[74805]: DEBUG nova.compute.manager [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:27:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:58 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:27:58 user nova-compute[74805]: INFO nova.compute.claims [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Claim successful on node user
Nov 15 04:27:59 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:27:59 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:27:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.545s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:59 user nova-compute[74805]: DEBUG nova.compute.manager [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:27:59 user nova-compute[74805]: DEBUG nova.compute.manager [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:27:59 user nova-compute[74805]: DEBUG nova.network.neutron [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:27:59 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:27:59 user nova-compute[74805]: DEBUG nova.compute.manager [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:27:59 user nova-compute[74805]: DEBUG nova.policy [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50fe72dfe19f4c9792c4733f14b2d464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ba201faadb461882c823f9bd895af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:27:59 user nova-compute[74805]: DEBUG nova.compute.manager [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:27:59 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:27:59 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Creating image(s)
Nov 15 04:27:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "/opt/stack/data/nova/instances/6500dfcd-24fb-4683-aa90-3c17420f44c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "/opt/stack/data/nova/instances/6500dfcd-24fb-4683-aa90-3c17420f44c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "/opt/stack/data/nova/instances/6500dfcd-24fb-4683-aa90-3c17420f44c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:27:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:27:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.185s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:27:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:27:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:27:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.247s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/6500dfcd-24fb-4683-aa90-3c17420f44c1/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/6500dfcd-24fb-4683-aa90-3c17420f44c1/disk 1073741824" returned: 0 in 0.051s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:00 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6500dfcd-24fb-4683-aa90-3c17420f44c1/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:28:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6500dfcd-24fb-4683-aa90-3c17420f44c1/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:00 user nova-compute[74805]: DEBUG nova.network.neutron [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Successfully created port: ccd1646c-a99d-46c3-9caa-d1420b79390a {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:28:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6500dfcd-24fb-4683-aa90-3c17420f44c1/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:00 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Cannot resize image /opt/stack/data/nova/instances/6500dfcd-24fb-4683-aa90-3c17420f44c1/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:28:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:28:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Ensure instance console log exists: /opt/stack/data/nova/instances/6500dfcd-24fb-4683-aa90-3c17420f44c1/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:28:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.network.neutron [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Successfully updated port: ccd1646c-a99d-46c3-9caa-d1420b79390a {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "refresh_cache-6500dfcd-24fb-4683-aa90-3c17420f44c1" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquired lock "refresh_cache-6500dfcd-24fb-4683-aa90-3c17420f44c1" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.network.neutron [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.compute.manager [req-2be55df1-4487-417d-8e06-51c236b8f10e req-a482dcfc-e756-447d-b154-9b1caba2a487 service nova] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Received event network-changed-ccd1646c-a99d-46c3-9caa-d1420b79390a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.compute.manager [req-2be55df1-4487-417d-8e06-51c236b8f10e req-a482dcfc-e756-447d-b154-9b1caba2a487 service nova] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Refreshing instance network info cache due to event network-changed-ccd1646c-a99d-46c3-9caa-d1420b79390a. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2be55df1-4487-417d-8e06-51c236b8f10e req-a482dcfc-e756-447d-b154-9b1caba2a487 service nova] Acquiring lock "refresh_cache-6500dfcd-24fb-4683-aa90-3c17420f44c1" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.network.neutron [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.network.neutron [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Updating instance_info_cache with network_info: [{"id": "ccd1646c-a99d-46c3-9caa-d1420b79390a", "address": "fa:16:3e:3a:04:cb", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd1646c-a9", "ovs_interfaceid": "ccd1646c-a99d-46c3-9caa-d1420b79390a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Releasing lock "refresh_cache-6500dfcd-24fb-4683-aa90-3c17420f44c1" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.compute.manager [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Instance network_info: |[{"id": "ccd1646c-a99d-46c3-9caa-d1420b79390a", "address": "fa:16:3e:3a:04:cb", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd1646c-a9", "ovs_interfaceid": "ccd1646c-a99d-46c3-9caa-d1420b79390a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2be55df1-4487-417d-8e06-51c236b8f10e req-a482dcfc-e756-447d-b154-9b1caba2a487 service nova] Acquired lock "refresh_cache-6500dfcd-24fb-4683-aa90-3c17420f44c1" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.network.neutron [req-2be55df1-4487-417d-8e06-51c236b8f10e req-a482dcfc-e756-447d-b154-9b1caba2a487 service nova] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Refreshing network info cache for port ccd1646c-a99d-46c3-9caa-d1420b79390a {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Start _get_guest_xml network_info=[{"id": "ccd1646c-a99d-46c3-9caa-d1420b79390a", "address": "fa:16:3e:3a:04:cb", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd1646c-a9", "ovs_interfaceid": "ccd1646c-a99d-46c3-9caa-d1420b79390a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:28:01 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:28:01 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-292741836',display_name='tempest-AttachVolumeTestJSON-server-292741836',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-292741836',id=36,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFofT9T8nuqJoYl+xrXEbEiwVCmi9ar+UeVHQ5AJd7Qo7dxDmH8wnwceUhut9M3advHMWouuz1J0oMVLcWqEvdCMpxkl3Tu+90EbbIoXjhlmpGVZhP+6942VyAIEjcBUA==',key_name='tempest-keypair-1597146635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7ba201faadb461882c823f9bd895af9',ramdisk_id='',reservation_id='r-skj7gis1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-17326548',owner_user_name='tempest-AttachVolumeTestJSON-17326548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:28:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50fe72dfe19f4c9792c4733f14b2d464',uuid=6500dfcd-24fb-4683-aa90-3c17420f44c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccd1646c-a99d-46c3-9caa-d1420b79390a", "address": "fa:16:3e:3a:04:cb", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd1646c-a9", "ovs_interfaceid": "ccd1646c-a99d-46c3-9caa-d1420b79390a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Converting VIF {"id": "ccd1646c-a99d-46c3-9caa-d1420b79390a", "address": "fa:16:3e:3a:04:cb", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd1646c-a9", "ovs_interfaceid": "ccd1646c-a99d-46c3-9caa-d1420b79390a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:04:cb,bridge_name='br-int',has_traffic_filtering=True,id=ccd1646c-a99d-46c3-9caa-d1420b79390a,network=Network(5b2973a0-643c-4d30-a6cd-3d1391fe2cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccd1646c-a9') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.objects.instance [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'pci_devices' on Instance uuid 6500dfcd-24fb-4683-aa90-3c17420f44c1 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:28:01 user nova-compute[74805]:   <uuid>6500dfcd-24fb-4683-aa90-3c17420f44c1</uuid>
Nov 15 04:28:01 user nova-compute[74805]:   <name>instance-00000024</name>
Nov 15 04:28:01 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:28:01 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:28:01 user nova-compute[74805]:   <metadata>
Nov 15 04:28:01 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:28:01 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:28:01 user nova-compute[74805]:       <nova:name>tempest-AttachVolumeTestJSON-server-292741836</nova:name>
Nov 15 04:28:01 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:28:01</nova:creationTime>
Nov 15 04:28:01 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:28:01 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:28:01 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:28:01 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:28:01 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:28:01 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:28:01 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:28:01 user nova-compute[74805]:       <nova:owner>
Nov 15 04:28:01 user nova-compute[74805]:         <nova:user uuid="50fe72dfe19f4c9792c4733f14b2d464">tempest-AttachVolumeTestJSON-17326548-project-member</nova:user>
Nov 15 04:28:01 user nova-compute[74805]:         <nova:project uuid="b7ba201faadb461882c823f9bd895af9">tempest-AttachVolumeTestJSON-17326548</nova:project>
Nov 15 04:28:01 user nova-compute[74805]:       </nova:owner>
Nov 15 04:28:01 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:28:01 user nova-compute[74805]:       <nova:ports>
Nov 15 04:28:01 user nova-compute[74805]:         <nova:port uuid="ccd1646c-a99d-46c3-9caa-d1420b79390a">
Nov 15 04:28:01 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 04:28:01 user nova-compute[74805]:         </nova:port>
Nov 15 04:28:01 user nova-compute[74805]:       </nova:ports>
Nov 15 04:28:01 user nova-compute[74805]:     </nova:instance>
Nov 15 04:28:01 user nova-compute[74805]:   </metadata>
Nov 15 04:28:01 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:28:01 user nova-compute[74805]:     <system>
Nov 15 04:28:01 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:28:01 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:28:01 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:28:01 user nova-compute[74805]:       <entry name="serial">6500dfcd-24fb-4683-aa90-3c17420f44c1</entry>
Nov 15 04:28:01 user nova-compute[74805]:       <entry name="uuid">6500dfcd-24fb-4683-aa90-3c17420f44c1</entry>
Nov 15 04:28:01 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:28:01 user nova-compute[74805]:     </system>
Nov 15 04:28:01 user nova-compute[74805]:   </sysinfo>
Nov 15 04:28:01 user nova-compute[74805]:   <os>
Nov 15 04:28:01 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:28:01 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:28:01 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:28:01 user nova-compute[74805]:   </os>
Nov 15 04:28:01 user nova-compute[74805]:   <features>
Nov 15 04:28:01 user nova-compute[74805]:     <acpi/>
Nov 15 04:28:01 user nova-compute[74805]:     <apic/>
Nov 15 04:28:01 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:28:01 user nova-compute[74805]:   </features>
Nov 15 04:28:01 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:28:01 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:28:01 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:28:01 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:28:01 user nova-compute[74805]:   </clock>
Nov 15 04:28:01 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:28:01 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:28:01 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:28:01 user nova-compute[74805]:   </cpu>
Nov 15 04:28:01 user nova-compute[74805]:   <devices>
Nov 15 04:28:01 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:28:01 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:28:01 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/6500dfcd-24fb-4683-aa90-3c17420f44c1/disk"/>
Nov 15 04:28:01 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:28:01 user nova-compute[74805]:     </disk>
Nov 15 04:28:01 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:28:01 user nova-compute[74805]:       <mac address="fa:16:3e:3a:04:cb"/>
Nov 15 04:28:01 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:28:01 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:28:01 user nova-compute[74805]:       <target dev="tapccd1646c-a9"/>
Nov 15 04:28:01 user nova-compute[74805]:     </interface>
Nov 15 04:28:01 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:28:01 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/6500dfcd-24fb-4683-aa90-3c17420f44c1/console.log" append="off"/>
Nov 15 04:28:01 user nova-compute[74805]:     </serial>
Nov 15 04:28:01 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:28:01 user nova-compute[74805]:     <video>
Nov 15 04:28:01 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:28:01 user nova-compute[74805]:     </video>
Nov 15 04:28:01 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:28:01 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:28:01 user nova-compute[74805]:     </rng>
Nov 15 04:28:01 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:28:01 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:28:01 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:28:01 user nova-compute[74805]:     </memballoon>
Nov 15 04:28:01 user nova-compute[74805]:   </devices>
Nov 15 04:28:01 user nova-compute[74805]: </domain>
Nov 15 04:28:01 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-292741836',display_name='tempest-AttachVolumeTestJSON-server-292741836',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-292741836',id=36,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFofT9T8nuqJoYl+xrXEbEiwVCmi9ar+UeVHQ5AJd7Qo7dxDmH8wnwceUhut9M3advHMWouuz1J0oMVLcWqEvdCMpxkl3Tu+90EbbIoXjhlmpGVZhP+6942VyAIEjcBUA==',key_name='tempest-keypair-1597146635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7ba201faadb461882c823f9bd895af9',ramdisk_id='',reservation_id='r-skj7gis1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-17326548',owner_user_name='tempest-AttachVolumeTestJSON-17326548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:28:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50fe72dfe19f4c9792c4733f14b2d464',uuid=6500dfcd-24fb-4683-aa90-3c17420f44c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccd1646c-a99d-46c3-9caa-d1420b79390a", "address": "fa:16:3e:3a:04:cb", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd1646c-a9", "ovs_interfaceid": "ccd1646c-a99d-46c3-9caa-d1420b79390a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Converting VIF {"id": "ccd1646c-a99d-46c3-9caa-d1420b79390a", "address": "fa:16:3e:3a:04:cb", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd1646c-a9", "ovs_interfaceid": "ccd1646c-a99d-46c3-9caa-d1420b79390a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:04:cb,bridge_name='br-int',has_traffic_filtering=True,id=ccd1646c-a99d-46c3-9caa-d1420b79390a,network=Network(5b2973a0-643c-4d30-a6cd-3d1391fe2cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccd1646c-a9') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG os_vif [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:04:cb,bridge_name='br-int',has_traffic_filtering=True,id=ccd1646c-a99d-46c3-9caa-d1420b79390a,network=Network(5b2973a0-643c-4d30-a6cd-3d1391fe2cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccd1646c-a9') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85405489-6f90-5da3-9352-743443c1ce29', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapccd1646c-a9, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapccd1646c-a9, col_values=(('qos', UUID('624590aa-e445-4d85-b87a-7a0f52672247')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapccd1646c-a9, col_values=(('external_ids', {'iface-id': 'ccd1646c-a99d-46c3-9caa-d1420b79390a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:04:cb', 'vm-uuid': '6500dfcd-24fb-4683-aa90-3c17420f44c1'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:01 user nova-compute[74805]: INFO os_vif [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:04:cb,bridge_name='br-int',has_traffic_filtering=True,id=ccd1646c-a99d-46c3-9caa-d1420b79390a,network=Network(5b2973a0-643c-4d30-a6cd-3d1391fe2cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccd1646c-a9')
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] No VIF found with MAC fa:16:3e:3a:04:cb, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.network.neutron [req-2be55df1-4487-417d-8e06-51c236b8f10e req-a482dcfc-e756-447d-b154-9b1caba2a487 service nova] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Updated VIF entry in instance network info cache for port ccd1646c-a99d-46c3-9caa-d1420b79390a. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG nova.network.neutron [req-2be55df1-4487-417d-8e06-51c236b8f10e req-a482dcfc-e756-447d-b154-9b1caba2a487 service nova] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Updating instance_info_cache with network_info: [{"id": "ccd1646c-a99d-46c3-9caa-d1420b79390a", "address": "fa:16:3e:3a:04:cb", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd1646c-a9", "ovs_interfaceid": "ccd1646c-a99d-46c3-9caa-d1420b79390a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:28:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2be55df1-4487-417d-8e06-51c236b8f10e req-a482dcfc-e756-447d-b154-9b1caba2a487 service nova] Releasing lock "refresh_cache-6500dfcd-24fb-4683-aa90-3c17420f44c1" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:28:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:03 user nova-compute[74805]: DEBUG nova.compute.manager [req-ee47d783-9879-479d-acde-cf291f339fb5 req-5f6fb18f-66f3-42e5-9aec-432b3d18433f service nova] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Received event network-vif-plugged-ccd1646c-a99d-46c3-9caa-d1420b79390a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ee47d783-9879-479d-acde-cf291f339fb5 req-5f6fb18f-66f3-42e5-9aec-432b3d18433f service nova] Acquiring lock "6500dfcd-24fb-4683-aa90-3c17420f44c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ee47d783-9879-479d-acde-cf291f339fb5 req-5f6fb18f-66f3-42e5-9aec-432b3d18433f service nova] Lock "6500dfcd-24fb-4683-aa90-3c17420f44c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ee47d783-9879-479d-acde-cf291f339fb5 req-5f6fb18f-66f3-42e5-9aec-432b3d18433f service nova] Lock "6500dfcd-24fb-4683-aa90-3c17420f44c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:03 user nova-compute[74805]: DEBUG nova.compute.manager [req-ee47d783-9879-479d-acde-cf291f339fb5 req-5f6fb18f-66f3-42e5-9aec-432b3d18433f service nova] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] No waiting events found dispatching network-vif-plugged-ccd1646c-a99d-46c3-9caa-d1420b79390a {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:28:03 user nova-compute[74805]: WARNING nova.compute.manager [req-ee47d783-9879-479d-acde-cf291f339fb5 req-5f6fb18f-66f3-42e5-9aec-432b3d18433f service nova] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Received unexpected event network-vif-plugged-ccd1646c-a99d-46c3-9caa-d1420b79390a for instance with vm_state building and task_state spawning.
Nov 15 04:28:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "4a2d5475-04a4-414d-9ce9-d5204494f898" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "4a2d5475-04a4-414d-9ce9-d5204494f898" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:04 user nova-compute[74805]: INFO nova.compute.manager [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Detaching volume dd635a1a-ac62-4627-8a17-e02f6328d312
Nov 15 04:28:04 user nova-compute[74805]: INFO nova.virt.block_device [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Attempting to driver detach volume dd635a1a-ac62-4627-8a17-e02f6328d312 from mountpoint /dev/vdc
Nov 15 04:28:04 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Attempting to detach device vdc from instance 4a2d5475-04a4-414d-9ce9-d5204494f898 from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:28:04 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:28:04 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:28:04 user nova-compute[74805]:   <source dev="/dev/sdc"/>
Nov 15 04:28:04 user nova-compute[74805]:   <target dev="vdc" bus="virtio"/>
Nov 15 04:28:04 user nova-compute[74805]:   <serial>dd635a1a-ac62-4627-8a17-e02f6328d312</serial>
Nov 15 04:28:04 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 04:28:04 user nova-compute[74805]: </disk>
Nov 15 04:28:04 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:28:04 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Successfully detached device vdc from instance 4a2d5475-04a4-414d-9ce9-d5204494f898 from the persistent domain config.
Nov 15 04:28:04 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4a2d5475-04a4-414d-9ce9-d5204494f898 from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:28:04 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:28:04 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:28:04 user nova-compute[74805]:   <source dev="/dev/sdc"/>
Nov 15 04:28:04 user nova-compute[74805]:   <target dev="vdc" bus="virtio"/>
Nov 15 04:28:04 user nova-compute[74805]:   <serial>dd635a1a-ac62-4627-8a17-e02f6328d312</serial>
Nov 15 04:28:04 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 04:28:04 user nova-compute[74805]: </disk>
Nov 15 04:28:04 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:28:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4a2d5475-04a4-414d-9ce9-d5204494f898 {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:28:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:05 user nova-compute[74805]: DEBUG nova.compute.manager [req-f87921f0-42e0-4eea-ad1f-ef56ff228ce3 req-05560d0b-062d-4710-97a4-f8e0b56b4675 service nova] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Received event network-vif-plugged-ccd1646c-a99d-46c3-9caa-d1420b79390a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f87921f0-42e0-4eea-ad1f-ef56ff228ce3 req-05560d0b-062d-4710-97a4-f8e0b56b4675 service nova] Acquiring lock "6500dfcd-24fb-4683-aa90-3c17420f44c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f87921f0-42e0-4eea-ad1f-ef56ff228ce3 req-05560d0b-062d-4710-97a4-f8e0b56b4675 service nova] Lock "6500dfcd-24fb-4683-aa90-3c17420f44c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f87921f0-42e0-4eea-ad1f-ef56ff228ce3 req-05560d0b-062d-4710-97a4-f8e0b56b4675 service nova] Lock "6500dfcd-24fb-4683-aa90-3c17420f44c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:05 user nova-compute[74805]: DEBUG nova.compute.manager [req-f87921f0-42e0-4eea-ad1f-ef56ff228ce3 req-05560d0b-062d-4710-97a4-f8e0b56b4675 service nova] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] No waiting events found dispatching network-vif-plugged-ccd1646c-a99d-46c3-9caa-d1420b79390a {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:28:05 user nova-compute[74805]: WARNING nova.compute.manager [req-f87921f0-42e0-4eea-ad1f-ef56ff228ce3 req-05560d0b-062d-4710-97a4-f8e0b56b4675 service nova] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Received unexpected event network-vif-plugged-ccd1646c-a99d-46c3-9caa-d1420b79390a for instance with vm_state building and task_state spawning.
Nov 15 04:28:05 user nova-compute[74805]: DEBUG nova.compute.manager [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:28:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:28:05 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Instance spawned successfully.
Nov 15 04:28:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:28:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:28:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:28:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:28:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:28:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:28:05 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:28:05 user nova-compute[74805]: INFO nova.compute.manager [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Took 6.01 seconds to spawn the instance on the hypervisor.
Nov 15 04:28:05 user nova-compute[74805]: DEBUG nova.compute.manager [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:28:05 user nova-compute[74805]: INFO nova.compute.manager [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Took 6.91 seconds to build instance.
Nov 15 04:28:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f37aaa46-f949-4eb3-a514-9e6c5db82297 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "6500dfcd-24fb-4683-aa90-3c17420f44c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.038s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:10 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:28:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:12 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:28:12 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:28:12 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:28:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:12 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:28:12 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:28:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:28:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:28:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6500dfcd-24fb-4683-aa90-3c17420f44c1/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6500dfcd-24fb-4683-aa90-3c17420f44c1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6500dfcd-24fb-4683-aa90-3c17420f44c1/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6500dfcd-24fb-4683-aa90-3c17420f44c1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce0502da-6afb-47b3-a6f0-de5885b52f30/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce0502da-6afb-47b3-a6f0-de5885b52f30/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce0502da-6afb-47b3-a6f0-de5885b52f30/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce0502da-6afb-47b3-a6f0-de5885b52f30/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:28:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:28:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:28:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:15 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:28:15 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:28:15 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=7405MB free_disk=25.109127044677734GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:28:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:15 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Applying migration context for instance fda0e490-03e3-4cf5-b22d-aab83d715616 as it has an incoming, in-progress migration 3138f4ce-86c5-4b8e-a7e5-1c9b46e64019. Migration status is finished {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 04:28:15 user nova-compute[74805]: INFO nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Updating resource usage from migration 3138f4ce-86c5-4b8e-a7e5-1c9b46e64019
Nov 15 04:28:15 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance d63f3726-27df-455f-bda0-3ddca95b70d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:28:15 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 9f267864-0b72-431d-9b0d-c63436002a4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:28:15 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:28:15 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 4a2d5475-04a4-414d-9ce9-d5204494f898 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:28:15 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 07831159-aab3-4f4a-8cc9-25d74e254ae2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:28:15 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 38196606-a9c9-4604-ad21-2ec7511a8b28 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:28:15 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance bc2e6fef-e9b0-4413-ad26-e4a076cb0b49 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:28:15 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Migration 3138f4ce-86c5-4b8e-a7e5-1c9b46e64019 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 04:28:15 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance fda0e490-03e3-4cf5-b22d-aab83d715616 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:28:15 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance c4968663-4f4f-4db0-bd2c-278d271b8b35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:28:15 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance ce0502da-6afb-47b3-a6f0-de5885b52f30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:28:15 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 6500dfcd-24fb-4683-aa90-3c17420f44c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:28:15 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:28:15 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:28:16 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:28:16 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:28:16 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:28:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.565s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:17 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:28:17 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:28:17 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:28:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:28:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:28:17 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:28:17 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Updating instance_info_cache with network_info: [{"id": "b5adbddb-acb3-40b1-9768-923daa9f3a29", "address": "fa:16:3e:7f:dc:30", "network": {"id": "a06a4001-e7e0-4991-b68a-0a0395d22e19", "bridge": "br-int", "label": "tempest-TestStampPattern-341788822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464531969a244952b436e763f17ab970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5adbddb-ac", "ovs_interfaceid": "b5adbddb-acb3-40b1-9768-923daa9f3a29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:28:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:28:17 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:28:17 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:28:17 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:28:17 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:28:19 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:28:19 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:28:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:21 user nova-compute[74805]: DEBUG nova.compute.manager [req-ad7bf27f-e737-47fb-ad13-c07bc33fc042 req-382e70ac-efb9-4133-9365-2b44d9cbff1b service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-changed-dc86c423-92d8-43e7-a330-b1ebe656885a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:21 user nova-compute[74805]: DEBUG nova.compute.manager [req-ad7bf27f-e737-47fb-ad13-c07bc33fc042 req-382e70ac-efb9-4133-9365-2b44d9cbff1b service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Refreshing instance network info cache due to event network-changed-dc86c423-92d8-43e7-a330-b1ebe656885a. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:28:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ad7bf27f-e737-47fb-ad13-c07bc33fc042 req-382e70ac-efb9-4133-9365-2b44d9cbff1b service nova] Acquiring lock "refresh_cache-07831159-aab3-4f4a-8cc9-25d74e254ae2" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:28:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ad7bf27f-e737-47fb-ad13-c07bc33fc042 req-382e70ac-efb9-4133-9365-2b44d9cbff1b service nova] Acquired lock "refresh_cache-07831159-aab3-4f4a-8cc9-25d74e254ae2" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:28:21 user nova-compute[74805]: DEBUG nova.network.neutron [req-ad7bf27f-e737-47fb-ad13-c07bc33fc042 req-382e70ac-efb9-4133-9365-2b44d9cbff1b service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Refreshing network info cache for port dc86c423-92d8-43e7-a330-b1ebe656885a {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:28:22 user nova-compute[74805]: DEBUG nova.network.neutron [req-ad7bf27f-e737-47fb-ad13-c07bc33fc042 req-382e70ac-efb9-4133-9365-2b44d9cbff1b service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Updated VIF entry in instance network info cache for port dc86c423-92d8-43e7-a330-b1ebe656885a. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:28:22 user nova-compute[74805]: DEBUG nova.network.neutron [req-ad7bf27f-e737-47fb-ad13-c07bc33fc042 req-382e70ac-efb9-4133-9365-2b44d9cbff1b service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Updating instance_info_cache with network_info: [{"id": "dc86c423-92d8-43e7-a330-b1ebe656885a", "address": "fa:16:3e:97:a8:ea", "network": {"id": "139930e8-4754-4236-a668-4afcacf2fed1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-127286933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc86c423-92", "ovs_interfaceid": "dc86c423-92d8-43e7-a330-b1ebe656885a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "address": "fa:16:3e:50:4d:3b", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e7afc5-68", "ovs_interfaceid": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "address": "fa:16:3e:21:14:f4", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01ea0e4b-c9", "ovs_interfaceid": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e1f2018-b2ed-4d3c-8557-159094954698", "address": "fa:16:3e:23:69:29", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1f2018-b2", "ovs_interfaceid": "9e1f2018-b2ed-4d3c-8557-159094954698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "address": "fa:16:3e:d0:e7:b1", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04eb3fe-3f", "ovs_interfaceid": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2b44c84-229d-451e-b81c-e45ca53d6ef5", "address": "fa:16:3e:b4:2b:28", "network": {"id": "378a82b9-cfdf-45a5-82cb-25308188ce8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1809740597", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b44c84-22", "ovs_interfaceid": "b2b44c84-229d-451e-b81c-e45ca53d6ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "address": "fa:16:3e:90:ce:b7", "network": {"id": "378a82b9-cfdf-45a5-82cb-25308188ce8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1809740597", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dcaad31-1b", "ovs_interfaceid": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:28:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ad7bf27f-e737-47fb-ad13-c07bc33fc042 req-382e70ac-efb9-4133-9365-2b44d9cbff1b service nova] Releasing lock "refresh_cache-07831159-aab3-4f4a-8cc9-25d74e254ae2" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:24 user nova-compute[74805]: INFO nova.compute.manager [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Terminating instance
Nov 15 04:28:24 user nova-compute[74805]: DEBUG nova.compute.manager [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-fd40612c-3f5b-4f32-8867-e9854ddd890c req-0778c3ea-7187-41ff-9176-902da89c9767 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-unplugged-e7e7afc5-68c4-4483-848e-7a08e6ad2495 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-fd40612c-3f5b-4f32-8867-e9854ddd890c req-0778c3ea-7187-41ff-9176-902da89c9767 service nova] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-fd40612c-3f5b-4f32-8867-e9854ddd890c req-0778c3ea-7187-41ff-9176-902da89c9767 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-fd40612c-3f5b-4f32-8867-e9854ddd890c req-0778c3ea-7187-41ff-9176-902da89c9767 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-fd40612c-3f5b-4f32-8867-e9854ddd890c req-0778c3ea-7187-41ff-9176-902da89c9767 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] No waiting events found dispatching network-vif-unplugged-e7e7afc5-68c4-4483-848e-7a08e6ad2495 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-fd40612c-3f5b-4f32-8867-e9854ddd890c req-0778c3ea-7187-41ff-9176-902da89c9767 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-unplugged-e7e7afc5-68c4-4483-848e-7a08e6ad2495 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-6196e76e-7ac2-4f66-99e5-2429c2b51ef6 req-f907aa0d-40a5-465b-8f78-602dd10326cd service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-unplugged-dc86c423-92d8-43e7-a330-b1ebe656885a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6196e76e-7ac2-4f66-99e5-2429c2b51ef6 req-f907aa0d-40a5-465b-8f78-602dd10326cd service nova] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6196e76e-7ac2-4f66-99e5-2429c2b51ef6 req-f907aa0d-40a5-465b-8f78-602dd10326cd service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6196e76e-7ac2-4f66-99e5-2429c2b51ef6 req-f907aa0d-40a5-465b-8f78-602dd10326cd service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-6196e76e-7ac2-4f66-99e5-2429c2b51ef6 req-f907aa0d-40a5-465b-8f78-602dd10326cd service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] No waiting events found dispatching network-vif-unplugged-dc86c423-92d8-43e7-a330-b1ebe656885a {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-6196e76e-7ac2-4f66-99e5-2429c2b51ef6 req-f907aa0d-40a5-465b-8f78-602dd10326cd service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-unplugged-dc86c423-92d8-43e7-a330-b1ebe656885a for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-02409444-5abb-4aa3-8c75-9dc68ae656a2 req-fec87347-7d70-4ee7-a55b-aac9e91eb80a service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-unplugged-01ea0e4b-c98f-4380-9dd9-0b8a33f784f1 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-02409444-5abb-4aa3-8c75-9dc68ae656a2 req-fec87347-7d70-4ee7-a55b-aac9e91eb80a service nova] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-02409444-5abb-4aa3-8c75-9dc68ae656a2 req-fec87347-7d70-4ee7-a55b-aac9e91eb80a service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-02409444-5abb-4aa3-8c75-9dc68ae656a2 req-fec87347-7d70-4ee7-a55b-aac9e91eb80a service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-02409444-5abb-4aa3-8c75-9dc68ae656a2 req-fec87347-7d70-4ee7-a55b-aac9e91eb80a service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] No waiting events found dispatching network-vif-unplugged-01ea0e4b-c98f-4380-9dd9-0b8a33f784f1 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-02409444-5abb-4aa3-8c75-9dc68ae656a2 req-fec87347-7d70-4ee7-a55b-aac9e91eb80a service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-unplugged-01ea0e4b-c98f-4380-9dd9-0b8a33f784f1 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:25 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 4a2d5475-04a4-414d-9ce9-d5204494f898 is timed out.
Nov 15 04:28:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:25 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Successfully detached device vdc from instance 4a2d5475-04a4-414d-9ce9-d5204494f898 from the live domain config.
Nov 15 04:28:25 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJauStep', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:28:25 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:28:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0ef366-f07a-4f32-a6b7-ad13d087ff9b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:28:25 user nova-compute[74805]: No targets found.
Nov 15 04:28:25 user nova-compute[74805]: iSNS:
Nov 15 04:28:25 user nova-compute[74805]: No targets found.
Nov 15 04:28:25 user nova-compute[74805]: STATIC:
Nov 15 04:28:25 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745
Nov 15 04:28:25 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:28:25 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:28:25 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb
Nov 15 04:28:25 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:28:25 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:28:25 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f
Nov 15 04:28:25 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:28:25 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:28:25 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83
Nov 15 04:28:25 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:28:25 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:28:25 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf
Nov 15 04:28:25 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:28:25 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:28:25 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13
Nov 15 04:28:25 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:28:25 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:28:25 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312
Nov 15 04:28:25 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:28:25 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:28:25 user nova-compute[74805]: FIRMWARE:
Nov 15 04:28:25 user nova-compute[74805]: No targets found.
Nov 15 04:28:25 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:28:25 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:28:25 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd760a61-555a-4298-bb5f-891efd040cfa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb272b83-3e3a-4066-9182-458495a1c334]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:28:25 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:28:25 user nova-compute[74805]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)
Nov 15 04:28:25 user nova-compute[74805]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)
Nov 15 04:28:25 user nova-compute[74805]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:28:25 user nova-compute[74805]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)
Nov 15 04:28:25 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:28:25 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 (non-flash)
Nov 15 04:28:25 user nova-compute[74805]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:28:25 user nova-compute[74805]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)
Nov 15 04:28:25 user nova-compute[74805]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)
Nov 15 04:28:25 user nova-compute[74805]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:28:25 user nova-compute[74805]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)
Nov 15 04:28:25 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:28:25 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c7648b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312'): ({'sdc'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Removing single pathed devices sdc {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc531fd-5b31-4dbc-8025-1bcafd6a5853]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbadaff4-92c1-4b1b-8dc5-4f98ed7145a2]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Flushing IO for device /dev/sdc {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c55d99c-d4cf-4704-b0b1-af61229ead32]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.228s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad85e2bc-9cc0-4ae2-be7d-e7e3bb0934c7]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23331626262386133', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_fc7ec92d', '/dev/disk/by-id/scsi-1SCST_BIOfc7ec92d-31bbb8a39472e25f') {{(pid=85029) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6331a9b3-bcb4-49d6-ae88-58947b94c8e3]: (4, None) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c954d403-4ec6-48c1-8195-e49dffc7cef3]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 -p 172.16.0.220:3260 --logout" returned: 0 in 0.171s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[820a8d3f-0891-4a61-b8f5-6a6d1137b146]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312, portal: 172.16.0.220,3260]
Nov 15 04:28:25 user nova-compute[74805]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312, portal: 172.16.0.220,3260] successful.
Nov 15 04:28:25 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd635a1a-ac62-4627-8a17-e02f6328d312 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be5c269-025a-436b-ad73-2fb1e737ea5e]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.671s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] <== disconnect_volume: return (673ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:28:25 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Instance destroyed successfully.
Nov 15 04:28:25 user nova-compute[74805]: DEBUG nova.objects.instance [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lazy-loading 'resources' on Instance uuid 07831159-aab3-4f4a-8cc9-25d74e254ae2 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1873844826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1873844826',id=32,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqZkCUSoOrMa7ifMuGw6KskYm0ddSPTuC5l2fF8XxmzROteC0oBjHEzid9TYILC5ffFia4MmQDokK+XpN/+t424KLYwLutvEODoNkq9qNzPxtfd4Hfr+nfzxcQDZyj/ZQ==',key_name='tempest-keypair-1974570634',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:27:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d96d68212bfd495db1630d31eb10c5ff',ramdisk_id='',reservation_id='r-i2dle74p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-307297502',owner_user_name='tempest-TaggedBootDevicesTest_v242-307297502-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:27:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='061709b977974ab0bc342e0cbf4bb842',uuid=07831159-aab3-4f4a-8cc9-25d74e254ae2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc86c423-92d8-43e7-a330-b1ebe656885a", "address": "fa:16:3e:97:a8:ea", "network": {"id": "139930e8-4754-4236-a668-4afcacf2fed1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-127286933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc86c423-92", "ovs_interfaceid": "dc86c423-92d8-43e7-a330-b1ebe656885a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converting VIF {"id": "dc86c423-92d8-43e7-a330-b1ebe656885a", "address": "fa:16:3e:97:a8:ea", "network": {"id": "139930e8-4754-4236-a668-4afcacf2fed1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-127286933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc86c423-92", "ovs_interfaceid": "dc86c423-92d8-43e7-a330-b1ebe656885a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:a8:ea,bridge_name='br-int',has_traffic_filtering=True,id=dc86c423-92d8-43e7-a330-b1ebe656885a,network=Network(139930e8-4754-4236-a668-4afcacf2fed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc86c423-92') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG os_vif [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:a8:ea,bridge_name='br-int',has_traffic_filtering=True,id=dc86c423-92d8-43e7-a330-b1ebe656885a,network=Network(139930e8-4754-4236-a668-4afcacf2fed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc86c423-92') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc86c423-92, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=69ef834a-5e00-4d2e-a746-12f6bd3887d7) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:25 user nova-compute[74805]: INFO os_vif [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:a8:ea,bridge_name='br-int',has_traffic_filtering=True,id=dc86c423-92d8-43e7-a330-b1ebe656885a,network=Network(139930e8-4754-4236-a668-4afcacf2fed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc86c423-92')
Nov 15 04:28:25 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1873844826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1873844826',id=32,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqZkCUSoOrMa7ifMuGw6KskYm0ddSPTuC5l2fF8XxmzROteC0oBjHEzid9TYILC5ffFia4MmQDokK+XpN/+t424KLYwLutvEODoNkq9qNzPxtfd4Hfr+nfzxcQDZyj/ZQ==',key_name='tempest-keypair-1974570634',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:27:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d96d68212bfd495db1630d31eb10c5ff',ramdisk_id='',reservation_id='r-i2dle74p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-307297502',owner_user_name='tempest-TaggedBootDevicesTest_v242-307297502-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:27:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='061709b977974ab0bc342e0cbf4bb842',uuid=07831159-aab3-4f4a-8cc9-25d74e254ae2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "address": "fa:16:3e:50:4d:3b", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e7afc5-68", "ovs_interfaceid": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converting VIF {"id": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "address": "fa:16:3e:50:4d:3b", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e7afc5-68", "ovs_interfaceid": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:4d:3b,bridge_name='br-int',has_traffic_filtering=True,id=e7e7afc5-68c4-4483-848e-7a08e6ad2495,network=Network(98a0ba70-e465-40f4-8e47-aaed0b8beac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape7e7afc5-68') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG os_vif [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:4d:3b,bridge_name='br-int',has_traffic_filtering=True,id=e7e7afc5-68c4-4483-848e-7a08e6ad2495,network=Network(98a0ba70-e465-40f4-8e47-aaed0b8beac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape7e7afc5-68') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7e7afc5-68, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b283a5f-d14b-4dd5-8197-1edf8f96628c) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: INFO os_vif [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:4d:3b,bridge_name='br-int',has_traffic_filtering=True,id=e7e7afc5-68c4-4483-848e-7a08e6ad2495,network=Network(98a0ba70-e465-40f4-8e47-aaed0b8beac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape7e7afc5-68')
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1873844826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1873844826',id=32,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqZkCUSoOrMa7ifMuGw6KskYm0ddSPTuC5l2fF8XxmzROteC0oBjHEzid9TYILC5ffFia4MmQDokK+XpN/+t424KLYwLutvEODoNkq9qNzPxtfd4Hfr+nfzxcQDZyj/ZQ==',key_name='tempest-keypair-1974570634',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:27:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d96d68212bfd495db1630d31eb10c5ff',ramdisk_id='',reservation_id='r-i2dle74p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-307297502',owner_user_name='tempest-TaggedBootDevicesTest_v242-307297502-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:27:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='061709b977974ab0bc342e0cbf4bb842',uuid=07831159-aab3-4f4a-8cc9-25d74e254ae2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "address": "fa:16:3e:21:14:f4", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01ea0e4b-c9", "ovs_interfaceid": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converting VIF {"id": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "address": "fa:16:3e:21:14:f4", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01ea0e4b-c9", "ovs_interfaceid": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:14:f4,bridge_name='br-int',has_traffic_filtering=True,id=01ea0e4b-c98f-4380-9dd9-0b8a33f784f1,network=Network(98a0ba70-e465-40f4-8e47-aaed0b8beac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap01ea0e4b-c9') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_vif [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:14:f4,bridge_name='br-int',has_traffic_filtering=True,id=01ea0e4b-c98f-4380-9dd9-0b8a33f784f1,network=Network(98a0ba70-e465-40f4-8e47-aaed0b8beac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap01ea0e4b-c9') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01ea0e4b-c9, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=53d48187-2186-4ce7-8d25-4014557f928c) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: INFO os_vif [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:14:f4,bridge_name='br-int',has_traffic_filtering=True,id=01ea0e4b-c98f-4380-9dd9-0b8a33f784f1,network=Network(98a0ba70-e465-40f4-8e47-aaed0b8beac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap01ea0e4b-c9')
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1873844826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1873844826',id=32,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqZkCUSoOrMa7ifMuGw6KskYm0ddSPTuC5l2fF8XxmzROteC0oBjHEzid9TYILC5ffFia4MmQDokK+XpN/+t424KLYwLutvEODoNkq9qNzPxtfd4Hfr+nfzxcQDZyj/ZQ==',key_name='tempest-keypair-1974570634',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:27:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d96d68212bfd495db1630d31eb10c5ff',ramdisk_id='',reservation_id='r-i2dle74p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-307297502',owner_user_name='tempest-TaggedBootDevicesTest_v242-307297502-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:27:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='061709b977974ab0bc342e0cbf4bb842',uuid=07831159-aab3-4f4a-8cc9-25d74e254ae2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e1f2018-b2ed-4d3c-8557-159094954698", "address": "fa:16:3e:23:69:29", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1f2018-b2", "ovs_interfaceid": "9e1f2018-b2ed-4d3c-8557-159094954698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converting VIF {"id": "9e1f2018-b2ed-4d3c-8557-159094954698", "address": "fa:16:3e:23:69:29", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1f2018-b2", "ovs_interfaceid": "9e1f2018-b2ed-4d3c-8557-159094954698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:69:29,bridge_name='br-int',has_traffic_filtering=True,id=9e1f2018-b2ed-4d3c-8557-159094954698,network=Network(98a0ba70-e465-40f4-8e47-aaed0b8beac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e1f2018-b2') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_vif [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:69:29,bridge_name='br-int',has_traffic_filtering=True,id=9e1f2018-b2ed-4d3c-8557-159094954698,network=Network(98a0ba70-e465-40f4-8e47-aaed0b8beac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e1f2018-b2') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e1f2018-b2, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bf49827f-a892-43ec-9253-2dcaaa3c6b4e) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: INFO os_vif [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:69:29,bridge_name='br-int',has_traffic_filtering=True,id=9e1f2018-b2ed-4d3c-8557-159094954698,network=Network(98a0ba70-e465-40f4-8e47-aaed0b8beac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e1f2018-b2')
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1873844826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1873844826',id=32,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqZkCUSoOrMa7ifMuGw6KskYm0ddSPTuC5l2fF8XxmzROteC0oBjHEzid9TYILC5ffFia4MmQDokK+XpN/+t424KLYwLutvEODoNkq9qNzPxtfd4Hfr+nfzxcQDZyj/ZQ==',key_name='tempest-keypair-1974570634',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:27:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d96d68212bfd495db1630d31eb10c5ff',ramdisk_id='',reservation_id='r-i2dle74p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-307297502',owner_user_name='tempest-TaggedBootDevicesTest_v242-307297502-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:27:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='061709b977974ab0bc342e0cbf4bb842',uuid=07831159-aab3-4f4a-8cc9-25d74e254ae2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "address": "fa:16:3e:d0:e7:b1", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04eb3fe-3f", "ovs_interfaceid": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converting VIF {"id": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "address": "fa:16:3e:d0:e7:b1", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04eb3fe-3f", "ovs_interfaceid": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:e7:b1,bridge_name='br-int',has_traffic_filtering=True,id=f04eb3fe-3f8c-45d9-91f2-2f96f3757755,network=Network(98a0ba70-e465-40f4-8e47-aaed0b8beac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04eb3fe-3f') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_vif [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:e7:b1,bridge_name='br-int',has_traffic_filtering=True,id=f04eb3fe-3f8c-45d9-91f2-2f96f3757755,network=Network(98a0ba70-e465-40f4-8e47-aaed0b8beac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04eb3fe-3f') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf04eb3fe-3f, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=817adaa4-c546-4688-95c2-7ea54e01c492) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: INFO os_vif [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:e7:b1,bridge_name='br-int',has_traffic_filtering=True,id=f04eb3fe-3f8c-45d9-91f2-2f96f3757755,network=Network(98a0ba70-e465-40f4-8e47-aaed0b8beac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04eb3fe-3f')
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1873844826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1873844826',id=32,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqZkCUSoOrMa7ifMuGw6KskYm0ddSPTuC5l2fF8XxmzROteC0oBjHEzid9TYILC5ffFia4MmQDokK+XpN/+t424KLYwLutvEODoNkq9qNzPxtfd4Hfr+nfzxcQDZyj/ZQ==',key_name='tempest-keypair-1974570634',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:27:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d96d68212bfd495db1630d31eb10c5ff',ramdisk_id='',reservation_id='r-i2dle74p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-307297502',owner_user_name='tempest-TaggedBootDevicesTest_v242-307297502-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:27:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='061709b977974ab0bc342e0cbf4bb842',uuid=07831159-aab3-4f4a-8cc9-25d74e254ae2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2b44c84-229d-451e-b81c-e45ca53d6ef5", "address": "fa:16:3e:b4:2b:28", "network": {"id": "378a82b9-cfdf-45a5-82cb-25308188ce8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1809740597", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b44c84-22", "ovs_interfaceid": "b2b44c84-229d-451e-b81c-e45ca53d6ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converting VIF {"id": "b2b44c84-229d-451e-b81c-e45ca53d6ef5", "address": "fa:16:3e:b4:2b:28", "network": {"id": "378a82b9-cfdf-45a5-82cb-25308188ce8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1809740597", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b44c84-22", "ovs_interfaceid": "b2b44c84-229d-451e-b81c-e45ca53d6ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:2b:28,bridge_name='br-int',has_traffic_filtering=True,id=b2b44c84-229d-451e-b81c-e45ca53d6ef5,network=Network(378a82b9-cfdf-45a5-82cb-25308188ce8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2b44c84-22') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_vif [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:2b:28,bridge_name='br-int',has_traffic_filtering=True,id=b2b44c84-229d-451e-b81c-e45ca53d6ef5,network=Network(378a82b9-cfdf-45a5-82cb-25308188ce8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2b44c84-22') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2b44c84-22, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e28dc6d-058f-46ce-91c0-e2aef5a366fc) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: INFO os_vif [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:2b:28,bridge_name='br-int',has_traffic_filtering=True,id=b2b44c84-229d-451e-b81c-e45ca53d6ef5,network=Network(378a82b9-cfdf-45a5-82cb-25308188ce8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2b44c84-22')
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T04:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1873844826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1873844826',id=32,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqZkCUSoOrMa7ifMuGw6KskYm0ddSPTuC5l2fF8XxmzROteC0oBjHEzid9TYILC5ffFia4MmQDokK+XpN/+t424KLYwLutvEODoNkq9qNzPxtfd4Hfr+nfzxcQDZyj/ZQ==',key_name='tempest-keypair-1974570634',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:27:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d96d68212bfd495db1630d31eb10c5ff',ramdisk_id='',reservation_id='r-i2dle74p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-307297502',owner_user_name='tempest-TaggedBootDevicesTest_v242-307297502-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:27:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='061709b977974ab0bc342e0cbf4bb842',uuid=07831159-aab3-4f4a-8cc9-25d74e254ae2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "address": "fa:16:3e:90:ce:b7", "network": {"id": "378a82b9-cfdf-45a5-82cb-25308188ce8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1809740597", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dcaad31-1b", "ovs_interfaceid": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converting VIF {"id": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "address": "fa:16:3e:90:ce:b7", "network": {"id": "378a82b9-cfdf-45a5-82cb-25308188ce8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1809740597", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dcaad31-1b", "ovs_interfaceid": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:ce:b7,bridge_name='br-int',has_traffic_filtering=True,id=3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d,network=Network(378a82b9-cfdf-45a5-82cb-25308188ce8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dcaad31-1b') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_vif [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:ce:b7,bridge_name='br-int',has_traffic_filtering=True,id=3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d,network=Network(378a82b9-cfdf-45a5-82cb-25308188ce8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dcaad31-1b') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3dcaad31-1b, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5deb82af-4846-4276-a761-842eb9d4242a) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:26 user nova-compute[74805]: INFO os_vif [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:ce:b7,bridge_name='br-int',has_traffic_filtering=True,id=3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d,network=Network(378a82b9-cfdf-45a5-82cb-25308188ce8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dcaad31-1b')
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsQulWoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:28:26 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16da6ca-0818-48f3-980c-873063037c54]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:28:26 user nova-compute[74805]: No targets found.
Nov 15 04:28:26 user nova-compute[74805]: iSNS:
Nov 15 04:28:26 user nova-compute[74805]: No targets found.
Nov 15 04:28:26 user nova-compute[74805]: STATIC:
Nov 15 04:28:26 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745
Nov 15 04:28:26 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:28:26 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:28:26 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb
Nov 15 04:28:26 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:28:26 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:28:26 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f
Nov 15 04:28:26 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:28:26 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:28:26 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83
Nov 15 04:28:26 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:28:26 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:28:26 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf
Nov 15 04:28:26 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:28:26 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:28:26 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13
Nov 15 04:28:26 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:28:26 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:28:26 user nova-compute[74805]: FIRMWARE:
Nov 15 04:28:26 user nova-compute[74805]: No targets found.
Nov 15 04:28:26 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:28:26 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:28:26 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a562a8c8-eef4-460c-93a0-e50712303af5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-plugged-e7e7afc5-68c4-4483-848e-7a08e6ad2495 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] No waiting events found dispatching network-vif-plugged-e7e7afc5-68c4-4483-848e-7a08e6ad2495 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:28:26 user nova-compute[74805]: WARNING nova.compute.manager [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received unexpected event network-vif-plugged-e7e7afc5-68c4-4483-848e-7a08e6ad2495 for instance with vm_state active and task_state deleting.
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-unplugged-9e1f2018-b2ed-4d3c-8557-159094954698 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] No waiting events found dispatching network-vif-unplugged-9e1f2018-b2ed-4d3c-8557-159094954698 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-unplugged-9e1f2018-b2ed-4d3c-8557-159094954698 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-plugged-9e1f2018-b2ed-4d3c-8557-159094954698 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] No waiting events found dispatching network-vif-plugged-9e1f2018-b2ed-4d3c-8557-159094954698 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:28:26 user nova-compute[74805]: WARNING nova.compute.manager [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received unexpected event network-vif-plugged-9e1f2018-b2ed-4d3c-8557-159094954698 for instance with vm_state active and task_state deleting.
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-unplugged-f04eb3fe-3f8c-45d9-91f2-2f96f3757755 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] No waiting events found dispatching network-vif-unplugged-f04eb3fe-3f8c-45d9-91f2-2f96f3757755 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-unplugged-f04eb3fe-3f8c-45d9-91f2-2f96f3757755 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-plugged-f04eb3fe-3f8c-45d9-91f2-2f96f3757755 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] No waiting events found dispatching network-vif-plugged-f04eb3fe-3f8c-45d9-91f2-2f96f3757755 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:28:26 user nova-compute[74805]: WARNING nova.compute.manager [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received unexpected event network-vif-plugged-f04eb3fe-3f8c-45d9-91f2-2f96f3757755 for instance with vm_state active and task_state deleting.
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-unplugged-b2b44c84-229d-451e-b81c-e45ca53d6ef5 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] No waiting events found dispatching network-vif-unplugged-b2b44c84-229d-451e-b81c-e45ca53d6ef5 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-unplugged-b2b44c84-229d-451e-b81c-e45ca53d6ef5 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-plugged-b2b44c84-229d-451e-b81c-e45ca53d6ef5 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] No waiting events found dispatching network-vif-plugged-b2b44c84-229d-451e-b81c-e45ca53d6ef5 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:28:26 user nova-compute[74805]: WARNING nova.compute.manager [req-c6f5c31c-1780-4711-abf8-60a25329870b req-fcaca234-4d54-476a-b303-c02a202505b8 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received unexpected event network-vif-plugged-b2b44c84-229d-451e-b81c-e45ca53d6ef5 for instance with vm_state active and task_state deleting.
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[27caf0fa-c227-433c-92f3-1ba96483b598]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.objects.instance [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lazy-loading 'flavor' on Instance uuid 4a2d5475-04a4-414d-9ce9-d5204494f898 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-396af464-5bc0-47f9-b560-72b5db5646f3 req-d2e9ad00-7c91-4859-abc9-d56841e5a55c service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-plugged-dc86c423-92d8-43e7-a330-b1ebe656885a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-396af464-5bc0-47f9-b560-72b5db5646f3 req-d2e9ad00-7c91-4859-abc9-d56841e5a55c service nova] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-396af464-5bc0-47f9-b560-72b5db5646f3 req-d2e9ad00-7c91-4859-abc9-d56841e5a55c service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-396af464-5bc0-47f9-b560-72b5db5646f3 req-d2e9ad00-7c91-4859-abc9-d56841e5a55c service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-396af464-5bc0-47f9-b560-72b5db5646f3 req-d2e9ad00-7c91-4859-abc9-d56841e5a55c service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] No waiting events found dispatching network-vif-plugged-dc86c423-92d8-43e7-a330-b1ebe656885a {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:28:26 user nova-compute[74805]: WARNING nova.compute.manager [req-396af464-5bc0-47f9-b560-72b5db5646f3 req-d2e9ad00-7c91-4859-abc9-d56841e5a55c service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received unexpected event network-vif-plugged-dc86c423-92d8-43e7-a330-b1ebe656885a for instance with vm_state active and task_state deleting.
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:28:26 user nova-compute[74805]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)
Nov 15 04:28:26 user nova-compute[74805]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)
Nov 15 04:28:26 user nova-compute[74805]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:28:26 user nova-compute[74805]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)
Nov 15 04:28:26 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:28:26 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 (non-flash)
Nov 15 04:28:26 user nova-compute[74805]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)
Nov 15 04:28:26 user nova-compute[74805]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)
Nov 15 04:28:26 user nova-compute[74805]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:28:26 user nova-compute[74805]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)
Nov 15 04:28:26 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:28:26 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f7862aef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13'): ({'sdf'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Removing single pathed devices sdf {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5d8d2f-9a3d-443b-81ec-eb96d4ce5a38]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5c39b916-89c5-4eb6-9eab-8003ccd8e395 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "4a2d5475-04a4-414d-9ce9-d5204494f898" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.225s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa15a92-1765-4d24-b35c-9c0ae6b5ce93]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Flushing IO for device /dev/sdf {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[74638a2b-91b2-4211-b867-e77ed6a3bd19]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-e9d00e59-5f75-4d73-a238-12bbfb75f2ad req-0ddffab9-7ce8-4dce-8ef1-155f6f022bf0 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-plugged-01ea0e4b-c98f-4380-9dd9-0b8a33f784f1 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e9d00e59-5f75-4d73-a238-12bbfb75f2ad req-0ddffab9-7ce8-4dce-8ef1-155f6f022bf0 service nova] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e9d00e59-5f75-4d73-a238-12bbfb75f2ad req-0ddffab9-7ce8-4dce-8ef1-155f6f022bf0 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e9d00e59-5f75-4d73-a238-12bbfb75f2ad req-0ddffab9-7ce8-4dce-8ef1-155f6f022bf0 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-e9d00e59-5f75-4d73-a238-12bbfb75f2ad req-0ddffab9-7ce8-4dce-8ef1-155f6f022bf0 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] No waiting events found dispatching network-vif-plugged-01ea0e4b-c98f-4380-9dd9-0b8a33f784f1 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:28:26 user nova-compute[74805]: WARNING nova.compute.manager [req-e9d00e59-5f75-4d73-a238-12bbfb75f2ad req-0ddffab9-7ce8-4dce-8ef1-155f6f022bf0 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received unexpected event network-vif-plugged-01ea0e4b-c98f-4380-9dd9-0b8a33f784f1 for instance with vm_state active and task_state deleting.
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-e9d00e59-5f75-4d73-a238-12bbfb75f2ad req-0ddffab9-7ce8-4dce-8ef1-155f6f022bf0 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-unplugged-3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e9d00e59-5f75-4d73-a238-12bbfb75f2ad req-0ddffab9-7ce8-4dce-8ef1-155f6f022bf0 service nova] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e9d00e59-5f75-4d73-a238-12bbfb75f2ad req-0ddffab9-7ce8-4dce-8ef1-155f6f022bf0 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e9d00e59-5f75-4d73-a238-12bbfb75f2ad req-0ddffab9-7ce8-4dce-8ef1-155f6f022bf0 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-e9d00e59-5f75-4d73-a238-12bbfb75f2ad req-0ddffab9-7ce8-4dce-8ef1-155f6f022bf0 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] No waiting events found dispatching network-vif-unplugged-3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-e9d00e59-5f75-4d73-a238-12bbfb75f2ad req-0ddffab9-7ce8-4dce-8ef1-155f6f022bf0 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-unplugged-3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-e9d00e59-5f75-4d73-a238-12bbfb75f2ad req-0ddffab9-7ce8-4dce-8ef1-155f6f022bf0 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-plugged-3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e9d00e59-5f75-4d73-a238-12bbfb75f2ad req-0ddffab9-7ce8-4dce-8ef1-155f6f022bf0 service nova] Acquiring lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e9d00e59-5f75-4d73-a238-12bbfb75f2ad req-0ddffab9-7ce8-4dce-8ef1-155f6f022bf0 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e9d00e59-5f75-4d73-a238-12bbfb75f2ad req-0ddffab9-7ce8-4dce-8ef1-155f6f022bf0 service nova] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-e9d00e59-5f75-4d73-a238-12bbfb75f2ad req-0ddffab9-7ce8-4dce-8ef1-155f6f022bf0 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] No waiting events found dispatching network-vif-plugged-3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:28:26 user nova-compute[74805]: WARNING nova.compute.manager [req-e9d00e59-5f75-4d73-a238-12bbfb75f2ad req-0ddffab9-7ce8-4dce-8ef1-155f6f022bf0 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received unexpected event network-vif-plugged-3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d for instance with vm_state active and task_state deleting.
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f8d679-66ca-4dbf-894d-869fc5a39841]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] SCSI volumes sdf have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3061eb0b-50dc-42fc-b10c-f291e5376e34]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9feeb0a3-5219-4284-abd3-604c2fbb97b7]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13, portal: 172.16.0.220,3260]
Nov 15 04:28:26 user nova-compute[74805]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13, portal: 172.16.0.220,3260] successful.
Nov 15 04:28:26 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a565fc-6821-43c6-a60d-1a6863c86b13 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d23d9a0-8efb-4f19-8909-6139ef0136b4]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.431s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] <== disconnect_volume: return (433ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKHgnywb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:28:26 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7714c71d-1ef2-4ad4-9611-8312dd5f423d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:28:26 user nova-compute[74805]: No targets found.
Nov 15 04:28:26 user nova-compute[74805]: iSNS:
Nov 15 04:28:26 user nova-compute[74805]: No targets found.
Nov 15 04:28:26 user nova-compute[74805]: STATIC:
Nov 15 04:28:26 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745
Nov 15 04:28:26 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:28:26 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:28:26 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb
Nov 15 04:28:26 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:28:26 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:28:26 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f
Nov 15 04:28:26 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:28:26 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:28:26 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83
Nov 15 04:28:26 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:28:26 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:28:26 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf
Nov 15 04:28:26 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:28:26 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:28:26 user nova-compute[74805]: FIRMWARE:
Nov 15 04:28:26 user nova-compute[74805]: No targets found.
Nov 15 04:28:26 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:28:26 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:28:26 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbe80c9-4c93-442f-820f-3a8393b4dcd5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cc5930-60db-4594-a92c-927cf2493b2c]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)
Nov 15 04:28:27 user nova-compute[74805]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)
Nov 15 04:28:27 user nova-compute[74805]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:28:27 user nova-compute[74805]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)
Nov 15 04:28:27 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:28:27 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 (non-flash)
Nov 15 04:28:27 user nova-compute[74805]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)
Nov 15 04:28:27 user nova-compute[74805]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:28:27 user nova-compute[74805]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)
Nov 15 04:28:27 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:28:27 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f7862b2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745'): ({'sdd'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Removing single pathed devices sdd {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[76de32f5-36b7-4c0f-97d9-0e1340845236]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b989a3-7b9f-45cd-8e64-5c5717cffc83]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Flushing IO for device /dev/sdd {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fb89c5-c577-4acd-b93d-c883af654a84]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd28827-2a82-4959-8c23-35f2d4c8b844]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] SCSI volumes sdd have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5815f290-4c19-4173-a446-1d37ac6ae6f8]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb72fa2b-22a9-41c7-ba4c-306223801f07]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745, portal: 172.16.0.220,3260]
Nov 15 04:28:27 user nova-compute[74805]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745, portal: 172.16.0.220,3260] successful.
Nov 15 04:28:27 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21bdb111-72fd-476f-9401-4904721d3745 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e56c2b-9ea3-4c23-9945-cf551559eb76]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] <== disconnect_volume: return (356ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gdiAECQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:28:27 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15ad7e3-4e50-43e3-8576-3c4165d30cd2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:28:27 user nova-compute[74805]: No targets found.
Nov 15 04:28:27 user nova-compute[74805]: iSNS:
Nov 15 04:28:27 user nova-compute[74805]: No targets found.
Nov 15 04:28:27 user nova-compute[74805]: STATIC:
Nov 15 04:28:27 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb
Nov 15 04:28:27 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:28:27 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:28:27 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f
Nov 15 04:28:27 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:28:27 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:28:27 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83
Nov 15 04:28:27 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:28:27 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:28:27 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf
Nov 15 04:28:27 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:28:27 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:28:27 user nova-compute[74805]: FIRMWARE:
Nov 15 04:28:27 user nova-compute[74805]: No targets found.
Nov 15 04:28:27 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:28:27 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:28:27 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a322578-e8a8-4b74-b9f1-8ddb92c0d364]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[209599c6-efb4-4140-87d3-916a1312e717]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)
Nov 15 04:28:27 user nova-compute[74805]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:28:27 user nova-compute[74805]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)
Nov 15 04:28:27 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:28:27 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf (non-flash)
Nov 15 04:28:27 user nova-compute[74805]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:28:27 user nova-compute[74805]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)
Nov 15 04:28:27 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:28:27 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f7862a710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf'): ({'sdg'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Removing single pathed devices sdg {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37801bf-b464-460f-b07f-6a5f6f2f55f1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd47aef-33e5-4751-a8ea-36e1dfb6cbe2]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Flushing IO for device /dev/sdg {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[febca519-19f5-4e88-90f3-2ccd9a363311]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.059s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48d481f-e6fa-420b-a8b6-2914bdd90fd0]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] SCSI volumes sdg have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[976d62be-24c1-48f9-99e5-b80948eb6d50]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ddafa3-1cd5-429d-8a80-34774deb74e5]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf, portal: 172.16.0.220,3260]
Nov 15 04:28:27 user nova-compute[74805]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf, portal: 172.16.0.220,3260] successful.
Nov 15 04:28:27 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dce0ff9-f5c7-4329-9830-5c67a1e1f9cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f015e45-e7ab-4c91-b13e-c317d3406da6]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] <== disconnect_volume: return (349ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:28:27 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Deleting instance files /opt/stack/data/nova/instances/07831159-aab3-4f4a-8cc9-25d74e254ae2_del
Nov 15 04:28:27 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Deletion of /opt/stack/data/nova/instances/07831159-aab3-4f4a-8cc9-25d74e254ae2_del complete
Nov 15 04:28:27 user nova-compute[74805]: INFO nova.compute.manager [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Took 3.66 seconds to destroy the instance on the hypervisor.
Nov 15 04:28:27 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:28:27 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:28:29 user nova-compute[74805]: DEBUG nova.compute.manager [req-386761f0-5c12-4346-9b76-54c09523b9d8 req-5904514d-0efd-488f-9fab-e9c7e10e661f service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-deleted-b2b44c84-229d-451e-b81c-e45ca53d6ef5 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:29 user nova-compute[74805]: INFO nova.compute.manager [req-386761f0-5c12-4346-9b76-54c09523b9d8 req-5904514d-0efd-488f-9fab-e9c7e10e661f service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Neutron deleted interface b2b44c84-229d-451e-b81c-e45ca53d6ef5; detaching it from the instance and deleting it from the info cache
Nov 15 04:28:29 user nova-compute[74805]: DEBUG nova.network.neutron [req-386761f0-5c12-4346-9b76-54c09523b9d8 req-5904514d-0efd-488f-9fab-e9c7e10e661f service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Updating instance_info_cache with network_info: [{"id": "dc86c423-92d8-43e7-a330-b1ebe656885a", "address": "fa:16:3e:97:a8:ea", "network": {"id": "139930e8-4754-4236-a668-4afcacf2fed1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-127286933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc86c423-92", "ovs_interfaceid": "dc86c423-92d8-43e7-a330-b1ebe656885a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "address": "fa:16:3e:50:4d:3b", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e7afc5-68", "ovs_interfaceid": "e7e7afc5-68c4-4483-848e-7a08e6ad2495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "address": "fa:16:3e:21:14:f4", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01ea0e4b-c9", "ovs_interfaceid": "01ea0e4b-c98f-4380-9dd9-0b8a33f784f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9e1f2018-b2ed-4d3c-8557-159094954698", "address": "fa:16:3e:23:69:29", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1f2018-b2", "ovs_interfaceid": "9e1f2018-b2ed-4d3c-8557-159094954698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "address": "fa:16:3e:d0:e7:b1", "network": {"id": "98a0ba70-e465-40f4-8e47-aaed0b8beac7", "bridge": "br-int", "label": "tempest-device-tagging-net1-899879341", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04eb3fe-3f", "ovs_interfaceid": "f04eb3fe-3f8c-45d9-91f2-2f96f3757755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "address": "fa:16:3e:90:ce:b7", "network": {"id": "378a82b9-cfdf-45a5-82cb-25308188ce8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1809740597", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d96d68212bfd495db1630d31eb10c5ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dcaad31-1b", "ovs_interfaceid": "3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:28:29 user nova-compute[74805]: DEBUG nova.compute.manager [req-386761f0-5c12-4346-9b76-54c09523b9d8 req-5904514d-0efd-488f-9fab-e9c7e10e661f service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Detach interface failed, port_id=b2b44c84-229d-451e-b81c-e45ca53d6ef5, reason: Instance 07831159-aab3-4f4a-8cc9-25d74e254ae2 could not be found. {{(pid=74805) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 04:28:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:31 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:28:31 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Took 3.32 seconds to deallocate network for instance.
Nov 15 04:28:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:31 user nova-compute[74805]: DEBUG nova.compute.manager [req-d5026abb-4720-42f7-94df-e9dc20af58b7 req-be83bfac-f5af-4cab-87d8-0d5ef0669820 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-deleted-dc86c423-92d8-43e7-a330-b1ebe656885a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:31 user nova-compute[74805]: DEBUG nova.compute.manager [req-d5026abb-4720-42f7-94df-e9dc20af58b7 req-be83bfac-f5af-4cab-87d8-0d5ef0669820 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-deleted-f04eb3fe-3f8c-45d9-91f2-2f96f3757755 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:31 user nova-compute[74805]: DEBUG nova.compute.manager [req-d5026abb-4720-42f7-94df-e9dc20af58b7 req-be83bfac-f5af-4cab-87d8-0d5ef0669820 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-deleted-9e1f2018-b2ed-4d3c-8557-159094954698 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:31 user nova-compute[74805]: DEBUG nova.compute.manager [req-d5026abb-4720-42f7-94df-e9dc20af58b7 req-be83bfac-f5af-4cab-87d8-0d5ef0669820 service nova] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Received event network-vif-deleted-3dcaad31-1bef-4fbc-bbb4-18a3a1ab5e2d {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:33 user nova-compute[74805]: INFO nova.compute.manager [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] [instance: 07831159-aab3-4f4a-8cc9-25d74e254ae2] Took 2.31 seconds to detach 3 volumes for instance.
Nov 15 04:28:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:33 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:28:33 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:28:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:33 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Deleted allocations for instance 07831159-aab3-4f4a-8cc9-25d74e254ae2
Nov 15 04:28:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a5873535-6ab5-4724-9a43-f5b62c4b1682 tempest-TaggedBootDevicesTest_v242-307297502 tempest-TaggedBootDevicesTest_v242-307297502-project-member] Lock "07831159-aab3-4f4a-8cc9-25d74e254ae2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.838s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:28:43 user nova-compute[74805]: INFO nova.compute.manager [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Rescuing
Nov 15 04:28:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "refresh_cache-38196606-a9c9-4604-ad21-2ec7511a8b28" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:28:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquired lock "refresh_cache-38196606-a9c9-4604-ad21-2ec7511a8b28" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:28:43 user nova-compute[74805]: DEBUG nova.network.neutron [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:28:44 user nova-compute[74805]: DEBUG nova.network.neutron [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Updating instance_info_cache with network_info: [{"id": "23517101-97ec-4772-ab6b-6f626a6547bc", "address": "fa:16:3e:da:ef:08", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23517101-97", "ovs_interfaceid": "23517101-97ec-4772-ab6b-6f626a6547bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:28:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Releasing lock "refresh_cache-38196606-a9c9-4604-ad21-2ec7511a8b28" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:28:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-d6879da8-d419-4d4f-8ea0-87e7d8917707 req-0fdc6da6-1bd1-4ed4-ba0c-5587af1f12b2 service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Received event network-vif-unplugged-23517101-97ec-4772-ab6b-6f626a6547bc {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d6879da8-d419-4d4f-8ea0-87e7d8917707 req-0fdc6da6-1bd1-4ed4-ba0c-5587af1f12b2 service nova] Acquiring lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d6879da8-d419-4d4f-8ea0-87e7d8917707 req-0fdc6da6-1bd1-4ed4-ba0c-5587af1f12b2 service nova] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d6879da8-d419-4d4f-8ea0-87e7d8917707 req-0fdc6da6-1bd1-4ed4-ba0c-5587af1f12b2 service nova] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-d6879da8-d419-4d4f-8ea0-87e7d8917707 req-0fdc6da6-1bd1-4ed4-ba0c-5587af1f12b2 service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] No waiting events found dispatching network-vif-unplugged-23517101-97ec-4772-ab6b-6f626a6547bc {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:28:45 user nova-compute[74805]: WARNING nova.compute.manager [req-d6879da8-d419-4d4f-8ea0-87e7d8917707 req-0fdc6da6-1bd1-4ed4-ba0c-5587af1f12b2 service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Received unexpected event network-vif-unplugged-23517101-97ec-4772-ab6b-6f626a6547bc for instance with vm_state active and task_state rescuing.
Nov 15 04:28:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:45 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Instance destroyed successfully.
Nov 15 04:28:45 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Attempting a stable device rescue
Nov 15 04:28:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74805) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 04:28:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Instance directory exists: not creating {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 04:28:45 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Creating image(s)
Nov 15 04:28:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "/opt/stack/data/nova/instances/38196606-a9c9-4604-ad21-2ec7511a8b28/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "/opt/stack/data/nova/instances/38196606-a9c9-4604-ad21-2ec7511a8b28/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "/opt/stack/data/nova/instances/38196606-a9c9-4604-ad21-2ec7511a8b28/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:45 user nova-compute[74805]: DEBUG nova.objects.instance [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lazy-loading 'trusted_certs' on Instance uuid 38196606-a9c9-4604-ad21-2ec7511a8b28 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:28:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "a32bca047063c6290680328ffec321473cc86545" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "a32bca047063c6290680328ffec321473cc86545" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a32bca047063c6290680328ffec321473cc86545.part --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a32bca047063c6290680328ffec321473cc86545.part --force-share --output=json" returned: 0 in 0.175s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:46 user nova-compute[74805]: DEBUG nova.virt.images [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] c1d2ac25-902c-4944-abfd-8606a754728a was qcow2, converting to raw {{(pid=74805) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 04:28:46 user nova-compute[74805]: DEBUG nova.privsep.utils [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74805) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 04:28:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a32bca047063c6290680328ffec321473cc86545.part /opt/stack/data/nova/instances/_base/a32bca047063c6290680328ffec321473cc86545.converted {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG nova.compute.manager [req-f9692762-6991-477f-aa9c-26c07b6faaaa req-d02667ed-5b0e-4722-9991-1d7aaa0e310a service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Received event network-vif-plugged-23517101-97ec-4772-ab6b-6f626a6547bc {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f9692762-6991-477f-aa9c-26c07b6faaaa req-d02667ed-5b0e-4722-9991-1d7aaa0e310a service nova] Acquiring lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f9692762-6991-477f-aa9c-26c07b6faaaa req-d02667ed-5b0e-4722-9991-1d7aaa0e310a service nova] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f9692762-6991-477f-aa9c-26c07b6faaaa req-d02667ed-5b0e-4722-9991-1d7aaa0e310a service nova] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG nova.compute.manager [req-f9692762-6991-477f-aa9c-26c07b6faaaa req-d02667ed-5b0e-4722-9991-1d7aaa0e310a service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] No waiting events found dispatching network-vif-plugged-23517101-97ec-4772-ab6b-6f626a6547bc {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:28:47 user nova-compute[74805]: WARNING nova.compute.manager [req-f9692762-6991-477f-aa9c-26c07b6faaaa req-d02667ed-5b0e-4722-9991-1d7aaa0e310a service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Received unexpected event network-vif-plugged-23517101-97ec-4772-ab6b-6f626a6547bc for instance with vm_state active and task_state rescuing.
Nov 15 04:28:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a32bca047063c6290680328ffec321473cc86545.part /opt/stack/data/nova/instances/_base/a32bca047063c6290680328ffec321473cc86545.converted" returned: 0 in 0.426s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a32bca047063c6290680328ffec321473cc86545.converted --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a32bca047063c6290680328ffec321473cc86545.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "a32bca047063c6290680328ffec321473cc86545" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.998s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "a32bca047063c6290680328ffec321473cc86545" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "a32bca047063c6290680328ffec321473cc86545" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a32bca047063c6290680328ffec321473cc86545 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a32bca047063c6290680328ffec321473cc86545 --force-share --output=json" returned: 0 in 0.175s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a32bca047063c6290680328ffec321473cc86545,backing_fmt=raw /opt/stack/data/nova/instances/38196606-a9c9-4604-ad21-2ec7511a8b28/disk.rescue {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a32bca047063c6290680328ffec321473cc86545,backing_fmt=raw /opt/stack/data/nova/instances/38196606-a9c9-4604-ad21-2ec7511a8b28/disk.rescue" returned: 0 in 0.048s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "a32bca047063c6290680328ffec321473cc86545" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG nova.objects.instance [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lazy-loading 'migration_context' on Instance uuid 38196606-a9c9-4604-ad21-2ec7511a8b28 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG nova.objects.base [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Object Instance<38196606-a9c9-4604-ad21-2ec7511a8b28> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Start _get_guest_xml network_info=[{"id": "23517101-97ec-4772-ab6b-6f626a6547bc", "address": "fa:16:3e:da:ef:08", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "vif_mac": "fa:16:3e:da:ef:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23517101-97", "ovs_interfaceid": "23517101-97ec-4772-ab6b-6f626a6547bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c1d2ac25-902c-4944-abfd-8606a754728a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qbpwgdVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '38196606-a9c9-4604-ad21-2ec7511a8b28', 'attached_at': '', 'detached_at': '', 'volume_id': 'bf8cdd86-a2fb-4387-a1e6-0e354edafa6f', 'serial': 'bf8cdd86-a2fb-4387-a1e6-0e354edafa6f'}, 'delete_on_termination': False, 'attachment_id': '92d131ac-1e4f-4f5b-81fd-0a3db31dbf6f', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG nova.objects.instance [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lazy-loading 'resources' on Instance uuid 38196606-a9c9-4604-ad21-2ec7511a8b28 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG nova.objects.base [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Object Instance<38196606-a9c9-4604-ad21-2ec7511a8b28> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG nova.objects.instance [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lazy-loading 'numa_topology' on Instance uuid 38196606-a9c9-4604-ad21-2ec7511a8b28 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG nova.objects.base [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Object Instance<38196606-a9c9-4604-ad21-2ec7511a8b28> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:28:47 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:28:47 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:28:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG nova.objects.instance [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lazy-loading 'vcpu_model' on Instance uuid 38196606-a9c9-4604-ad21-2ec7511a8b28 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG nova.objects.base [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Object Instance<38196606-a9c9-4604-ad21-2ec7511a8b28> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qbpwgdVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:28:47 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:28:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:28:47 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:28:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:28:47 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:28:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8260685a-00e0-475a-8ce6-79097d2b0a76]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = qbpwgdVH\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 04:28:47 user nova-compute[74805]: node.name = iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f
Nov 15 04:28:47 user nova-compute[74805]: node.tpgt = -1
Nov 15 04:28:47 user nova-compute[74805]: node.startup = automatic
Nov 15 04:28:47 user nova-compute[74805]: node.leading_login = No
Nov 15 04:28:47 user nova-compute[74805]: iface.iscsi_ifacename = default
Nov 15 04:28:47 user nova-compute[74805]: iface.net_ifacename = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.ipaddress = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.prefix_len = 0
Nov 15 04:28:47 user nova-compute[74805]: iface.hwaddress = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.transport_name = tcp
Nov 15 04:28:47 user nova-compute[74805]: iface.initiatorname = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.state = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.vlan_id = 0
Nov 15 04:28:47 user nova-compute[74805]: iface.vlan_priority = 0
Nov 15 04:28:47 user nova-compute[74805]: iface.vlan_state = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.iface_num = 0
Nov 15 04:28:47 user nova-compute[74805]: iface.mtu = 0
Nov 15 04:28:47 user nova-compute[74805]: iface.port = 0
Nov 15 04:28:47 user nova-compute[74805]: iface.bootproto = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.subnet_mask = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.gateway = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.dhcp_alt_client_id = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.dhcp_dns = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.dhcp_learn_iqn = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.dhcp_vendor_id_state = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.dhcp_vendor_id = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.dhcp_slp_da = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.fragmentation = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.gratuitous_arp = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.incoming_forwarding = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.tos_state = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.tos = 0
Nov 15 04:28:47 user nova-compute[74805]: iface.ttl = 0
Nov 15 04:28:47 user nova-compute[74805]: iface.delayed_ack = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.tcp_nagle = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.tcp_wsf_state = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.tcp_wsf = 0
Nov 15 04:28:47 user nova-compute[74805]: iface.tcp_timer_scale = 0
Nov 15 04:28:47 user nova-compute[74805]: iface.tcp_timestamp = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.redirect = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.def_task_mgmt_timeout = 0
Nov 15 04:28:47 user nova-compute[74805]: iface.header_digest = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.data_digest = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.immediate_data = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.initial_r2t = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.data_seq_inorder = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.data_pdu_inorder = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.erl = 0
Nov 15 04:28:47 user nova-compute[74805]: iface.max_receive_data_len = 0
Nov 15 04:28:47 user nova-compute[74805]: iface.first_burst_len = 0
Nov 15 04:28:47 user nova-compute[74805]: iface.max_outstanding_r2t = 0
Nov 15 04:28:47 user nova-compute[74805]: iface.max_burst_len = 0
Nov 15 04:28:47 user nova-compute[74805]: iface.chap_auth = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.bidi_chap = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.strict_login_compliance = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.discovery_auth = <empty>
Nov 15 04:28:47 user nova-compute[74805]: iface.discovery_logout = <empty>
Nov 15 04:28:47 user nova-compute[74805]: node.discovery_address = <empty>
Nov 15 04:28:47 user nova-compute[74805]: node.discovery_port = 0
Nov 15 04:28:47 user nova-compute[74805]: node.discovery_type = static
Nov 15 04:28:47 user nova-compute[74805]: node.session.initial_cmdsn = 0
Nov 15 04:28:47 user nova-compute[74805]: node.session.initial_login_retry_max = 8
Nov 15 04:28:47 user nova-compute[74805]: node.session.xmit_thread_priority = -20
Nov 15 04:28:47 user nova-compute[74805]: node.session.cmds_max = 128
Nov 15 04:28:47 user nova-compute[74805]: node.session.queue_depth = 32
Nov 15 04:28:47 user nova-compute[74805]: node.session.nr_sessions = 1
Nov 15 04:28:47 user nova-compute[74805]: node.session.auth.authmethod = CHAP
Nov 15 04:28:47 user nova-compute[74805]: node.session.auth.username = qbpwgdVH
Nov 15 04:28:47 user nova-compute[74805]: node.session.auth.password = ***
Nov 15 04:28:47 user nova-compute[74805]: node.session.auth.username_in = <empty>
Nov 15 04:28:47 user nova-compute[74805]: node.session.auth.password_in = <empty>
Nov 15 04:28:47 user nova-compute[74805]: node.session.auth.chap_algs = MD5
Nov 15 04:28:47 user nova-compute[74805]: node.session.timeo.replacement_timeout = 120
Nov 15 04:28:47 user nova-compute[74805]: node.session.err_timeo.abort_timeout = 15
Nov 15 04:28:47 user nova-compute[74805]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 04:28:47 user nova-compute[74805]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 04:28:47 user nova-compute[74805]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 04:28:47 user nova-compute[74805]: node.session.iscsi.FastAbort = Yes
Nov 15 04:28:47 user nova-compute[74805]: node.session.iscsi.InitialR2T = No
Nov 15 04:28:47 user nova-compute[74805]: node.session.iscsi.ImmediateData = Yes
Nov 15 04:28:47 user nova-compute[74805]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 04:28:47 user nova-compute[74805]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 04:28:47 user nova-compute[74805]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 04:28:47 user nova-compute[74805]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 04:28:47 user nova-compute[74805]: node.session.iscsi.MaxConnections = 1
Nov 15 04:28:47 user nova-compute[74805]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 04:28:47 user nova-compute[74805]: node.session.iscsi.ERL = 0
Nov 15 04:28:47 user nova-compute[74805]: node.session.scan = manual
Nov 15 04:28:47 user nova-compute[74805]: node.session.reopen_max = 0
Nov 15 04:28:47 user nova-compute[74805]: node.conn[0].address = 172.16.0.220
Nov 15 04:28:47 user nova-compute[74805]: node.conn[0].port = 3260
Nov 15 04:28:47 user nova-compute[74805]: node.conn[0].startup = manual
Nov 15 04:28:47 user nova-compute[74805]: node.conn[0].tcp.window_size = 524288
Nov 15 04:28:47 user nova-compute[74805]: node.conn[0].tcp.type_of_service = 0
Nov 15 04:28:47 user nova-compute[74805]: node.conn[0].timeo.logout_timeout = 15
Nov 15 04:28:47 user nova-compute[74805]: node.conn[0].timeo.login_timeout = 15
Nov 15 04:28:47 user nova-compute[74805]: node.conn[0].timeo.auth_timeout = 45
Nov 15 04:28:47 user nova-compute[74805]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 04:28:47 user nova-compute[74805]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 04:28:47 user nova-compute[74805]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 04:28:47 user nova-compute[74805]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 04:28:47 user nova-compute[74805]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 04:28:47 user nova-compute[74805]: node.conn[0].iscsi.DataDigest = None
Nov 15 04:28:47 user nova-compute[74805]: node.conn[0].iscsi.IFMarker = No
Nov 15 04:28:47 user nova-compute[74805]: node.conn[0].iscsi.OFMarker = No
Nov 15 04:28:47 user nova-compute[74805]: # END RECORD
Nov 15 04:28:47 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:28:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd99439-b0f6-4dc6-bd05-8beac3739fbf]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2cef8c8-1161-4a18-a117-b92fd369ac43]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qbpwgdVH {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qbpwgdVH" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[83744995-d8dd-416d-97b7-516f7d183a0a]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qbpwgdVH'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.187s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[36967aef-e1ea-4d01-9e7e-e7e440615b27]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[736272bb-e7fb-48b6-8695-8e0466186c3c]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:28:48 user nova-compute[74805]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)
Nov 15 04:28:48 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:28:48 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:28:48 user nova-compute[74805]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)
Nov 15 04:28:48 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:28:48 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] HCTL ('39', '0', '0', 0) found on session 38 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Scanning host 39 c: 0, t: 0, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42aa9ce-c54f-4f3d-86c4-b1c2e8560576]: (4, ('0 0 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Searching for a device in session 38 and hctl ('39', '0', '0', 0) yield: sdh {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qbpwgdVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.326s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] <== connect_volume: return (327ms) {'type': 'block', 'scsi_wwn': '26332383866366438', 'path': '/dev/sdh'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332383866366438', 'path': '/dev/sdh'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:26:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-839976471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-839976471',id=33,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:27:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d11645073d58476491d101b9f3ee4052',ramdisk_id='',reservation_id='r-vt73w83j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1297861260',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:27:10Z,user_data=None,user_id='8cba9273daa1478fa6cc8274443b4f40',uuid=38196606-a9c9-4604-ad21-2ec7511a8b28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23517101-97ec-4772-ab6b-6f626a6547bc", "address": "fa:16:3e:da:ef:08", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "vif_mac": "fa:16:3e:da:ef:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23517101-97", "ovs_interfaceid": "23517101-97ec-4772-ab6b-6f626a6547bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Converting VIF {"id": "23517101-97ec-4772-ab6b-6f626a6547bc", "address": "fa:16:3e:da:ef:08", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "vif_mac": "fa:16:3e:da:ef:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23517101-97", "ovs_interfaceid": "23517101-97ec-4772-ab6b-6f626a6547bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:ef:08,bridge_name='br-int',has_traffic_filtering=True,id=23517101-97ec-4772-ab6b-6f626a6547bc,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23517101-97') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG nova.objects.instance [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lazy-loading 'pci_devices' on Instance uuid 38196606-a9c9-4604-ad21-2ec7511a8b28 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG nova.objects.base [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Object Instance<38196606-a9c9-4604-ad21-2ec7511a8b28> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:28:48 user nova-compute[74805]:   <uuid>38196606-a9c9-4604-ad21-2ec7511a8b28</uuid>
Nov 15 04:28:48 user nova-compute[74805]:   <name>instance-00000021</name>
Nov 15 04:28:48 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:28:48 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:28:48 user nova-compute[74805]:   <metadata>
Nov 15 04:28:48 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:28:48 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:28:48 user nova-compute[74805]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-839976471</nova:name>
Nov 15 04:28:48 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:28:47</nova:creationTime>
Nov 15 04:28:48 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:28:48 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:28:48 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:28:48 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:28:48 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:28:48 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:28:48 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:28:48 user nova-compute[74805]:       <nova:owner>
Nov 15 04:28:48 user nova-compute[74805]:         <nova:user uuid="8cba9273daa1478fa6cc8274443b4f40">tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member</nova:user>
Nov 15 04:28:48 user nova-compute[74805]:         <nova:project uuid="d11645073d58476491d101b9f3ee4052">tempest-ServerBootFromVolumeStableRescueTest-1297861260</nova:project>
Nov 15 04:28:48 user nova-compute[74805]:       </nova:owner>
Nov 15 04:28:48 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:28:48 user nova-compute[74805]:       <nova:ports>
Nov 15 04:28:48 user nova-compute[74805]:         <nova:port uuid="23517101-97ec-4772-ab6b-6f626a6547bc">
Nov 15 04:28:48 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 04:28:48 user nova-compute[74805]:         </nova:port>
Nov 15 04:28:48 user nova-compute[74805]:       </nova:ports>
Nov 15 04:28:48 user nova-compute[74805]:     </nova:instance>
Nov 15 04:28:48 user nova-compute[74805]:   </metadata>
Nov 15 04:28:48 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:28:48 user nova-compute[74805]:     <system>
Nov 15 04:28:48 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:28:48 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:28:48 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:28:48 user nova-compute[74805]:       <entry name="serial">38196606-a9c9-4604-ad21-2ec7511a8b28</entry>
Nov 15 04:28:48 user nova-compute[74805]:       <entry name="uuid">38196606-a9c9-4604-ad21-2ec7511a8b28</entry>
Nov 15 04:28:48 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:28:48 user nova-compute[74805]:     </system>
Nov 15 04:28:48 user nova-compute[74805]:   </sysinfo>
Nov 15 04:28:48 user nova-compute[74805]:   <os>
Nov 15 04:28:48 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:28:48 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:28:48 user nova-compute[74805]:   </os>
Nov 15 04:28:48 user nova-compute[74805]:   <features>
Nov 15 04:28:48 user nova-compute[74805]:     <acpi/>
Nov 15 04:28:48 user nova-compute[74805]:     <apic/>
Nov 15 04:28:48 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:28:48 user nova-compute[74805]:   </features>
Nov 15 04:28:48 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:28:48 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:28:48 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:28:48 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:28:48 user nova-compute[74805]:   </clock>
Nov 15 04:28:48 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:28:48 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:28:48 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:28:48 user nova-compute[74805]:   </cpu>
Nov 15 04:28:48 user nova-compute[74805]:   <devices>
Nov 15 04:28:48 user nova-compute[74805]:     <disk type="block" device="disk">
Nov 15 04:28:48 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:28:48 user nova-compute[74805]:       <source dev="/dev/sdh"/>
Nov 15 04:28:48 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:28:48 user nova-compute[74805]:       <serial>bf8cdd86-a2fb-4387-a1e6-0e354edafa6f</serial>
Nov 15 04:28:48 user nova-compute[74805]:     </disk>
Nov 15 04:28:48 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:28:48 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:28:48 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/38196606-a9c9-4604-ad21-2ec7511a8b28/disk.rescue"/>
Nov 15 04:28:48 user nova-compute[74805]:       <target dev="vdb" bus="virtio"/>
Nov 15 04:28:48 user nova-compute[74805]:       <boot order="1"/>
Nov 15 04:28:48 user nova-compute[74805]:     </disk>
Nov 15 04:28:48 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:28:48 user nova-compute[74805]:       <mac address="fa:16:3e:da:ef:08"/>
Nov 15 04:28:48 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:28:48 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:28:48 user nova-compute[74805]:       <target dev="tap23517101-97"/>
Nov 15 04:28:48 user nova-compute[74805]:     </interface>
Nov 15 04:28:48 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:28:48 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/38196606-a9c9-4604-ad21-2ec7511a8b28/console.log" append="off"/>
Nov 15 04:28:48 user nova-compute[74805]:     </serial>
Nov 15 04:28:48 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:28:48 user nova-compute[74805]:     <video>
Nov 15 04:28:48 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:28:48 user nova-compute[74805]:     </video>
Nov 15 04:28:48 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:28:48 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:28:48 user nova-compute[74805]:     </rng>
Nov 15 04:28:48 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:28:48 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:28:48 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:28:48 user nova-compute[74805]:     </memballoon>
Nov 15 04:28:48 user nova-compute[74805]:   </devices>
Nov 15 04:28:48 user nova-compute[74805]: </domain>
Nov 15 04:28:48 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:28:48 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Instance destroyed successfully.
Nov 15 04:28:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:28:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] No VIF found with MAC fa:16:3e:da:ef:08, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:28:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:49 user nova-compute[74805]: DEBUG nova.compute.manager [req-520659db-ab31-4b4f-a905-a582bc24dd6d req-96b6f457-3707-49d0-a802-5720f8b3227d service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Received event network-vif-plugged-23517101-97ec-4772-ab6b-6f626a6547bc {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-520659db-ab31-4b4f-a905-a582bc24dd6d req-96b6f457-3707-49d0-a802-5720f8b3227d service nova] Acquiring lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-520659db-ab31-4b4f-a905-a582bc24dd6d req-96b6f457-3707-49d0-a802-5720f8b3227d service nova] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-520659db-ab31-4b4f-a905-a582bc24dd6d req-96b6f457-3707-49d0-a802-5720f8b3227d service nova] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:49 user nova-compute[74805]: DEBUG nova.compute.manager [req-520659db-ab31-4b4f-a905-a582bc24dd6d req-96b6f457-3707-49d0-a802-5720f8b3227d service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] No waiting events found dispatching network-vif-plugged-23517101-97ec-4772-ab6b-6f626a6547bc {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:28:49 user nova-compute[74805]: WARNING nova.compute.manager [req-520659db-ab31-4b4f-a905-a582bc24dd6d req-96b6f457-3707-49d0-a802-5720f8b3227d service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Received unexpected event network-vif-plugged-23517101-97ec-4772-ab6b-6f626a6547bc for instance with vm_state active and task_state rescuing.
Nov 15 04:28:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:51 user nova-compute[74805]: DEBUG nova.compute.manager [req-0e824fea-9750-43d6-9a48-87cd92ece95c req-9b5bce51-c28e-45f5-9855-ef67a89727c9 service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Received event network-vif-plugged-23517101-97ec-4772-ab6b-6f626a6547bc {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0e824fea-9750-43d6-9a48-87cd92ece95c req-9b5bce51-c28e-45f5-9855-ef67a89727c9 service nova] Acquiring lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0e824fea-9750-43d6-9a48-87cd92ece95c req-9b5bce51-c28e-45f5-9855-ef67a89727c9 service nova] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0e824fea-9750-43d6-9a48-87cd92ece95c req-9b5bce51-c28e-45f5-9855-ef67a89727c9 service nova] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:51 user nova-compute[74805]: DEBUG nova.compute.manager [req-0e824fea-9750-43d6-9a48-87cd92ece95c req-9b5bce51-c28e-45f5-9855-ef67a89727c9 service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] No waiting events found dispatching network-vif-plugged-23517101-97ec-4772-ab6b-6f626a6547bc {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:28:51 user nova-compute[74805]: WARNING nova.compute.manager [req-0e824fea-9750-43d6-9a48-87cd92ece95c req-9b5bce51-c28e-45f5-9855-ef67a89727c9 service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Received unexpected event network-vif-plugged-23517101-97ec-4772-ab6b-6f626a6547bc for instance with vm_state active and task_state rescuing.
Nov 15 04:28:52 user nova-compute[74805]: DEBUG nova.compute.manager [None req-091b4a6a-4fdd-4685-883b-83d6d0afb277 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:28:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-24a07423-6ef6-4bce-b31c-01fee781bf8b tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "4a2d5475-04a4-414d-9ce9-d5204494f898" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-24a07423-6ef6-4bce-b31c-01fee781bf8b tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "4a2d5475-04a4-414d-9ce9-d5204494f898" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-24a07423-6ef6-4bce-b31c-01fee781bf8b tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "4a2d5475-04a4-414d-9ce9-d5204494f898-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-24a07423-6ef6-4bce-b31c-01fee781bf8b tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "4a2d5475-04a4-414d-9ce9-d5204494f898-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-24a07423-6ef6-4bce-b31c-01fee781bf8b tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "4a2d5475-04a4-414d-9ce9-d5204494f898-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:54 user nova-compute[74805]: INFO nova.compute.manager [None req-24a07423-6ef6-4bce-b31c-01fee781bf8b tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Terminating instance
Nov 15 04:28:54 user nova-compute[74805]: DEBUG nova.compute.manager [None req-24a07423-6ef6-4bce-b31c-01fee781bf8b tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:28:54 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:54 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:54 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:54 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:55 user nova-compute[74805]: DEBUG nova.compute.manager [req-b8247271-4427-4059-b50c-942a976389c0 req-9da7f94b-3b27-42ee-a66d-cc63fabda6fd service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Received event network-vif-unplugged-90a9632d-7041-430e-a0f4-0b8ec60eb332 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b8247271-4427-4059-b50c-942a976389c0 req-9da7f94b-3b27-42ee-a66d-cc63fabda6fd service nova] Acquiring lock "4a2d5475-04a4-414d-9ce9-d5204494f898-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b8247271-4427-4059-b50c-942a976389c0 req-9da7f94b-3b27-42ee-a66d-cc63fabda6fd service nova] Lock "4a2d5475-04a4-414d-9ce9-d5204494f898-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b8247271-4427-4059-b50c-942a976389c0 req-9da7f94b-3b27-42ee-a66d-cc63fabda6fd service nova] Lock "4a2d5475-04a4-414d-9ce9-d5204494f898-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:55 user nova-compute[74805]: DEBUG nova.compute.manager [req-b8247271-4427-4059-b50c-942a976389c0 req-9da7f94b-3b27-42ee-a66d-cc63fabda6fd service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] No waiting events found dispatching network-vif-unplugged-90a9632d-7041-430e-a0f4-0b8ec60eb332 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:28:55 user nova-compute[74805]: DEBUG nova.compute.manager [req-b8247271-4427-4059-b50c-942a976389c0 req-9da7f94b-3b27-42ee-a66d-cc63fabda6fd service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Received event network-vif-unplugged-90a9632d-7041-430e-a0f4-0b8ec60eb332 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:28:55 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Instance destroyed successfully.
Nov 15 04:28:55 user nova-compute[74805]: DEBUG nova.objects.instance [None req-24a07423-6ef6-4bce-b31c-01fee781bf8b tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lazy-loading 'resources' on Instance uuid 4a2d5475-04a4-414d-9ce9-d5204494f898 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:28:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-24a07423-6ef6-4bce-b31c-01fee781bf8b tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T04:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-918598282',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-918598282',id=25,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMymrvqIzYGxGC8fgN4EdQbJ0JI3rZYj1T8Y5E6V+FSJeCmAYkDYrYJ8BCpQMPV7261ZAXmjrXyft6H81pTvLfoVVhh1tKM5UtLUU619sjSGelYRZRrJtmj2R7elo05DA==',key_name='tempest-keypair-1201355498',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:26:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e01874e82ed4ae08813343751506eeb',ramdisk_id='',reservation_id='r-0vg8si2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2114494734',owner_user_name='tempest-AttachVolumeShelveTestJSON-2114494734-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:26:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2876983d30794d8db191857d2f420f7d',uuid=4a2d5475-04a4-414d-9ce9-d5204494f898,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "address": "fa:16:3e:61:a1:b6", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a9632d-70", "ovs_interfaceid": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:28:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-24a07423-6ef6-4bce-b31c-01fee781bf8b tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Converting VIF {"id": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "address": "fa:16:3e:61:a1:b6", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a9632d-70", "ovs_interfaceid": "90a9632d-7041-430e-a0f4-0b8ec60eb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:28:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-24a07423-6ef6-4bce-b31c-01fee781bf8b tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:a1:b6,bridge_name='br-int',has_traffic_filtering=True,id=90a9632d-7041-430e-a0f4-0b8ec60eb332,network=Network(5febf498-f447-4e3b-a484-320124bd0158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a9632d-70') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:28:55 user nova-compute[74805]: DEBUG os_vif [None req-24a07423-6ef6-4bce-b31c-01fee781bf8b tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:a1:b6,bridge_name='br-int',has_traffic_filtering=True,id=90a9632d-7041-430e-a0f4-0b8ec60eb332,network=Network(5febf498-f447-4e3b-a484-320124bd0158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a9632d-70') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:28:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90a9632d-70, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:28:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:28:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f34dd5f7-4735-4c56-9547-9bf8308ab1ea) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:28:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:28:55 user nova-compute[74805]: INFO os_vif [None req-24a07423-6ef6-4bce-b31c-01fee781bf8b tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:a1:b6,bridge_name='br-int',has_traffic_filtering=True,id=90a9632d-7041-430e-a0f4-0b8ec60eb332,network=Network(5febf498-f447-4e3b-a484-320124bd0158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a9632d-70')
Nov 15 04:28:55 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-24a07423-6ef6-4bce-b31c-01fee781bf8b tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Deleting instance files /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898_del
Nov 15 04:28:55 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-24a07423-6ef6-4bce-b31c-01fee781bf8b tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Deletion of /opt/stack/data/nova/instances/4a2d5475-04a4-414d-9ce9-d5204494f898_del complete
Nov 15 04:28:55 user nova-compute[74805]: INFO nova.compute.manager [None req-24a07423-6ef6-4bce-b31c-01fee781bf8b tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 15 04:28:55 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-24a07423-6ef6-4bce-b31c-01fee781bf8b tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:28:55 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:28:55 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:28:56 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:28:56 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Took 0.77 seconds to deallocate network for instance.
Nov 15 04:28:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-24a07423-6ef6-4bce-b31c-01fee781bf8b tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-24a07423-6ef6-4bce-b31c-01fee781bf8b tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:57 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-24a07423-6ef6-4bce-b31c-01fee781bf8b tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:28:57 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-24a07423-6ef6-4bce-b31c-01fee781bf8b tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:28:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-24a07423-6ef6-4bce-b31c-01fee781bf8b tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.625s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:57 user nova-compute[74805]: DEBUG nova.compute.manager [req-4d3c3834-18df-47c7-8b2a-ce7b8acd093b req-b37a03d9-3d1d-4860-847e-cf5c46893b77 service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Received event network-vif-plugged-90a9632d-7041-430e-a0f4-0b8ec60eb332 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-4d3c3834-18df-47c7-8b2a-ce7b8acd093b req-b37a03d9-3d1d-4860-847e-cf5c46893b77 service nova] Acquiring lock "4a2d5475-04a4-414d-9ce9-d5204494f898-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:28:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-4d3c3834-18df-47c7-8b2a-ce7b8acd093b req-b37a03d9-3d1d-4860-847e-cf5c46893b77 service nova] Lock "4a2d5475-04a4-414d-9ce9-d5204494f898-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:28:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-4d3c3834-18df-47c7-8b2a-ce7b8acd093b req-b37a03d9-3d1d-4860-847e-cf5c46893b77 service nova] Lock "4a2d5475-04a4-414d-9ce9-d5204494f898-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:28:57 user nova-compute[74805]: DEBUG nova.compute.manager [req-4d3c3834-18df-47c7-8b2a-ce7b8acd093b req-b37a03d9-3d1d-4860-847e-cf5c46893b77 service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] No waiting events found dispatching network-vif-plugged-90a9632d-7041-430e-a0f4-0b8ec60eb332 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:28:57 user nova-compute[74805]: WARNING nova.compute.manager [req-4d3c3834-18df-47c7-8b2a-ce7b8acd093b req-b37a03d9-3d1d-4860-847e-cf5c46893b77 service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Received unexpected event network-vif-plugged-90a9632d-7041-430e-a0f4-0b8ec60eb332 for instance with vm_state deleted and task_state None.
Nov 15 04:28:57 user nova-compute[74805]: DEBUG nova.compute.manager [req-4d3c3834-18df-47c7-8b2a-ce7b8acd093b req-b37a03d9-3d1d-4860-847e-cf5c46893b77 service nova] [instance: 4a2d5475-04a4-414d-9ce9-d5204494f898] Received event network-vif-deleted-90a9632d-7041-430e-a0f4-0b8ec60eb332 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:28:57 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-24a07423-6ef6-4bce-b31c-01fee781bf8b tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Deleted allocations for instance 4a2d5475-04a4-414d-9ce9-d5204494f898
Nov 15 04:28:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-24a07423-6ef6-4bce-b31c-01fee781bf8b tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "4a2d5475-04a4-414d-9ce9-d5204494f898" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.494s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:29:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:29:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:29:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:29:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:29:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:29:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:29:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:29:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:29:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:11 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:29:13 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:29:13 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:29:14 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:29:14 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:29:14 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:29:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:29:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:29:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:29:14 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:29:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:29:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:29:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:29:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38196606-a9c9-4604-ad21-2ec7511a8b28/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:15 user nova-compute[74805]: DEBUG nova.compute.manager [req-99ab8826-6d5e-4c35-8986-dcd3b319c74a req-485bba82-986f-4321-a986-e433a72d9434 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Received event network-changed-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:29:15 user nova-compute[74805]: DEBUG nova.compute.manager [req-99ab8826-6d5e-4c35-8986-dcd3b319c74a req-485bba82-986f-4321-a986-e433a72d9434 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Refreshing instance network info cache due to event network-changed-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:29:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-99ab8826-6d5e-4c35-8986-dcd3b319c74a req-485bba82-986f-4321-a986-e433a72d9434 service nova] Acquiring lock "refresh_cache-bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:29:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-99ab8826-6d5e-4c35-8986-dcd3b319c74a req-485bba82-986f-4321-a986-e433a72d9434 service nova] Acquired lock "refresh_cache-bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:29:15 user nova-compute[74805]: DEBUG nova.network.neutron [req-99ab8826-6d5e-4c35-8986-dcd3b319c74a req-485bba82-986f-4321-a986-e433a72d9434 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Refreshing network info cache for port b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:29:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38196606-a9c9-4604-ad21-2ec7511a8b28/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38196606-a9c9-4604-ad21-2ec7511a8b28/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Acquiring lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:29:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:29:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Acquiring lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:29:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:29:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:29:15 user nova-compute[74805]: INFO nova.compute.manager [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Terminating instance
Nov 15 04:29:15 user nova-compute[74805]: DEBUG nova.compute.manager [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:29:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38196606-a9c9-4604-ad21-2ec7511a8b28/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6500dfcd-24fb-4683-aa90-3c17420f44c1/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6500dfcd-24fb-4683-aa90-3c17420f44c1/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6500dfcd-24fb-4683-aa90-3c17420f44c1/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6500dfcd-24fb-4683-aa90-3c17420f44c1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:16 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Instance destroyed successfully.
Nov 15 04:29:16 user nova-compute[74805]: DEBUG nova.objects.instance [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lazy-loading 'resources' on Instance uuid bc2e6fef-e9b0-4413-ad26-e4a076cb0b49 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T04:23:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1631741636',display_name='tempest-TestShelveInstance-server-1631741636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1631741636',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJZ7VNrqog1l5LS5ex5rgm9h9OaqVSpKNKvGoqpKAwA7018UsVo8X4OO2N4xP1K//IYAzTMHD0Ji+yoeCcs7+FCRWzP8wxCbmmZRQ7L83rEsZslABx/Y41Z0E46WakUyQ==',key_name='tempest-TestShelveInstance-385247914',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:27:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ffec78f4baa84125864c0992ecfa6181',ramdisk_id='',reservation_id='r-il5y2g8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1222914404',owner_user_name='tempest-TestShelveInstance-1222914404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:27:37Z,user_data=None,user_id='4de845d5de0a4cc880f29b4a522c81e1',uuid=bc2e6fef-e9b0-4413-ad26-e4a076cb0b49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "address": "fa:16:3e:48:b0:09", "network": {"id": "62c3a0d2-d7cf-41dd-adb6-f2331929ee00", "bridge": "br-int", "label": "tempest-TestShelveInstance-1115394549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec78f4baa84125864c0992ecfa6181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5818fba-ad", "ovs_interfaceid": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Converting VIF {"id": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "address": "fa:16:3e:48:b0:09", "network": {"id": "62c3a0d2-d7cf-41dd-adb6-f2331929ee00", "bridge": "br-int", "label": "tempest-TestShelveInstance-1115394549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec78f4baa84125864c0992ecfa6181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5818fba-ad", "ovs_interfaceid": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:b0:09,bridge_name='br-int',has_traffic_filtering=True,id=b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31,network=Network(62c3a0d2-d7cf-41dd-adb6-f2331929ee00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5818fba-ad') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG os_vif [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:b0:09,bridge_name='br-int',has_traffic_filtering=True,id=b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31,network=Network(62c3a0d2-d7cf-41dd-adb6-f2331929ee00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5818fba-ad') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5818fba-ad, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f5f1dbc-38bb-4b52-b445-6d0f0273d1f5) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:16 user nova-compute[74805]: INFO os_vif [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:b0:09,bridge_name='br-int',has_traffic_filtering=True,id=b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31,network=Network(62c3a0d2-d7cf-41dd-adb6-f2331929ee00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5818fba-ad')
Nov 15 04:29:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'foiIdAtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:29:16 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:29:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a314505-0155-4b44-bf4d-a6ea2a7e21ad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ec9439d-7058-449d-979e-b74149a340dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:29:16 user nova-compute[74805]: No targets found.
Nov 15 04:29:16 user nova-compute[74805]: iSNS:
Nov 15 04:29:16 user nova-compute[74805]: No targets found.
Nov 15 04:29:16 user nova-compute[74805]: STATIC:
Nov 15 04:29:16 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb
Nov 15 04:29:16 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:29:16 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:29:16 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f
Nov 15 04:29:16 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:29:16 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:29:16 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:7ec9439d-7058-449d-979e-b74149a340dc
Nov 15 04:29:16 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:29:16 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:29:16 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83
Nov 15 04:29:16 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:29:16 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:29:16 user nova-compute[74805]: FIRMWARE:
Nov 15 04:29:16 user nova-compute[74805]: No targets found.
Nov 15 04:29:16 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:29:16 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:29:16 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b993513-9db4-4e2e-b60a-b7457c91265d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ec9439d-7058-449d-979e-b74149a340dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a533b76f-ed93-400e-aa45-2549f48ec1b0]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec9439d-7058-449d-979e-b74149a340dc (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:29:16 user nova-compute[74805]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)
Nov 15 04:29:16 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:29:16 user nova-compute[74805]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec9439d-7058-449d-979e-b74149a340dc (non-flash)
Nov 15 04:29:16 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:29:16 user nova-compute[74805]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb (non-flash)
Nov 15 04:29:16 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:29:16 user nova-compute[74805]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec9439d-7058-449d-979e-b74149a340dc (non-flash)
Nov 15 04:29:16 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2fb4235c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb'): ({'sde'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Removing single pathed devices sde {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce0502da-6afb-47b3-a6f0-de5885b52f30/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcd7542-f71c-45fb-b49b-3ffdf1818e17]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74bde8a-7771-417c-8bf2-2411b9bc09b2]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Flushing IO for device /dev/sde {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec97302-b5fd-41be-84c3-db69cdb2a853]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd3f69c-c7e7-435f-8796-87f9a75ec967]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] SCSI volumes sde have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[44afbb6f-0a2c-44b3-b534-eec9dc0001ba]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce0502da-6afb-47b3-a6f0-de5885b52f30/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce0502da-6afb-47b3-a6f0-de5885b52f30/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG nova.network.neutron [req-99ab8826-6d5e-4c35-8986-dcd3b319c74a req-485bba82-986f-4321-a986-e433a72d9434 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Updated VIF entry in instance network info cache for port b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG nova.network.neutron [req-99ab8826-6d5e-4c35-8986-dcd3b319c74a req-485bba82-986f-4321-a986-e433a72d9434 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Updating instance_info_cache with network_info: [{"id": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "address": "fa:16:3e:48:b0:09", "network": {"id": "62c3a0d2-d7cf-41dd-adb6-f2331929ee00", "bridge": "br-int", "label": "tempest-TestShelveInstance-1115394549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec78f4baa84125864c0992ecfa6181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5818fba-ad", "ovs_interfaceid": "b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[43194627-078e-49e1-8dce-1560cb149b0d]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb, portal: 172.16.0.220,3260]
Nov 15 04:29:16 user nova-compute[74805]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb, portal: 172.16.0.220,3260] successful.
Nov 15 04:29:16 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-99ab8826-6d5e-4c35-8986-dcd3b319c74a req-485bba82-986f-4321-a986-e433a72d9434 service nova] Releasing lock "refresh_cache-bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a3adea-ac4e-44f2-935b-9d9c28f70afb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cd3f05-fb13-4526-b413-31ae4cab6c0b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] <== disconnect_volume: return (387ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:29:16 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Deleting instance files /opt/stack/data/nova/instances/bc2e6fef-e9b0-4413-ad26-e4a076cb0b49_del
Nov 15 04:29:16 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Deletion of /opt/stack/data/nova/instances/bc2e6fef-e9b0-4413-ad26-e4a076cb0b49_del complete
Nov 15 04:29:16 user nova-compute[74805]: INFO nova.compute.manager [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:29:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce0502da-6afb-47b3-a6f0-de5885b52f30/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:17 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:29:17 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:29:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=7552MB free_disk=25.000869750976562GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Applying migration context for instance fda0e490-03e3-4cf5-b22d-aab83d715616 as it has an incoming, in-progress migration 3138f4ce-86c5-4b8e-a7e5-1c9b46e64019. Migration status is finished {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 04:29:17 user nova-compute[74805]: INFO nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Updating resource usage from migration 3138f4ce-86c5-4b8e-a7e5-1c9b46e64019
Nov 15 04:29:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance d63f3726-27df-455f-bda0-3ddca95b70d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 9f267864-0b72-431d-9b0d-c63436002a4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 38196606-a9c9-4604-ad21-2ec7511a8b28 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance bc2e6fef-e9b0-4413-ad26-e4a076cb0b49 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Migration 3138f4ce-86c5-4b8e-a7e5-1c9b46e64019 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance fda0e490-03e3-4cf5-b22d-aab83d715616 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance c4968663-4f4f-4db0-bd2c-278d271b8b35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance ce0502da-6afb-47b3-a6f0-de5885b52f30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 6500dfcd-24fb-4683-aa90-3c17420f44c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG nova.compute.manager [req-1e71f7a2-c008-413c-b719-db0eacad8c30 req-23e1e7ec-23bf-46cd-9399-7b1fe24f3fd7 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Received event network-vif-unplugged-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1e71f7a2-c008-413c-b719-db0eacad8c30 req-23e1e7ec-23bf-46cd-9399-7b1fe24f3fd7 service nova] Acquiring lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1e71f7a2-c008-413c-b719-db0eacad8c30 req-23e1e7ec-23bf-46cd-9399-7b1fe24f3fd7 service nova] Lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1e71f7a2-c008-413c-b719-db0eacad8c30 req-23e1e7ec-23bf-46cd-9399-7b1fe24f3fd7 service nova] Lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG nova.compute.manager [req-1e71f7a2-c008-413c-b719-db0eacad8c30 req-23e1e7ec-23bf-46cd-9399-7b1fe24f3fd7 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] No waiting events found dispatching network-vif-unplugged-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG nova.compute.manager [req-1e71f7a2-c008-413c-b719-db0eacad8c30 req-23e1e7ec-23bf-46cd-9399-7b1fe24f3fd7 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Received event network-vif-unplugged-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG nova.compute.manager [req-1e71f7a2-c008-413c-b719-db0eacad8c30 req-23e1e7ec-23bf-46cd-9399-7b1fe24f3fd7 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Received event network-vif-plugged-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1e71f7a2-c008-413c-b719-db0eacad8c30 req-23e1e7ec-23bf-46cd-9399-7b1fe24f3fd7 service nova] Acquiring lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1e71f7a2-c008-413c-b719-db0eacad8c30 req-23e1e7ec-23bf-46cd-9399-7b1fe24f3fd7 service nova] Lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1e71f7a2-c008-413c-b719-db0eacad8c30 req-23e1e7ec-23bf-46cd-9399-7b1fe24f3fd7 service nova] Lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG nova.compute.manager [req-1e71f7a2-c008-413c-b719-db0eacad8c30 req-23e1e7ec-23bf-46cd-9399-7b1fe24f3fd7 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] No waiting events found dispatching network-vif-plugged-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:29:17 user nova-compute[74805]: WARNING nova.compute.manager [req-1e71f7a2-c008-413c-b719-db0eacad8c30 req-23e1e7ec-23bf-46cd-9399-7b1fe24f3fd7 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Received unexpected event network-vif-plugged-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 for instance with vm_state active and task_state deleting.
Nov 15 04:29:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:29:17 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Took 0.85 seconds to deallocate network for instance.
Nov 15 04:29:17 user nova-compute[74805]: DEBUG nova.compute.manager [req-cfbccd79-f10d-4330-852c-119da5454b42 req-b78465e3-17b1-4fd6-8fb1-6631137f4843 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Received event network-vif-deleted-b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:29:17 user nova-compute[74805]: INFO nova.compute.manager [req-cfbccd79-f10d-4330-852c-119da5454b42 req-b78465e3-17b1-4fd6-8fb1-6631137f4843 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Neutron deleted interface b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31; detaching it from the instance and deleting it from the info cache
Nov 15 04:29:17 user nova-compute[74805]: DEBUG nova.network.neutron [req-cfbccd79-f10d-4330-852c-119da5454b42 req-b78465e3-17b1-4fd6-8fb1-6631137f4843 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG nova.compute.manager [req-cfbccd79-f10d-4330-852c-119da5454b42 req-b78465e3-17b1-4fd6-8fb1-6631137f4843 service nova] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Detach interface failed, port_id=b5818fba-ad8c-4d9d-ac9e-dca6e1fd6b31, reason: Instance bc2e6fef-e9b0-4413-ad26-e4a076cb0b49 could not be found. {{(pid=74805) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:29:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.528s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:29:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:18 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:29:18 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:29:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-fda0e490-03e3-4cf5-b22d-aab83d715616" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:29:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-fda0e490-03e3-4cf5-b22d-aab83d715616" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:29:19 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:29:19 user nova-compute[74805]: INFO nova.compute.manager [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Took 1.57 seconds to detach 1 volumes for instance.
Nov 15 04:29:19 user nova-compute[74805]: DEBUG nova.compute.manager [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] [instance: bc2e6fef-e9b0-4413-ad26-e4a076cb0b49] Deleting volume: 44a3adea-ac4e-44f2-935b-9d9c28f70afb {{(pid=74805) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 04:29:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:29:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:29:19 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Updating instance_info_cache with network_info: [{"id": "26c6a394-5344-46d4-abf8-e49600450a07", "address": "fa:16:3e:e3:5f:9a", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c6a394-53", "ovs_interfaceid": "26c6a394-5344-46d4-abf8-e49600450a07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:29:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-fda0e490-03e3-4cf5-b22d-aab83d715616" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:29:19 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:29:19 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:29:19 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:29:19 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:29:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:29:19 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Deleted allocations for instance bc2e6fef-e9b0-4413-ad26-e4a076cb0b49
Nov 15 04:29:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-93a93ea7-cada-406d-b388-d444fa0364c7 tempest-TestShelveInstance-1222914404 tempest-TestShelveInstance-1222914404-project-member] Lock "bc2e6fef-e9b0-4413-ad26-e4a076cb0b49" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.373s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:29:20 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:29:20 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:29:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b73ad7c6-fb2e-45d1-9afd-cd4893add062 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "fda0e490-03e3-4cf5-b22d-aab83d715616" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:29:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b73ad7c6-fb2e-45d1-9afd-cd4893add062 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "fda0e490-03e3-4cf5-b22d-aab83d715616" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:29:21 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b73ad7c6-fb2e-45d1-9afd-cd4893add062 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Going to confirm migration 2 {{(pid=74805) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 15 04:29:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b73ad7c6-fb2e-45d1-9afd-cd4893add062 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "refresh_cache-fda0e490-03e3-4cf5-b22d-aab83d715616" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:29:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b73ad7c6-fb2e-45d1-9afd-cd4893add062 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquired lock "refresh_cache-fda0e490-03e3-4cf5-b22d-aab83d715616" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:29:21 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b73ad7c6-fb2e-45d1-9afd-cd4893add062 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:29:21 user nova-compute[74805]: DEBUG nova.objects.instance [None req-b73ad7c6-fb2e-45d1-9afd-cd4893add062 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lazy-loading 'info_cache' on Instance uuid fda0e490-03e3-4cf5-b22d-aab83d715616 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:29:22 user nova-compute[74805]: DEBUG nova.network.neutron [None req-b73ad7c6-fb2e-45d1-9afd-cd4893add062 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Updating instance_info_cache with network_info: [{"id": "26c6a394-5344-46d4-abf8-e49600450a07", "address": "fa:16:3e:e3:5f:9a", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c6a394-53", "ovs_interfaceid": "26c6a394-5344-46d4-abf8-e49600450a07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:29:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b73ad7c6-fb2e-45d1-9afd-cd4893add062 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Releasing lock "refresh_cache-fda0e490-03e3-4cf5-b22d-aab83d715616" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:29:22 user nova-compute[74805]: DEBUG nova.objects.instance [None req-b73ad7c6-fb2e-45d1-9afd-cd4893add062 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lazy-loading 'migration_context' on Instance uuid fda0e490-03e3-4cf5-b22d-aab83d715616 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:29:22 user nova-compute[74805]: DEBUG nova.objects.base [None req-b73ad7c6-fb2e-45d1-9afd-cd4893add062 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Object Instance<fda0e490-03e3-4cf5-b22d-aab83d715616> lazy-loaded attributes: info_cache,migration_context {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:29:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b73ad7c6-fb2e-45d1-9afd-cd4893add062 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:29:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b73ad7c6-fb2e-45d1-9afd-cd4893add062 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:29:22 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-b73ad7c6-fb2e-45d1-9afd-cd4893add062 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:29:22 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-b73ad7c6-fb2e-45d1-9afd-cd4893add062 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:29:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b73ad7c6-fb2e-45d1-9afd-cd4893add062 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.482s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:29:23 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-b73ad7c6-fb2e-45d1-9afd-cd4893add062 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Deleted allocation for migration 3138f4ce-86c5-4b8e-a7e5-1c9b46e64019
Nov 15 04:29:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b73ad7c6-fb2e-45d1-9afd-cd4893add062 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "fda0e490-03e3-4cf5-b22d-aab83d715616" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.574s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:29:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:27 user nova-compute[74805]: DEBUG nova.compute.manager [req-2a87f46e-d183-4827-b99c-cc2de5299dc7 req-0abf96f0-70b7-443f-89a6-55111fc262d5 service nova] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Received event network-changed-2c5ba330-8197-41a2-8ab4-d967a03ec2fc {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:29:27 user nova-compute[74805]: DEBUG nova.compute.manager [req-2a87f46e-d183-4827-b99c-cc2de5299dc7 req-0abf96f0-70b7-443f-89a6-55111fc262d5 service nova] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Refreshing instance network info cache due to event network-changed-2c5ba330-8197-41a2-8ab4-d967a03ec2fc. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:29:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2a87f46e-d183-4827-b99c-cc2de5299dc7 req-0abf96f0-70b7-443f-89a6-55111fc262d5 service nova] Acquiring lock "refresh_cache-c4968663-4f4f-4db0-bd2c-278d271b8b35" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:29:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2a87f46e-d183-4827-b99c-cc2de5299dc7 req-0abf96f0-70b7-443f-89a6-55111fc262d5 service nova] Acquired lock "refresh_cache-c4968663-4f4f-4db0-bd2c-278d271b8b35" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:29:27 user nova-compute[74805]: DEBUG nova.network.neutron [req-2a87f46e-d183-4827-b99c-cc2de5299dc7 req-0abf96f0-70b7-443f-89a6-55111fc262d5 service nova] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Refreshing network info cache for port 2c5ba330-8197-41a2-8ab4-d967a03ec2fc {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:29:28 user nova-compute[74805]: DEBUG nova.network.neutron [req-2a87f46e-d183-4827-b99c-cc2de5299dc7 req-0abf96f0-70b7-443f-89a6-55111fc262d5 service nova] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Updated VIF entry in instance network info cache for port 2c5ba330-8197-41a2-8ab4-d967a03ec2fc. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:29:28 user nova-compute[74805]: DEBUG nova.network.neutron [req-2a87f46e-d183-4827-b99c-cc2de5299dc7 req-0abf96f0-70b7-443f-89a6-55111fc262d5 service nova] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Updating instance_info_cache with network_info: [{"id": "2c5ba330-8197-41a2-8ab4-d967a03ec2fc", "address": "fa:16:3e:66:db:14", "network": {"id": "3948912e-ebae-4493-938d-3cf6366cf59f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1304629230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4790ff8a50a0448ebee83043e2fe764b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c5ba330-81", "ovs_interfaceid": "2c5ba330-8197-41a2-8ab4-d967a03ec2fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:29:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2a87f46e-d183-4827-b99c-cc2de5299dc7 req-0abf96f0-70b7-443f-89a6-55111fc262d5 service nova] Releasing lock "refresh_cache-c4968663-4f4f-4db0-bd2c-278d271b8b35" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:29:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Acquiring lock "c4968663-4f4f-4db0-bd2c-278d271b8b35" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:29:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "c4968663-4f4f-4db0-bd2c-278d271b8b35" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:29:28 user nova-compute[74805]: DEBUG nova.objects.instance [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lazy-loading 'flavor' on Instance uuid c4968663-4f4f-4db0-bd2c-278d271b8b35 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:29:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "c4968663-4f4f-4db0-bd2c-278d271b8b35" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:29:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Acquiring lock "c4968663-4f4f-4db0-bd2c-278d271b8b35" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:29:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "c4968663-4f4f-4db0-bd2c-278d271b8b35" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:29:28 user nova-compute[74805]: INFO nova.compute.manager [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Attaching volume 208e019a-e417-4514-9fa8-051c4a5adc04 to /dev/vdb
Nov 15 04:29:28 user nova-compute[74805]: DEBUG os_brick.utils [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:29:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:28 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e45327-1164-4241-954e-2a7a38757334]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:29 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb050675-b74c-4892-871b-4a73a5f1b23e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:29 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfece7c5-4bc9-4a95-9ff4-fb1f44450421]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:29 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cd9c52-bdf5-43c0-ae66-1c7d4b35f887]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:29:29 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:29:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:29:29 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:29:29 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4886024b-af1a-4896-bd40-3d469a8db6fc]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:29 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:29:29 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:29:29 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:29:29 user nova-compute[74805]: DEBUG os_brick.utils [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:29:29 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Updating existing volume attachment record: 3d916e9e-e28f-44b7-b7ce-4c060c77302c {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:29:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vQhFOtja', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:29:34 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:29:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:29:34 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:29:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:29:34 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c8d77b-ddf3-49bd-b4f1-6834186e26ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:29:34 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[75533893-3c6d-42ae-8479-27d1afc6b545]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04] added
Nov 15 04:29:34 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bcc3f8-508b-4fbe-8b79-aa7ef579d3f3]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[87347048-0667-4f07-8921-5df16ef77e61]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vQhFOtja {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vQhFOtja" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43798fe-ab74-4e54-b9fc-6c72b8c4011d]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vQhFOtja'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06b4bd9-38f6-41dc-8c3c-4638505ab016]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf5742b-aa85-4792-a943-a3f93ed291db]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:29:34 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:29:34 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:29:34 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:29:34 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e417a1c0-f614-4868-a79b-c4737bef9b87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04, portal: 172.16.0.220,3260]
Nov 15 04:29:34 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04, portal: 172.16.0.220,3260] successful.
Nov 15 04:29:34 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[95724864-c070-49b6-a363-175da425b1e4]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[83642450-a38f-4d3b-8c95-78afeeaf7413]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:29:34 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:29:34 user nova-compute[74805]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)
Nov 15 04:29:34 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:29:34 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:29:34 user nova-compute[74805]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)
Nov 15 04:29:34 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bdefb0-ff76-48bb-8234-5ddd324c1b2c]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:29:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vQhFOtja', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:29:35 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:29:35 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26266373331646134', 'path': '/dev/sdc'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:29:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266373331646134', 'path': '/dev/sdc'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:29:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:35 user nova-compute[74805]: DEBUG nova.objects.instance [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lazy-loading 'flavor' on Instance uuid c4968663-4f4f-4db0-bd2c-278d271b8b35 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:29:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:29:35 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:29:35 user nova-compute[74805]:   <source dev="/dev/sdc"/>
Nov 15 04:29:35 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:29:35 user nova-compute[74805]:   <serial>208e019a-e417-4514-9fa8-051c4a5adc04</serial>
Nov 15 04:29:35 user nova-compute[74805]: </disk>
Nov 15 04:29:35 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:29:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:29:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:29:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] No VIF found with MAC fa:16:3e:66:db:14, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:29:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8ca27eaa-c7bf-4540-b85f-68b1ff68ffcc tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "c4968663-4f4f-4db0-bd2c-278d271b8b35" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.425s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:29:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG nova.compute.manager [req-edf22854-c629-4c6d-8eef-4014c7e6015b req-5749650c-8eb2-4852-95de-7b7663e8be34 service nova] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Received event network-changed-135c9269-201d-4f8d-958e-8ef2a3e0e375 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG nova.compute.manager [req-edf22854-c629-4c6d-8eef-4014c7e6015b req-5749650c-8eb2-4852-95de-7b7663e8be34 service nova] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Refreshing instance network info cache due to event network-changed-135c9269-201d-4f8d-958e-8ef2a3e0e375. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-edf22854-c629-4c6d-8eef-4014c7e6015b req-5749650c-8eb2-4852-95de-7b7663e8be34 service nova] Acquiring lock "refresh_cache-ce0502da-6afb-47b3-a6f0-de5885b52f30" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-edf22854-c629-4c6d-8eef-4014c7e6015b req-5749650c-8eb2-4852-95de-7b7663e8be34 service nova] Acquired lock "refresh_cache-ce0502da-6afb-47b3-a6f0-de5885b52f30" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG nova.network.neutron [req-edf22854-c629-4c6d-8eef-4014c7e6015b req-5749650c-8eb2-4852-95de-7b7663e8be34 service nova] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Refreshing network info cache for port 135c9269-201d-4f8d-958e-8ef2a3e0e375 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "ce0502da-6afb-47b3-a6f0-de5885b52f30" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "ce0502da-6afb-47b3-a6f0-de5885b52f30" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG nova.objects.instance [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lazy-loading 'flavor' on Instance uuid ce0502da-6afb-47b3-a6f0-de5885b52f30 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "ce0502da-6afb-47b3-a6f0-de5885b52f30" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG nova.network.neutron [req-edf22854-c629-4c6d-8eef-4014c7e6015b req-5749650c-8eb2-4852-95de-7b7663e8be34 service nova] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Updated VIF entry in instance network info cache for port 135c9269-201d-4f8d-958e-8ef2a3e0e375. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG nova.network.neutron [req-edf22854-c629-4c6d-8eef-4014c7e6015b req-5749650c-8eb2-4852-95de-7b7663e8be34 service nova] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Updating instance_info_cache with network_info: [{"id": "135c9269-201d-4f8d-958e-8ef2a3e0e375", "address": "fa:16:3e:a3:b6:e0", "network": {"id": "a06a4001-e7e0-4991-b68a-0a0395d22e19", "bridge": "br-int", "label": "tempest-TestStampPattern-341788822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464531969a244952b436e763f17ab970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135c9269-20", "ovs_interfaceid": "135c9269-201d-4f8d-958e-8ef2a3e0e375", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-edf22854-c629-4c6d-8eef-4014c7e6015b req-5749650c-8eb2-4852-95de-7b7663e8be34 service nova] Releasing lock "refresh_cache-ce0502da-6afb-47b3-a6f0-de5885b52f30" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "ce0502da-6afb-47b3-a6f0-de5885b52f30" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "ce0502da-6afb-47b3-a6f0-de5885b52f30" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:29:39 user nova-compute[74805]: INFO nova.compute.manager [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Attaching volume c88700be-6094-4653-a89a-0b29ffe3851e to /dev/vdb
Nov 15 04:29:39 user nova-compute[74805]: DEBUG os_brick.utils [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50d9d9e-2aa2-4106-b62b-75cdcaff03af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3274208-9c8b-477f-869f-c8e6ff5ccae1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f5e39b-72ad-443f-9364-51bdc1ea3aee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[304b7772-6bb3-4f91-9d35-0772ba0fb3b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:29:39 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:29:39 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c4061a-b538-4b6a-97a0-c7d99a6714d2]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG os_brick.utils [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:29:39 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Updating existing volume attachment record: 1ee24858-f327-4660-a4c3-51de462ddc69 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:29:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Acquiring lock "c4968663-4f4f-4db0-bd2c-278d271b8b35" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:29:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "c4968663-4f4f-4db0-bd2c-278d271b8b35" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:29:40 user nova-compute[74805]: DEBUG nova.objects.instance [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lazy-loading 'flavor' on Instance uuid c4968663-4f4f-4db0-bd2c-278d271b8b35 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:29:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "c4968663-4f4f-4db0-bd2c-278d271b8b35" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:29:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Acquiring lock "c4968663-4f4f-4db0-bd2c-278d271b8b35" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:29:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "c4968663-4f4f-4db0-bd2c-278d271b8b35" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:29:40 user nova-compute[74805]: INFO nova.compute.manager [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Attaching volume 020a2933-dd7b-4c7b-805c-a2eb0fd1576f to /dev/vdc
Nov 15 04:29:41 user nova-compute[74805]: DEBUG os_brick.utils [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:29:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:41 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d8ce19-20cd-4e08-b4bc-8bb5b84d580c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:41 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b097cc7f-4f73-4956-8137-0ed06a872681]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:41 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead535c3-8468-4723-a8b3-24f1fb4207ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:41 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfd499f-b536-450d-90e5-2a5106b254d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:29:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:29:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:41 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:29:41 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:29:41 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb536a97-0ba1-465b-9940-a29c19683051]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:29:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:29:41 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:29:41 user nova-compute[74805]: DEBUG os_brick.utils [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:29:41 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Updating existing volume attachment record: 8b2e7f2a-468c-45e9-847e-807efd4d7de9 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:29:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xnfEVIQi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:29:44 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:29:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:29:44 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:29:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:29:44 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:29:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2caf8695-7a22-409e-83e1-cee91e198768]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:29:44 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5564fc-957e-480f-88e8-31e79b5073af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e] added
Nov 15 04:29:44 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a206c8-ff2a-4bb6-8b50-bbe7d71ab8e6]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea4dc22-3491-4efd-a743-648aa01940ea]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xnfEVIQi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xnfEVIQi" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3cb5d5-c4f9-4624-a533-710a5eccd32f]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xnfEVIQi'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf33add5-5ed8-4125-bf3f-cabb33218397]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5120181-bd26-434c-9f66-377c6f1ae1fe]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:29:44 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:29:44 user nova-compute[74805]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)
Nov 15 04:29:44 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:29:44 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:29:44 user nova-compute[74805]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)
Nov 15 04:29:44 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbffceb2-907f-4365-bf88-b7f803765be7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e, portal: 172.16.0.220,3260]
Nov 15 04:29:44 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e, portal: 172.16.0.220,3260] successful.
Nov 15 04:29:44 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:45 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[726b75e0-6310-49ff-a9cd-81b9db4340a0]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:45 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97a456b-b0e7-40a3-995e-354f86730c5e]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:29:45 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:29:45 user nova-compute[74805]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)
Nov 15 04:29:45 user nova-compute[74805]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e (non-flash)
Nov 15 04:29:45 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:29:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:29:45 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:29:45 user nova-compute[74805]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)
Nov 15 04:29:45 user nova-compute[74805]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e (non-flash)
Nov 15 04:29:45 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:29:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:29:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:29:45 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:29:45 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:29:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:45 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:45 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a169c6f-be83-46aa-8ae3-5b0a2db48fe8]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:45 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:29:45 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xnfEVIQi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:29:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23763663766326239', 'path': '/dev/sdd'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763663766326239', 'path': '/dev/sdd'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWPMJAwU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:29:46 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:29:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:29:46 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:29:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:29:46 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG nova.objects.instance [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lazy-loading 'flavor' on Instance uuid ce0502da-6afb-47b3-a6f0-de5885b52f30 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0876faa-665f-4525-8402-ebef5dab3d78]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:29:46 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:29:46 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:29:46 user nova-compute[74805]:   <source dev="/dev/sdd"/>
Nov 15 04:29:46 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:29:46 user nova-compute[74805]:   <serial>c88700be-6094-4653-a89a-0b29ffe3851e</serial>
Nov 15 04:29:46 user nova-compute[74805]: </disk>
Nov 15 04:29:46 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec2125b-378c-44fc-a900-cdb0040c8e82]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f] added
Nov 15 04:29:46 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.060s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4a92aa-ca76-4101-806b-15b1faf779f7]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[daaf46d6-e42b-41a1-83f3-d16aee7c6423]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rWPMJAwU {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rWPMJAwU" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c1dc61-bd79-449e-ba8e-fdd529143592]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rWPMJAwU'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa34987d-438d-43e0-8adc-3bb8511b8645]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb81d58c-a717-4d04-a0ea-fc7728fd7e58]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:29:46 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:29:46 user nova-compute[74805]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)
Nov 15 04:29:46 user nova-compute[74805]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e (non-flash)
Nov 15 04:29:46 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:29:46 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:29:46 user nova-compute[74805]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)
Nov 15 04:29:46 user nova-compute[74805]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e (non-flash)
Nov 15 04:29:46 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6fe3c1-af83-484f-a145-4ecf549320eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f, portal: 172.16.0.220,3260]
Nov 15 04:29:46 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f, portal: 172.16.0.220,3260] successful.
Nov 15 04:29:46 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4af5315-59ee-4264-a830-13c616005679]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5068e5be-1568-40bb-a209-24f8d5db1ea4]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:29:46 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:29:46 user nova-compute[74805]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)
Nov 15 04:29:46 user nova-compute[74805]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e (non-flash)
Nov 15 04:29:46 user nova-compute[74805]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f (non-flash)
Nov 15 04:29:46 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:29:46 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:29:46 user nova-compute[74805]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)
Nov 15 04:29:46 user nova-compute[74805]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e (non-flash)
Nov 15 04:29:46 user nova-compute[74805]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f (non-flash)
Nov 15 04:29:46 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] HCTL ('36', '-', '-', 0) found on session 45 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4fe197-7e7a-459f-8b55-498bf6405ecf]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWPMJAwU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] No VIF found with MAC fa:16:3e:a3:b6:e0, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:29:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-335ff94d-cbca-41d3-9cf7-3bcadda4c737 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "ce0502da-6afb-47b3-a6f0-de5885b52f30" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.963s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:29:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:29:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '26432383930353061', 'path': '/dev/sde'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:29:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432383930353061', 'path': '/dev/sde'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:29:47 user nova-compute[74805]: DEBUG nova.objects.instance [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lazy-loading 'flavor' on Instance uuid c4968663-4f4f-4db0-bd2c-278d271b8b35 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:29:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:29:47 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:29:47 user nova-compute[74805]:   <source dev="/dev/sde"/>
Nov 15 04:29:47 user nova-compute[74805]:   <target dev="vdc" bus="virtio"/>
Nov 15 04:29:47 user nova-compute[74805]:   <serial>020a2933-dd7b-4c7b-805c-a2eb0fd1576f</serial>
Nov 15 04:29:47 user nova-compute[74805]: </disk>
Nov 15 04:29:47 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:29:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:29:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:29:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:29:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] No VIF found with MAC fa:16:3e:66:db:14, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:29:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-745ba84b-4731-4308-add2-2577a4802f96 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "c4968663-4f4f-4db0-bd2c-278d271b8b35" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.090s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:29:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "ce0502da-6afb-47b3-a6f0-de5885b52f30" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:29:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "ce0502da-6afb-47b3-a6f0-de5885b52f30" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.005s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:29:48 user nova-compute[74805]: INFO nova.compute.manager [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Detaching volume c88700be-6094-4653-a89a-0b29ffe3851e
Nov 15 04:29:48 user nova-compute[74805]: INFO nova.virt.block_device [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Attempting to driver detach volume c88700be-6094-4653-a89a-0b29ffe3851e from mountpoint /dev/vdb
Nov 15 04:29:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Attempting to detach device vdb from instance ce0502da-6afb-47b3-a6f0-de5885b52f30 from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:29:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:29:48 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:29:48 user nova-compute[74805]:   <source dev="/dev/sdd"/>
Nov 15 04:29:48 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:29:48 user nova-compute[74805]:   <serial>c88700be-6094-4653-a89a-0b29ffe3851e</serial>
Nov 15 04:29:48 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:29:48 user nova-compute[74805]: </disk>
Nov 15 04:29:48 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:29:48 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Successfully detached device vdb from instance ce0502da-6afb-47b3-a6f0-de5885b52f30 from the persistent domain config.
Nov 15 04:29:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ce0502da-6afb-47b3-a6f0-de5885b52f30 from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:29:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:29:48 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:29:48 user nova-compute[74805]:   <source dev="/dev/sdd"/>
Nov 15 04:29:48 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:29:48 user nova-compute[74805]:   <serial>c88700be-6094-4653-a89a-0b29ffe3851e</serial>
Nov 15 04:29:48 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:29:48 user nova-compute[74805]: </disk>
Nov 15 04:29:48 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:29:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Acquiring lock "c4968663-4f4f-4db0-bd2c-278d271b8b35" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:29:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "c4968663-4f4f-4db0-bd2c-278d271b8b35" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:29:49 user nova-compute[74805]: INFO nova.compute.manager [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Detaching volume 020a2933-dd7b-4c7b-805c-a2eb0fd1576f
Nov 15 04:29:49 user nova-compute[74805]: INFO nova.virt.block_device [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Attempting to driver detach volume 020a2933-dd7b-4c7b-805c-a2eb0fd1576f from mountpoint /dev/vdc
Nov 15 04:29:49 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Attempting to detach device vdc from instance c4968663-4f4f-4db0-bd2c-278d271b8b35 from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:29:49 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:29:49 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:29:49 user nova-compute[74805]:   <source dev="/dev/sde"/>
Nov 15 04:29:49 user nova-compute[74805]:   <target dev="vdc" bus="virtio"/>
Nov 15 04:29:49 user nova-compute[74805]:   <serial>020a2933-dd7b-4c7b-805c-a2eb0fd1576f</serial>
Nov 15 04:29:49 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 04:29:49 user nova-compute[74805]: </disk>
Nov 15 04:29:49 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:29:49 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Successfully detached device vdc from instance c4968663-4f4f-4db0-bd2c-278d271b8b35 from the persistent domain config.
Nov 15 04:29:49 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance c4968663-4f4f-4db0-bd2c-278d271b8b35 from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:29:49 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:29:49 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:29:49 user nova-compute[74805]:   <source dev="/dev/sde"/>
Nov 15 04:29:49 user nova-compute[74805]:   <target dev="vdc" bus="virtio"/>
Nov 15 04:29:49 user nova-compute[74805]:   <serial>020a2933-dd7b-4c7b-805c-a2eb0fd1576f</serial>
Nov 15 04:29:49 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 04:29:49 user nova-compute[74805]: </disk>
Nov 15 04:29:49 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:29:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:29:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:29:49 user nova-compute[74805]: DEBUG nova.compute.manager [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:29:49 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ce0502da-6afb-47b3-a6f0-de5885b52f30 {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:29:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:29:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:29:49 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:29:49 user nova-compute[74805]: INFO nova.compute.claims [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Claim successful on node user
Nov 15 04:29:49 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance c4968663-4f4f-4db0-bd2c-278d271b8b35 {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:29:49 user nova-compute[74805]: DEBUG nova.compute.manager [req-2de21722-be33-4317-b92b-e12c206acbb9 req-c0a34311-a4b4-4b6b-b234-ce4f533df230 service nova] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Received event network-changed-ccd1646c-a99d-46c3-9caa-d1420b79390a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:29:49 user nova-compute[74805]: DEBUG nova.compute.manager [req-2de21722-be33-4317-b92b-e12c206acbb9 req-c0a34311-a4b4-4b6b-b234-ce4f533df230 service nova] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Refreshing instance network info cache due to event network-changed-ccd1646c-a99d-46c3-9caa-d1420b79390a. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:29:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2de21722-be33-4317-b92b-e12c206acbb9 req-c0a34311-a4b4-4b6b-b234-ce4f533df230 service nova] Acquiring lock "refresh_cache-6500dfcd-24fb-4683-aa90-3c17420f44c1" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:29:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2de21722-be33-4317-b92b-e12c206acbb9 req-c0a34311-a4b4-4b6b-b234-ce4f533df230 service nova] Acquired lock "refresh_cache-6500dfcd-24fb-4683-aa90-3c17420f44c1" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:29:49 user nova-compute[74805]: DEBUG nova.network.neutron [req-2de21722-be33-4317-b92b-e12c206acbb9 req-c0a34311-a4b4-4b6b-b234-ce4f533df230 service nova] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Refreshing network info cache for port ccd1646c-a99d-46c3-9caa-d1420b79390a {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:29:49 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:29:49 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:29:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:29:49 user nova-compute[74805]: DEBUG nova.compute.manager [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:29:49 user nova-compute[74805]: DEBUG nova.compute.manager [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:29:49 user nova-compute[74805]: DEBUG nova.network.neutron [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:29:49 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:29:49 user nova-compute[74805]: DEBUG nova.compute.manager [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:29:49 user nova-compute[74805]: DEBUG nova.policy [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2876983d30794d8db191857d2f420f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e01874e82ed4ae08813343751506eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:29:49 user nova-compute[74805]: DEBUG nova.compute.manager [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:29:49 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:29:49 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Creating image(s)
Nov 15 04:29:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:29:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "/opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:29:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "/opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:29:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:50 user nova-compute[74805]: DEBUG nova.network.neutron [req-2de21722-be33-4317-b92b-e12c206acbb9 req-c0a34311-a4b4-4b6b-b234-ce4f533df230 service nova] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Updated VIF entry in instance network info cache for port ccd1646c-a99d-46c3-9caa-d1420b79390a. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:29:50 user nova-compute[74805]: DEBUG nova.network.neutron [req-2de21722-be33-4317-b92b-e12c206acbb9 req-c0a34311-a4b4-4b6b-b234-ce4f533df230 service nova] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Updating instance_info_cache with network_info: [{"id": "ccd1646c-a99d-46c3-9caa-d1420b79390a", "address": "fa:16:3e:3a:04:cb", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd1646c-a9", "ovs_interfaceid": "ccd1646c-a99d-46c3-9caa-d1420b79390a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:29:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2de21722-be33-4317-b92b-e12c206acbb9 req-c0a34311-a4b4-4b6b-b234-ce4f533df230 service nova] Releasing lock "refresh_cache-6500dfcd-24fb-4683-aa90-3c17420f44c1" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:29:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.201s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:29:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:29:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.192s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk 1073741824" returned: 0 in 0.059s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:29:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.203s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:50 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:29:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:50 user nova-compute[74805]: DEBUG nova.network.neutron [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Successfully created port: 64bc8d35-4c9d-40db-ac46-46d6a3476698 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:29:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:50 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Cannot resize image /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:29:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:29:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Ensure instance console log exists: /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:29:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:29:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:29:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.network.neutron [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Successfully updated port: 64bc8d35-4c9d-40db-ac46-46d6a3476698 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "refresh_cache-2d9a5b2b-7196-4ec9-8afc-cac356fe1495" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquired lock "refresh_cache-2d9a5b2b-7196-4ec9-8afc-cac356fe1495" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.network.neutron [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.compute.manager [req-b148da2a-5e1e-48cc-98f6-c7036eee7e7d req-12ab48fd-2661-4cd3-b3f9-25ef4b81bccb service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Received event network-changed-64bc8d35-4c9d-40db-ac46-46d6a3476698 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.compute.manager [req-b148da2a-5e1e-48cc-98f6-c7036eee7e7d req-12ab48fd-2661-4cd3-b3f9-25ef4b81bccb service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Refreshing instance network info cache due to event network-changed-64bc8d35-4c9d-40db-ac46-46d6a3476698. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b148da2a-5e1e-48cc-98f6-c7036eee7e7d req-12ab48fd-2661-4cd3-b3f9-25ef4b81bccb service nova] Acquiring lock "refresh_cache-2d9a5b2b-7196-4ec9-8afc-cac356fe1495" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.network.neutron [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.network.neutron [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Updating instance_info_cache with network_info: [{"id": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "address": "fa:16:3e:22:73:22", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bc8d35-4c", "ovs_interfaceid": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Releasing lock "refresh_cache-2d9a5b2b-7196-4ec9-8afc-cac356fe1495" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.compute.manager [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Instance network_info: |[{"id": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "address": "fa:16:3e:22:73:22", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bc8d35-4c", "ovs_interfaceid": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b148da2a-5e1e-48cc-98f6-c7036eee7e7d req-12ab48fd-2661-4cd3-b3f9-25ef4b81bccb service nova] Acquired lock "refresh_cache-2d9a5b2b-7196-4ec9-8afc-cac356fe1495" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.network.neutron [req-b148da2a-5e1e-48cc-98f6-c7036eee7e7d req-12ab48fd-2661-4cd3-b3f9-25ef4b81bccb service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Refreshing network info cache for port 64bc8d35-4c9d-40db-ac46-46d6a3476698 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Start _get_guest_xml network_info=[{"id": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "address": "fa:16:3e:22:73:22", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bc8d35-4c", "ovs_interfaceid": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:29:51 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:29:51 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:29:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-404241420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-404241420',id=37,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKBur/RpyELDGs8OS+fGtmcJkicDq1Ji9wOx9nR/Hhap23qoGdzn+AKk78C/EboXmcHvLGWAUzOVtcD86a/Pmez/PS1wixMd9BxHxz0S3w0qb3gYKb+8AZmYpR6qLmaow==',key_name='tempest-keypair-498211884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e01874e82ed4ae08813343751506eeb',ramdisk_id='',reservation_id='r-d0v3uxp3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2114494734',owner_user_name='tempest-AttachVolumeShelveTestJSON-2114494734-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:29:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2876983d30794d8db191857d2f420f7d',uuid=2d9a5b2b-7196-4ec9-8afc-cac356fe1495,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "address": "fa:16:3e:22:73:22", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bc8d35-4c", "ovs_interfaceid": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Converting VIF {"id": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "address": "fa:16:3e:22:73:22", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bc8d35-4c", "ovs_interfaceid": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:73:22,bridge_name='br-int',has_traffic_filtering=True,id=64bc8d35-4c9d-40db-ac46-46d6a3476698,network=Network(5febf498-f447-4e3b-a484-320124bd0158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bc8d35-4c') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.objects.instance [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d9a5b2b-7196-4ec9-8afc-cac356fe1495 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:29:51 user nova-compute[74805]:   <uuid>2d9a5b2b-7196-4ec9-8afc-cac356fe1495</uuid>
Nov 15 04:29:51 user nova-compute[74805]:   <name>instance-00000025</name>
Nov 15 04:29:51 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:29:51 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:29:51 user nova-compute[74805]:   <metadata>
Nov 15 04:29:51 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:29:51 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:29:51 user nova-compute[74805]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-404241420</nova:name>
Nov 15 04:29:51 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:29:51</nova:creationTime>
Nov 15 04:29:51 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:29:51 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:29:51 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:29:51 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:29:51 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:29:51 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:29:51 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:29:51 user nova-compute[74805]:       <nova:owner>
Nov 15 04:29:51 user nova-compute[74805]:         <nova:user uuid="2876983d30794d8db191857d2f420f7d">tempest-AttachVolumeShelveTestJSON-2114494734-project-member</nova:user>
Nov 15 04:29:51 user nova-compute[74805]:         <nova:project uuid="5e01874e82ed4ae08813343751506eeb">tempest-AttachVolumeShelveTestJSON-2114494734</nova:project>
Nov 15 04:29:51 user nova-compute[74805]:       </nova:owner>
Nov 15 04:29:51 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:29:51 user nova-compute[74805]:       <nova:ports>
Nov 15 04:29:51 user nova-compute[74805]:         <nova:port uuid="64bc8d35-4c9d-40db-ac46-46d6a3476698">
Nov 15 04:29:51 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 04:29:51 user nova-compute[74805]:         </nova:port>
Nov 15 04:29:51 user nova-compute[74805]:       </nova:ports>
Nov 15 04:29:51 user nova-compute[74805]:     </nova:instance>
Nov 15 04:29:51 user nova-compute[74805]:   </metadata>
Nov 15 04:29:51 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:29:51 user nova-compute[74805]:     <system>
Nov 15 04:29:51 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:29:51 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:29:51 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:29:51 user nova-compute[74805]:       <entry name="serial">2d9a5b2b-7196-4ec9-8afc-cac356fe1495</entry>
Nov 15 04:29:51 user nova-compute[74805]:       <entry name="uuid">2d9a5b2b-7196-4ec9-8afc-cac356fe1495</entry>
Nov 15 04:29:51 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:29:51 user nova-compute[74805]:     </system>
Nov 15 04:29:51 user nova-compute[74805]:   </sysinfo>
Nov 15 04:29:51 user nova-compute[74805]:   <os>
Nov 15 04:29:51 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:29:51 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:29:51 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:29:51 user nova-compute[74805]:   </os>
Nov 15 04:29:51 user nova-compute[74805]:   <features>
Nov 15 04:29:51 user nova-compute[74805]:     <acpi/>
Nov 15 04:29:51 user nova-compute[74805]:     <apic/>
Nov 15 04:29:51 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:29:51 user nova-compute[74805]:   </features>
Nov 15 04:29:51 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:29:51 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:29:51 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:29:51 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:29:51 user nova-compute[74805]:   </clock>
Nov 15 04:29:51 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:29:51 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:29:51 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:29:51 user nova-compute[74805]:   </cpu>
Nov 15 04:29:51 user nova-compute[74805]:   <devices>
Nov 15 04:29:51 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:29:51 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:29:51 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk"/>
Nov 15 04:29:51 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:29:51 user nova-compute[74805]:     </disk>
Nov 15 04:29:51 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:29:51 user nova-compute[74805]:       <mac address="fa:16:3e:22:73:22"/>
Nov 15 04:29:51 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:29:51 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:29:51 user nova-compute[74805]:       <target dev="tap64bc8d35-4c"/>
Nov 15 04:29:51 user nova-compute[74805]:     </interface>
Nov 15 04:29:51 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:29:51 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/console.log" append="off"/>
Nov 15 04:29:51 user nova-compute[74805]:     </serial>
Nov 15 04:29:51 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:29:51 user nova-compute[74805]:     <video>
Nov 15 04:29:51 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:29:51 user nova-compute[74805]:     </video>
Nov 15 04:29:51 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:29:51 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:29:51 user nova-compute[74805]:     </rng>
Nov 15 04:29:51 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:29:51 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:29:51 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:29:51 user nova-compute[74805]:     </memballoon>
Nov 15 04:29:51 user nova-compute[74805]:   </devices>
Nov 15 04:29:51 user nova-compute[74805]: </domain>
Nov 15 04:29:51 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:29:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-404241420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-404241420',id=37,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKBur/RpyELDGs8OS+fGtmcJkicDq1Ji9wOx9nR/Hhap23qoGdzn+AKk78C/EboXmcHvLGWAUzOVtcD86a/Pmez/PS1wixMd9BxHxz0S3w0qb3gYKb+8AZmYpR6qLmaow==',key_name='tempest-keypair-498211884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e01874e82ed4ae08813343751506eeb',ramdisk_id='',reservation_id='r-d0v3uxp3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2114494734',owner_user_name='tempest-AttachVolumeShelveTestJSON-2114494734-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:29:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2876983d30794d8db191857d2f420f7d',uuid=2d9a5b2b-7196-4ec9-8afc-cac356fe1495,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "address": "fa:16:3e:22:73:22", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bc8d35-4c", "ovs_interfaceid": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Converting VIF {"id": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "address": "fa:16:3e:22:73:22", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bc8d35-4c", "ovs_interfaceid": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:73:22,bridge_name='br-int',has_traffic_filtering=True,id=64bc8d35-4c9d-40db-ac46-46d6a3476698,network=Network(5febf498-f447-4e3b-a484-320124bd0158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bc8d35-4c') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG os_vif [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:73:22,bridge_name='br-int',has_traffic_filtering=True,id=64bc8d35-4c9d-40db-ac46-46d6a3476698,network=Network(5febf498-f447-4e3b-a484-320124bd0158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bc8d35-4c') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'feffbabc-011b-5b66-b1c1-387905705513', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64bc8d35-4c, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64bc8d35-4c, col_values=(('qos', UUID('dc0d5fdc-4128-4052-bda3-7c3409c5ccc4')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64bc8d35-4c, col_values=(('external_ids', {'iface-id': '64bc8d35-4c9d-40db-ac46-46d6a3476698', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:73:22', 'vm-uuid': '2d9a5b2b-7196-4ec9-8afc-cac356fe1495'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:51 user nova-compute[74805]: INFO os_vif [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:73:22,bridge_name='br-int',has_traffic_filtering=True,id=64bc8d35-4c9d-40db-ac46-46d6a3476698,network=Network(5febf498-f447-4e3b-a484-320124bd0158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bc8d35-4c')
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:29:51 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] No VIF found with MAC fa:16:3e:22:73:22, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:29:52 user nova-compute[74805]: DEBUG nova.network.neutron [req-b148da2a-5e1e-48cc-98f6-c7036eee7e7d req-12ab48fd-2661-4cd3-b3f9-25ef4b81bccb service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Updated VIF entry in instance network info cache for port 64bc8d35-4c9d-40db-ac46-46d6a3476698. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:29:52 user nova-compute[74805]: DEBUG nova.network.neutron [req-b148da2a-5e1e-48cc-98f6-c7036eee7e7d req-12ab48fd-2661-4cd3-b3f9-25ef4b81bccb service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Updating instance_info_cache with network_info: [{"id": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "address": "fa:16:3e:22:73:22", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bc8d35-4c", "ovs_interfaceid": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:29:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b148da2a-5e1e-48cc-98f6-c7036eee7e7d req-12ab48fd-2661-4cd3-b3f9-25ef4b81bccb service nova] Releasing lock "refresh_cache-2d9a5b2b-7196-4ec9-8afc-cac356fe1495" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:29:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "6500dfcd-24fb-4683-aa90-3c17420f44c1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:29:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "6500dfcd-24fb-4683-aa90-3c17420f44c1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:29:52 user nova-compute[74805]: DEBUG nova.objects.instance [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'flavor' on Instance uuid 6500dfcd-24fb-4683-aa90-3c17420f44c1 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:29:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "6500dfcd-24fb-4683-aa90-3c17420f44c1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "6500dfcd-24fb-4683-aa90-3c17420f44c1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "6500dfcd-24fb-4683-aa90-3c17420f44c1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:29:53 user nova-compute[74805]: INFO nova.compute.manager [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Attaching volume d13a81d7-1d6e-4863-9483-43384041e465 to /dev/vdb
Nov 15 04:29:53 user nova-compute[74805]: DEBUG os_brick.utils [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e10d15-3ca2-4d55-be61-dbd181edb488]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be6d33f-40c8-4cce-9838-15999870861d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[da08dade-7001-4371-b9d5-485e02c4eccd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0d65e8-7656-4957-b659-d9fbaa245f6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:29:53 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:29:53 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee56e721-0f06-42b5-ab98-9bb5ddeae753]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG os_brick.utils [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Updating existing volume attachment record: 46a6dded-5c3a-4390-af97-7eceadc04e46 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG nova.compute.manager [req-e4308239-e050-4531-a58b-31c8a9e0787a req-088d58c7-0b15-4580-8e83-5e86472021d2 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Received event network-vif-plugged-64bc8d35-4c9d-40db-ac46-46d6a3476698 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e4308239-e050-4531-a58b-31c8a9e0787a req-088d58c7-0b15-4580-8e83-5e86472021d2 service nova] Acquiring lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e4308239-e050-4531-a58b-31c8a9e0787a req-088d58c7-0b15-4580-8e83-5e86472021d2 service nova] Lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e4308239-e050-4531-a58b-31c8a9e0787a req-088d58c7-0b15-4580-8e83-5e86472021d2 service nova] Lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:29:53 user nova-compute[74805]: DEBUG nova.compute.manager [req-e4308239-e050-4531-a58b-31c8a9e0787a req-088d58c7-0b15-4580-8e83-5e86472021d2 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] No waiting events found dispatching network-vif-plugged-64bc8d35-4c9d-40db-ac46-46d6a3476698 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:29:53 user nova-compute[74805]: WARNING nova.compute.manager [req-e4308239-e050-4531-a58b-31c8a9e0787a req-088d58c7-0b15-4580-8e83-5e86472021d2 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Received unexpected event network-vif-plugged-64bc8d35-4c9d-40db-ac46-46d6a3476698 for instance with vm_state building and task_state spawning.
Nov 15 04:29:54 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:54 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:54 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:54 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:55 user nova-compute[74805]: DEBUG nova.compute.manager [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:29:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:29:55 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Instance spawned successfully.
Nov 15 04:29:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:29:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:29:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:29:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:29:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:29:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:29:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:29:55 user nova-compute[74805]: INFO nova.compute.manager [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Took 5.84 seconds to spawn the instance on the hypervisor.
Nov 15 04:29:55 user nova-compute[74805]: DEBUG nova.compute.manager [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:29:55 user nova-compute[74805]: INFO nova.compute.manager [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Took 6.58 seconds to build instance.
Nov 15 04:29:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4c00cda1-b4b0-4b4e-ae79-79ad423d12a0 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.691s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:29:55 user nova-compute[74805]: DEBUG nova.compute.manager [req-2f4b685c-adee-411f-a550-df2a7f8ae402 req-b31f521b-011c-4a93-b4bc-5dbd692494d7 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Received event network-vif-plugged-64bc8d35-4c9d-40db-ac46-46d6a3476698 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:29:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2f4b685c-adee-411f-a550-df2a7f8ae402 req-b31f521b-011c-4a93-b4bc-5dbd692494d7 service nova] Acquiring lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:29:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2f4b685c-adee-411f-a550-df2a7f8ae402 req-b31f521b-011c-4a93-b4bc-5dbd692494d7 service nova] Lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:29:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2f4b685c-adee-411f-a550-df2a7f8ae402 req-b31f521b-011c-4a93-b4bc-5dbd692494d7 service nova] Lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:29:55 user nova-compute[74805]: DEBUG nova.compute.manager [req-2f4b685c-adee-411f-a550-df2a7f8ae402 req-b31f521b-011c-4a93-b4bc-5dbd692494d7 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] No waiting events found dispatching network-vif-plugged-64bc8d35-4c9d-40db-ac46-46d6a3476698 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:29:55 user nova-compute[74805]: WARNING nova.compute.manager [req-2f4b685c-adee-411f-a550-df2a7f8ae402 req-b31f521b-011c-4a93-b4bc-5dbd692494d7 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Received unexpected event network-vif-plugged-64bc8d35-4c9d-40db-ac46-46d6a3476698 for instance with vm_state active and task_state None.
Nov 15 04:29:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMBfCVKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:29:58 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:29:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:29:58 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:29:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:29:58 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f4efdd-fdc7-4cb5-98ff-ae0d03c975b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:29:58 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc52c8c-de44-46e3-ba44-ba6f4735de7e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465] added
Nov 15 04:29:58 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec49edb5-55ac-433a-ac58-07fa89fe2808]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e882a809-8a02-4df7-9069-6c1c3c057544]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMBfCVKv {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMBfCVKv" returned: 0 in 0.031s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b757756-3922-4855-8cf8-f3b59aed638e]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dMBfCVKv'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f78895-2450-44ce-aa7f-0781834be554]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea70465b-9470-461a-b1f4-e93b813e4386]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:29:58 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:29:58 user nova-compute[74805]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)
Nov 15 04:29:58 user nova-compute[74805]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e (non-flash)
Nov 15 04:29:58 user nova-compute[74805]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f (non-flash)
Nov 15 04:29:58 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:29:58 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:29:58 user nova-compute[74805]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)
Nov 15 04:29:58 user nova-compute[74805]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e (non-flash)
Nov 15 04:29:58 user nova-compute[74805]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f (non-flash)
Nov 15 04:29:58 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4685752-1309-48e7-9bcb-f3f96f558fa2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465, portal: 172.16.0.220,3260]
Nov 15 04:29:58 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465, portal: 172.16.0.220,3260] successful.
Nov 15 04:29:58 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e913f9a-3655-4834-b83d-bfbeb7fefbd3]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f72db6-3bf1-49f0-9122-ea328f886491]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:29:58 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:29:58 user nova-compute[74805]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)
Nov 15 04:29:58 user nova-compute[74805]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e (non-flash)
Nov 15 04:29:58 user nova-compute[74805]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f (non-flash)
Nov 15 04:29:58 user nova-compute[74805]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 (non-flash)
Nov 15 04:29:58 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:29:58 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:29:58 user nova-compute[74805]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)
Nov 15 04:29:58 user nova-compute[74805]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e (non-flash)
Nov 15 04:29:58 user nova-compute[74805]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f (non-flash)
Nov 15 04:29:58 user nova-compute[74805]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 (non-flash)
Nov 15 04:29:58 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] HCTL ('37', '-', '-', 0) found on session 46 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cbecd6-a3b3-4b58-9e43-0bb4a1670d43]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:29:58 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Searching for a device in session 46 and hctl ['37', '*', '*', 0] yield: None {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:29:59 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Searching for a device in session 46 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:29:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMBfCVKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:29:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:29:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '26336346264656161', 'path': '/dev/sdf'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:29:59 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336346264656161', 'path': '/dev/sdf'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:29:59 user nova-compute[74805]: DEBUG nova.objects.instance [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'flavor' on Instance uuid 6500dfcd-24fb-4683-aa90-3c17420f44c1 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:29:59 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:29:59 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:29:59 user nova-compute[74805]:   <source dev="/dev/sdf"/>
Nov 15 04:29:59 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:29:59 user nova-compute[74805]:   <serial>d13a81d7-1d6e-4863-9483-43384041e465</serial>
Nov 15 04:29:59 user nova-compute[74805]: </disk>
Nov 15 04:29:59 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:29:59 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:29:59 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:29:59 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] No VIF found with MAC fa:16:3e:3a:04:cb, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:30:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ac81b814-9fbd-4f62-92c3-e1a5651e5908 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "6500dfcd-24fb-4683-aa90-3c17420f44c1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.999s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:30:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:02 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "6500dfcd-24fb-4683-aa90-3c17420f44c1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:30:02 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "6500dfcd-24fb-4683-aa90-3c17420f44c1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:30:02 user nova-compute[74805]: DEBUG nova.objects.instance [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'flavor' on Instance uuid 6500dfcd-24fb-4683-aa90-3c17420f44c1 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:30:02 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "6500dfcd-24fb-4683-aa90-3c17420f44c1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:30:02 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "6500dfcd-24fb-4683-aa90-3c17420f44c1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:30:02 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "6500dfcd-24fb-4683-aa90-3c17420f44c1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:30:02 user nova-compute[74805]: INFO nova.compute.manager [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Attaching volume 2f9d9212-07e3-44dd-9372-df5fa83d5dda to /dev/vdc
Nov 15 04:30:02 user nova-compute[74805]: DEBUG os_brick.utils [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:30:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c4bda3-89ff-41cb-8e66-5c3eba2982e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb60925-7c1e-43e1-b320-af1a70ed077a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[831303ff-583e-4657-9ffe-4e4fc180aded]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c217f77-7b00-4efc-87d0-e68e0d4efe3b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:30:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:30:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:30:02 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:30:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cde52f4-3cad-46f9-8866-2e43cd68fda1]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:30:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:30:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:30:02 user nova-compute[74805]: DEBUG os_brick.utils [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:30:02 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Updating existing volume attachment record: 6c67df03-dead-42a7-aada-9a16d9a467d1 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:30:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NhbVDMls', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:30:07 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:30:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:30:07 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:30:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:30:07 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:30:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a0b112-957e-4d90-b873-084519890218]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:30:07 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f190cd5d-03d4-4ba6-8882-8436f5c5d43a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda] added
Nov 15 04:30:07 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8aeed7-11bb-4921-9871-fdb31da4ad32]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b588a47d-78d8-44f1-88f2-fd8d1d490b4e]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NhbVDMls {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NhbVDMls" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[712a81af-86e8-4da6-af78-216820a53979]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NhbVDMls'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[536fc8f5-1f6a-4fd2-ab6e-f0a3968cfab3]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcb19e6-2518-46cb-9605-7d8720505d22]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:30:07 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:30:07 user nova-compute[74805]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)
Nov 15 04:30:07 user nova-compute[74805]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e (non-flash)
Nov 15 04:30:07 user nova-compute[74805]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f (non-flash)
Nov 15 04:30:07 user nova-compute[74805]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 (non-flash)
Nov 15 04:30:07 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:30:07 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:30:07 user nova-compute[74805]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)
Nov 15 04:30:07 user nova-compute[74805]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e (non-flash)
Nov 15 04:30:07 user nova-compute[74805]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f (non-flash)
Nov 15 04:30:07 user nova-compute[74805]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 (non-flash)
Nov 15 04:30:07 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d9192a-3fe7-408f-8d64-772cd7281231]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda, portal: 172.16.0.220,3260]
Nov 15 04:30:07 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda, portal: 172.16.0.220,3260] successful.
Nov 15 04:30:07 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:30:07 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3945e7-2a91-4329-8048-c2436d438c7c]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:30:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81db38f-13d3-40cb-86f0-88a388b628d4]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:30:08 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:30:08 user nova-compute[74805]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)
Nov 15 04:30:08 user nova-compute[74805]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e (non-flash)
Nov 15 04:30:08 user nova-compute[74805]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f (non-flash)
Nov 15 04:30:08 user nova-compute[74805]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 (non-flash)
Nov 15 04:30:08 user nova-compute[74805]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda (non-flash)
Nov 15 04:30:08 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:30:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:30:08 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:30:08 user nova-compute[74805]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)
Nov 15 04:30:08 user nova-compute[74805]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e (non-flash)
Nov 15 04:30:08 user nova-compute[74805]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f (non-flash)
Nov 15 04:30:08 user nova-compute[74805]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 (non-flash)
Nov 15 04:30:08 user nova-compute[74805]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda (non-flash)
Nov 15 04:30:08 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:30:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:30:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:30:08 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] HCTL ('38', '-', '-', 0) found on session 47 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:30:08 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:30:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:08 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:08 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9968c385-049f-4f79-b0b9-73a92230c459]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:08 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Searching for a device in session 47 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:30:08 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NhbVDMls', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23736626363313566', 'path': '/dev/sdg'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736626363313566', 'path': '/dev/sdg'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG nova.objects.instance [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'flavor' on Instance uuid 6500dfcd-24fb-4683-aa90-3c17420f44c1 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:30:09 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:30:09 user nova-compute[74805]:   <source dev="/dev/sdg"/>
Nov 15 04:30:09 user nova-compute[74805]:   <target dev="vdc" bus="virtio"/>
Nov 15 04:30:09 user nova-compute[74805]:   <serial>2f9d9212-07e3-44dd-9372-df5fa83d5dda</serial>
Nov 15 04:30:09 user nova-compute[74805]: </disk>
Nov 15 04:30:09 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:30:09 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ce0502da-6afb-47b3-a6f0-de5885b52f30 is timed out.
Nov 15 04:30:09 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Successfully detached device vdb from instance ce0502da-6afb-47b3-a6f0-de5885b52f30 from the live domain config.
Nov 15 04:30:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xnfEVIQi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:30:09 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.038s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4300e8ad-8da9-4628-bd20-bc3af2901e0e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:30:09 user nova-compute[74805]: No targets found.
Nov 15 04:30:09 user nova-compute[74805]: iSNS:
Nov 15 04:30:09 user nova-compute[74805]: No targets found.
Nov 15 04:30:09 user nova-compute[74805]: STATIC:
Nov 15 04:30:09 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f
Nov 15 04:30:09 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:30:09 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:30:09 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465
Nov 15 04:30:09 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:30:09 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:30:09 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f
Nov 15 04:30:09 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:30:09 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:30:09 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83
Nov 15 04:30:09 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:30:09 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:30:09 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda
Nov 15 04:30:09 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:30:09 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:30:09 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e
Nov 15 04:30:09 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:30:09 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:30:09 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04
Nov 15 04:30:09 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:30:09 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:30:09 user nova-compute[74805]: FIRMWARE:
Nov 15 04:30:09 user nova-compute[74805]: No targets found.
Nov 15 04:30:09 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:30:09 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:30:09 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b677a7f3-2dd0-462a-af16-fddb401ccc02]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1d89c0-59a7-4f9f-9436-e5ca6512eaea]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:30:09 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:30:09 user nova-compute[74805]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)
Nov 15 04:30:09 user nova-compute[74805]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e (non-flash)
Nov 15 04:30:09 user nova-compute[74805]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f (non-flash)
Nov 15 04:30:09 user nova-compute[74805]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 (non-flash)
Nov 15 04:30:09 user nova-compute[74805]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda (non-flash)
Nov 15 04:30:09 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:30:09 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:30:09 user nova-compute[74805]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)
Nov 15 04:30:09 user nova-compute[74805]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e (non-flash)
Nov 15 04:30:09 user nova-compute[74805]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f (non-flash)
Nov 15 04:30:09 user nova-compute[74805]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 (non-flash)
Nov 15 04:30:09 user nova-compute[74805]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda (non-flash)
Nov 15 04:30:09 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2fb4236dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e'): ({'sdd'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Removing single pathed devices sdd {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6756009a-90e0-4515-9500-8283940bf456]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8faaa2f4-607a-402e-b8af-70cd6f4e4ecf]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Flushing IO for device /dev/sdd {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0673b691-528e-46ec-8bac-42a88d48a777]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c11e38e-b858-44af-89af-6cf88936edf7]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] SCSI volumes sdd have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6887f0b4-5904-4f1b-8bf7-6bf867ffc56b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] No VIF found with MAC fa:16:3e:3a:04:cb, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:30:09 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance c4968663-4f4f-4db0-bd2c-278d271b8b35 is timed out.
Nov 15 04:30:09 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Successfully detached device vdc from instance c4968663-4f4f-4db0-bd2c-278d271b8b35 from the live domain config.
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c788e2af-ceb6-477b-ae5c-47e17d9e44bd]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e, portal: 172.16.0.220,3260]
Nov 15 04:30:09 user nova-compute[74805]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e, portal: 172.16.0.220,3260] successful.
Nov 15 04:30:09 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWPMJAwU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:30:09 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c88700be-6094-4653-a89a-0b29ffe3851e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e5bd6c-5d80-49a5-8bcf-210b64942a39]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] <== disconnect_volume: return (386ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.043s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2706f663-c985-4560-b3d3-f11aee2858d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:30:09 user nova-compute[74805]: No targets found.
Nov 15 04:30:09 user nova-compute[74805]: iSNS:
Nov 15 04:30:09 user nova-compute[74805]: No targets found.
Nov 15 04:30:09 user nova-compute[74805]: STATIC:
Nov 15 04:30:09 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f
Nov 15 04:30:09 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:30:09 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:30:09 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465
Nov 15 04:30:09 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:30:09 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:30:09 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f
Nov 15 04:30:09 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:30:09 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:30:09 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83
Nov 15 04:30:09 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:30:09 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:30:09 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda
Nov 15 04:30:09 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:30:09 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:30:09 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04
Nov 15 04:30:09 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:30:09 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:30:09 user nova-compute[74805]: FIRMWARE:
Nov 15 04:30:09 user nova-compute[74805]: No targets found.
Nov 15 04:30:09 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:30:09 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:30:09 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a1b623-d353-465a-9dab-8cfbed277cb4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-e8d5d394-bbe7-49f0-80a4-ddda03c6c475 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "6500dfcd-24fb-4683-aa90-3c17420f44c1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.224s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a945d6-8ffc-4f96-aa43-39d0b4523a09]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:30:09 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:30:09 user nova-compute[74805]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)
Nov 15 04:30:09 user nova-compute[74805]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f (non-flash)
Nov 15 04:30:09 user nova-compute[74805]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 (non-flash)
Nov 15 04:30:09 user nova-compute[74805]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda (non-flash)
Nov 15 04:30:09 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:30:09 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:30:09 user nova-compute[74805]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)
Nov 15 04:30:09 user nova-compute[74805]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f (non-flash)
Nov 15 04:30:09 user nova-compute[74805]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 (non-flash)
Nov 15 04:30:09 user nova-compute[74805]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda (non-flash)
Nov 15 04:30:09 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c7af490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f'): ({'sde'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Removing single pathed devices sde {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c12273-cc52-4d4e-a0ca-79c5dcf315bb]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8e0bce-3afe-440a-b0a4-8221ae45295b]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Flushing IO for device /dev/sde {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcb2c61-76ef-45e2-8dcb-0d2655833b6f]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c25bfe-8e41-497b-a77c-a7af8ea1612c]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] SCSI volumes sde have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c5f3de-6a25-4fcb-b141-8d21a18afc88]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eca7dc8-f201-4cf1-8f34-4dfb1610417b]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f, portal: 172.16.0.220,3260]
Nov 15 04:30:09 user nova-compute[74805]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f, portal: 172.16.0.220,3260] successful.
Nov 15 04:30:09 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:30:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:020a2933-dd7b-4c7b-805c-a2eb0fd1576f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:10 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4332590-54b9-4831-8f06-323974ceec4b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:30:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:30:10 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] <== disconnect_volume: return (403ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:30:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:30:10 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:30:10 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74805) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 04:30:10 user nova-compute[74805]: DEBUG nova.objects.instance [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lazy-loading 'flavor' on Instance uuid ce0502da-6afb-47b3-a6f0-de5885b52f30 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:30:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b03a3e75-00da-47f0-b14f-d81a21869576 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "ce0502da-6afb-47b3-a6f0-de5885b52f30" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.805s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:30:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "6500dfcd-24fb-4683-aa90-3c17420f44c1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:30:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "6500dfcd-24fb-4683-aa90-3c17420f44c1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:30:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:10 user nova-compute[74805]: INFO nova.compute.manager [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Detaching volume d13a81d7-1d6e-4863-9483-43384041e465
Nov 15 04:30:10 user nova-compute[74805]: INFO nova.virt.block_device [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Attempting to driver detach volume d13a81d7-1d6e-4863-9483-43384041e465 from mountpoint /dev/vdb
Nov 15 04:30:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Attempting to detach device vdb from instance 6500dfcd-24fb-4683-aa90-3c17420f44c1 from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:30:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:30:10 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:30:10 user nova-compute[74805]:   <source dev="/dev/sdf"/>
Nov 15 04:30:10 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:30:10 user nova-compute[74805]:   <serial>d13a81d7-1d6e-4863-9483-43384041e465</serial>
Nov 15 04:30:10 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:30:10 user nova-compute[74805]: </disk>
Nov 15 04:30:10 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:30:10 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Successfully detached device vdb from instance 6500dfcd-24fb-4683-aa90-3c17420f44c1 from the persistent domain config.
Nov 15 04:30:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6500dfcd-24fb-4683-aa90-3c17420f44c1 from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:30:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:30:10 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:30:10 user nova-compute[74805]:   <source dev="/dev/sdf"/>
Nov 15 04:30:10 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:30:10 user nova-compute[74805]:   <serial>d13a81d7-1d6e-4863-9483-43384041e465</serial>
Nov 15 04:30:10 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:30:10 user nova-compute[74805]: </disk>
Nov 15 04:30:10 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:30:11 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:30:11 user nova-compute[74805]: DEBUG nova.objects.instance [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lazy-loading 'flavor' on Instance uuid c4968663-4f4f-4db0-bd2c-278d271b8b35 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:30:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6500dfcd-24fb-4683-aa90-3c17420f44c1 {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:30:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-04217c3e-cd8d-45c1-8ae9-c14b345d7a9b tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "c4968663-4f4f-4db0-bd2c-278d271b8b35" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.365s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:30:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:14 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:30:14 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:30:14 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:30:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:30:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:30:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:30:14 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:30:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:30:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:30:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:30:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38196606-a9c9-4604-ad21-2ec7511a8b28/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38196606-a9c9-4604-ad21-2ec7511a8b28/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38196606-a9c9-4604-ad21-2ec7511a8b28/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38196606-a9c9-4604-ad21-2ec7511a8b28/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6500dfcd-24fb-4683-aa90-3c17420f44c1/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6500dfcd-24fb-4683-aa90-3c17420f44c1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6500dfcd-24fb-4683-aa90-3c17420f44c1/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6500dfcd-24fb-4683-aa90-3c17420f44c1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:30:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce0502da-6afb-47b3-a6f0-de5885b52f30/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce0502da-6afb-47b3-a6f0-de5885b52f30/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce0502da-6afb-47b3-a6f0-de5885b52f30/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce0502da-6afb-47b3-a6f0-de5885b52f30/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:17 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:30:17 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:30:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=7624MB free_disk=24.943038940429688GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:30:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:30:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:30:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance d63f3726-27df-455f-bda0-3ddca95b70d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:30:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 9f267864-0b72-431d-9b0d-c63436002a4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:30:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:30:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 38196606-a9c9-4604-ad21-2ec7511a8b28 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:30:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance fda0e490-03e3-4cf5-b22d-aab83d715616 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:30:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance c4968663-4f4f-4db0-bd2c-278d271b8b35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:30:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance ce0502da-6afb-47b3-a6f0-de5885b52f30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:30:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 6500dfcd-24fb-4683-aa90-3c17420f44c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:30:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 2d9a5b2b-7196-4ec9-8afc-cac356fe1495 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:30:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:30:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:30:18 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:30:18 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:30:18 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:30:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.531s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:30:18 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:30:18 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Cleaning up deleted instances {{(pid=74805) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 04:30:18 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] There are 0 instances to clean {{(pid=74805) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 04:30:19 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:30:19 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:30:19 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:30:19 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:30:19 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Rebuilding the list of instances to heal {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 04:30:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-d63f3726-27df-455f-bda0-3ddca95b70d9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:30:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-d63f3726-27df-455f-bda0-3ddca95b70d9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:30:19 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:30:19 user nova-compute[74805]: DEBUG nova.objects.instance [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lazy-loading 'info_cache' on Instance uuid d63f3726-27df-455f-bda0-3ddca95b70d9 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:30:19 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Updating instance_info_cache with network_info: [{"id": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "address": "fa:16:3e:b1:3d:ff", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d0a11b6-25", "ovs_interfaceid": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:30:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-d63f3726-27df-455f-bda0-3ddca95b70d9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:30:19 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:30:19 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:30:19 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:30:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:21 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:30:21 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:30:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:31 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6500dfcd-24fb-4683-aa90-3c17420f44c1 is timed out.
Nov 15 04:30:31 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Successfully detached device vdb from instance 6500dfcd-24fb-4683-aa90-3c17420f44c1 from the live domain config.
Nov 15 04:30:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMBfCVKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:30:31 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:30:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[becf1b3a-2ec3-46b9-b664-8aa38dc1701a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:30:31 user nova-compute[74805]: No targets found.
Nov 15 04:30:31 user nova-compute[74805]: iSNS:
Nov 15 04:30:31 user nova-compute[74805]: No targets found.
Nov 15 04:30:31 user nova-compute[74805]: STATIC:
Nov 15 04:30:31 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465
Nov 15 04:30:31 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:30:31 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:30:31 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f
Nov 15 04:30:31 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:30:31 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:30:31 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83
Nov 15 04:30:31 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:30:31 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:30:31 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda
Nov 15 04:30:31 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:30:31 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:30:31 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04
Nov 15 04:30:31 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:30:31 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:30:31 user nova-compute[74805]: FIRMWARE:
Nov 15 04:30:31 user nova-compute[74805]: No targets found.
Nov 15 04:30:31 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:30:31 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:30:31 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[55924279-05ce-43bb-b70c-cee052384ffa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[459a5e5a-1c5a-40a8-ae27-ca28ec5912b4]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:30:31 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:30:31 user nova-compute[74805]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)
Nov 15 04:30:31 user nova-compute[74805]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 (non-flash)
Nov 15 04:30:31 user nova-compute[74805]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda (non-flash)
Nov 15 04:30:31 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:30:31 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:30:31 user nova-compute[74805]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)
Nov 15 04:30:31 user nova-compute[74805]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 (non-flash)
Nov 15 04:30:31 user nova-compute[74805]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda (non-flash)
Nov 15 04:30:31 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c7ae7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465'): ({'sdf'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Removing single pathed devices sdf {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc27ac9-0c3b-4e3c-95e9-d687ab8245ef]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[999a97da-8927-4e9b-b197-e417a0c14dfb]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Flushing IO for device /dev/sdf {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f79195-06c2-4c41-8152-649bde4d2263]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e57e566-0646-4f33-a415-ef75c1d36a61]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] SCSI volumes sdf have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dccaac-9960-45fc-956b-511b6662850d]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6505ab17-9dd8-4805-8e52-76e4771f44c1]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465, portal: 172.16.0.220,3260]
Nov 15 04:30:31 user nova-compute[74805]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465, portal: 172.16.0.220,3260] successful.
Nov 15 04:30:31 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d13a81d7-1d6e-4863-9483-43384041e465 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bdb32b-a026-4364-bc52-17748f481e6b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] <== disconnect_volume: return (317ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:30:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:30:32 user nova-compute[74805]: DEBUG nova.objects.instance [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'flavor' on Instance uuid 6500dfcd-24fb-4683-aa90-3c17420f44c1 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:30:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-c9e3901f-a37f-41c3-9a4d-fd413893831d tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "6500dfcd-24fb-4683-aa90-3c17420f44c1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.879s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:30:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "6500dfcd-24fb-4683-aa90-3c17420f44c1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:30:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "6500dfcd-24fb-4683-aa90-3c17420f44c1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:30:33 user nova-compute[74805]: INFO nova.compute.manager [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Detaching volume 2f9d9212-07e3-44dd-9372-df5fa83d5dda
Nov 15 04:30:33 user nova-compute[74805]: INFO nova.virt.block_device [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Attempting to driver detach volume 2f9d9212-07e3-44dd-9372-df5fa83d5dda from mountpoint /dev/vdc
Nov 15 04:30:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Attempting to detach device vdc from instance 6500dfcd-24fb-4683-aa90-3c17420f44c1 from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:30:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:30:33 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:30:33 user nova-compute[74805]:   <source dev="/dev/sdg"/>
Nov 15 04:30:33 user nova-compute[74805]:   <target dev="vdc" bus="virtio"/>
Nov 15 04:30:33 user nova-compute[74805]:   <serial>2f9d9212-07e3-44dd-9372-df5fa83d5dda</serial>
Nov 15 04:30:33 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 04:30:33 user nova-compute[74805]: </disk>
Nov 15 04:30:33 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:30:33 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Successfully detached device vdc from instance 6500dfcd-24fb-4683-aa90-3c17420f44c1 from the persistent domain config.
Nov 15 04:30:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 6500dfcd-24fb-4683-aa90-3c17420f44c1 from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:30:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:30:33 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:30:33 user nova-compute[74805]:   <source dev="/dev/sdg"/>
Nov 15 04:30:33 user nova-compute[74805]:   <target dev="vdc" bus="virtio"/>
Nov 15 04:30:33 user nova-compute[74805]:   <serial>2f9d9212-07e3-44dd-9372-df5fa83d5dda</serial>
Nov 15 04:30:33 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 04:30:33 user nova-compute[74805]: </disk>
Nov 15 04:30:33 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:30:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 6500dfcd-24fb-4683-aa90-3c17420f44c1 {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:30:34 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:30:35 user nova-compute[74805]: INFO nova.compute.manager [None req-0d2dd021-8223-42f1-9a95-05d0e309fdea tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Unrescuing
Nov 15 04:30:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0d2dd021-8223-42f1-9a95-05d0e309fdea tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "refresh_cache-38196606-a9c9-4604-ad21-2ec7511a8b28" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:30:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0d2dd021-8223-42f1-9a95-05d0e309fdea tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquired lock "refresh_cache-38196606-a9c9-4604-ad21-2ec7511a8b28" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:30:35 user nova-compute[74805]: DEBUG nova.network.neutron [None req-0d2dd021-8223-42f1-9a95-05d0e309fdea tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:30:35 user nova-compute[74805]: DEBUG nova.network.neutron [None req-0d2dd021-8223-42f1-9a95-05d0e309fdea tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Updating instance_info_cache with network_info: [{"id": "23517101-97ec-4772-ab6b-6f626a6547bc", "address": "fa:16:3e:da:ef:08", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23517101-97", "ovs_interfaceid": "23517101-97ec-4772-ab6b-6f626a6547bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:30:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0d2dd021-8223-42f1-9a95-05d0e309fdea tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Releasing lock "refresh_cache-38196606-a9c9-4604-ad21-2ec7511a8b28" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:30:35 user nova-compute[74805]: DEBUG nova.objects.instance [None req-0d2dd021-8223-42f1-9a95-05d0e309fdea tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lazy-loading 'flavor' on Instance uuid 38196606-a9c9-4604-ad21-2ec7511a8b28 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:30:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:36 user nova-compute[74805]: DEBUG nova.compute.manager [req-224970aa-4b35-403f-b99b-8ef10c16c93e req-a4e18ef0-b62d-4840-ba3c-06c205e58549 service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Received event network-vif-unplugged-23517101-97ec-4772-ab6b-6f626a6547bc {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:30:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-224970aa-4b35-403f-b99b-8ef10c16c93e req-a4e18ef0-b62d-4840-ba3c-06c205e58549 service nova] Acquiring lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:30:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-224970aa-4b35-403f-b99b-8ef10c16c93e req-a4e18ef0-b62d-4840-ba3c-06c205e58549 service nova] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:30:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-224970aa-4b35-403f-b99b-8ef10c16c93e req-a4e18ef0-b62d-4840-ba3c-06c205e58549 service nova] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:30:36 user nova-compute[74805]: DEBUG nova.compute.manager [req-224970aa-4b35-403f-b99b-8ef10c16c93e req-a4e18ef0-b62d-4840-ba3c-06c205e58549 service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] No waiting events found dispatching network-vif-unplugged-23517101-97ec-4772-ab6b-6f626a6547bc {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:30:36 user nova-compute[74805]: WARNING nova.compute.manager [req-224970aa-4b35-403f-b99b-8ef10c16c93e req-a4e18ef0-b62d-4840-ba3c-06c205e58549 service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Received unexpected event network-vif-unplugged-23517101-97ec-4772-ab6b-6f626a6547bc for instance with vm_state rescued and task_state unrescuing.
Nov 15 04:30:36 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Instance destroyed successfully.
Nov 15 04:30:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:38 user nova-compute[74805]: DEBUG nova.compute.manager [req-7b3221d7-361c-4bdc-8b0d-68ff4cdccee9 req-72a32f86-0160-45a5-ba3b-9d28ca56ad93 service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Received event network-vif-plugged-23517101-97ec-4772-ab6b-6f626a6547bc {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:30:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7b3221d7-361c-4bdc-8b0d-68ff4cdccee9 req-72a32f86-0160-45a5-ba3b-9d28ca56ad93 service nova] Acquiring lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:30:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7b3221d7-361c-4bdc-8b0d-68ff4cdccee9 req-72a32f86-0160-45a5-ba3b-9d28ca56ad93 service nova] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:30:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7b3221d7-361c-4bdc-8b0d-68ff4cdccee9 req-72a32f86-0160-45a5-ba3b-9d28ca56ad93 service nova] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:30:38 user nova-compute[74805]: DEBUG nova.compute.manager [req-7b3221d7-361c-4bdc-8b0d-68ff4cdccee9 req-72a32f86-0160-45a5-ba3b-9d28ca56ad93 service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] No waiting events found dispatching network-vif-plugged-23517101-97ec-4772-ab6b-6f626a6547bc {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:30:38 user nova-compute[74805]: WARNING nova.compute.manager [req-7b3221d7-361c-4bdc-8b0d-68ff4cdccee9 req-72a32f86-0160-45a5-ba3b-9d28ca56ad93 service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Received unexpected event network-vif-plugged-23517101-97ec-4772-ab6b-6f626a6547bc for instance with vm_state rescued and task_state unrescuing.
Nov 15 04:30:38 user nova-compute[74805]: DEBUG nova.compute.manager [req-7b3221d7-361c-4bdc-8b0d-68ff4cdccee9 req-72a32f86-0160-45a5-ba3b-9d28ca56ad93 service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Received event network-vif-plugged-23517101-97ec-4772-ab6b-6f626a6547bc {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:30:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7b3221d7-361c-4bdc-8b0d-68ff4cdccee9 req-72a32f86-0160-45a5-ba3b-9d28ca56ad93 service nova] Acquiring lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:30:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7b3221d7-361c-4bdc-8b0d-68ff4cdccee9 req-72a32f86-0160-45a5-ba3b-9d28ca56ad93 service nova] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:30:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7b3221d7-361c-4bdc-8b0d-68ff4cdccee9 req-72a32f86-0160-45a5-ba3b-9d28ca56ad93 service nova] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:30:38 user nova-compute[74805]: DEBUG nova.compute.manager [req-7b3221d7-361c-4bdc-8b0d-68ff4cdccee9 req-72a32f86-0160-45a5-ba3b-9d28ca56ad93 service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] No waiting events found dispatching network-vif-plugged-23517101-97ec-4772-ab6b-6f626a6547bc {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:30:38 user nova-compute[74805]: WARNING nova.compute.manager [req-7b3221d7-361c-4bdc-8b0d-68ff4cdccee9 req-72a32f86-0160-45a5-ba3b-9d28ca56ad93 service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Received unexpected event network-vif-plugged-23517101-97ec-4772-ab6b-6f626a6547bc for instance with vm_state rescued and task_state unrescuing.
Nov 15 04:30:38 user nova-compute[74805]: DEBUG nova.compute.manager [req-7b3221d7-361c-4bdc-8b0d-68ff4cdccee9 req-72a32f86-0160-45a5-ba3b-9d28ca56ad93 service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Received event network-vif-plugged-23517101-97ec-4772-ab6b-6f626a6547bc {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:30:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7b3221d7-361c-4bdc-8b0d-68ff4cdccee9 req-72a32f86-0160-45a5-ba3b-9d28ca56ad93 service nova] Acquiring lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:30:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7b3221d7-361c-4bdc-8b0d-68ff4cdccee9 req-72a32f86-0160-45a5-ba3b-9d28ca56ad93 service nova] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:30:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7b3221d7-361c-4bdc-8b0d-68ff4cdccee9 req-72a32f86-0160-45a5-ba3b-9d28ca56ad93 service nova] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:30:38 user nova-compute[74805]: DEBUG nova.compute.manager [req-7b3221d7-361c-4bdc-8b0d-68ff4cdccee9 req-72a32f86-0160-45a5-ba3b-9d28ca56ad93 service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] No waiting events found dispatching network-vif-plugged-23517101-97ec-4772-ab6b-6f626a6547bc {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:30:38 user nova-compute[74805]: WARNING nova.compute.manager [req-7b3221d7-361c-4bdc-8b0d-68ff4cdccee9 req-72a32f86-0160-45a5-ba3b-9d28ca56ad93 service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Received unexpected event network-vif-plugged-23517101-97ec-4772-ab6b-6f626a6547bc for instance with vm_state rescued and task_state unrescuing.
Nov 15 04:30:39 user nova-compute[74805]: DEBUG nova.compute.manager [req-796ac4ef-05ec-4038-8031-ad29b6fd1d27 req-896b566f-6b47-4b44-990c-1b1c33a04eba service nova] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Received event network-changed-135c9269-201d-4f8d-958e-8ef2a3e0e375 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:30:39 user nova-compute[74805]: DEBUG nova.compute.manager [req-796ac4ef-05ec-4038-8031-ad29b6fd1d27 req-896b566f-6b47-4b44-990c-1b1c33a04eba service nova] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Refreshing instance network info cache due to event network-changed-135c9269-201d-4f8d-958e-8ef2a3e0e375. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:30:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-796ac4ef-05ec-4038-8031-ad29b6fd1d27 req-896b566f-6b47-4b44-990c-1b1c33a04eba service nova] Acquiring lock "refresh_cache-ce0502da-6afb-47b3-a6f0-de5885b52f30" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:30:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-796ac4ef-05ec-4038-8031-ad29b6fd1d27 req-896b566f-6b47-4b44-990c-1b1c33a04eba service nova] Acquired lock "refresh_cache-ce0502da-6afb-47b3-a6f0-de5885b52f30" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:30:39 user nova-compute[74805]: DEBUG nova.network.neutron [req-796ac4ef-05ec-4038-8031-ad29b6fd1d27 req-896b566f-6b47-4b44-990c-1b1c33a04eba service nova] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Refreshing network info cache for port 135c9269-201d-4f8d-958e-8ef2a3e0e375 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:30:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Acquiring lock "c4968663-4f4f-4db0-bd2c-278d271b8b35" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:30:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "c4968663-4f4f-4db0-bd2c-278d271b8b35" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:30:39 user nova-compute[74805]: INFO nova.compute.manager [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Detaching volume 208e019a-e417-4514-9fa8-051c4a5adc04
Nov 15 04:30:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f7aa380-f8a2-480b-88d6-aad46cc88ba0 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "ce0502da-6afb-47b3-a6f0-de5885b52f30" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:30:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f7aa380-f8a2-480b-88d6-aad46cc88ba0 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "ce0502da-6afb-47b3-a6f0-de5885b52f30" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:30:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f7aa380-f8a2-480b-88d6-aad46cc88ba0 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "ce0502da-6afb-47b3-a6f0-de5885b52f30-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:30:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f7aa380-f8a2-480b-88d6-aad46cc88ba0 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "ce0502da-6afb-47b3-a6f0-de5885b52f30-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:30:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f7aa380-f8a2-480b-88d6-aad46cc88ba0 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "ce0502da-6afb-47b3-a6f0-de5885b52f30-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:30:39 user nova-compute[74805]: INFO nova.compute.manager [None req-6f7aa380-f8a2-480b-88d6-aad46cc88ba0 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Terminating instance
Nov 15 04:30:39 user nova-compute[74805]: DEBUG nova.compute.manager [None req-6f7aa380-f8a2-480b-88d6-aad46cc88ba0 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:30:39 user nova-compute[74805]: INFO nova.virt.block_device [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Attempting to driver detach volume 208e019a-e417-4514-9fa8-051c4a5adc04 from mountpoint /dev/vdb
Nov 15 04:30:39 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Attempting to detach device vdb from instance c4968663-4f4f-4db0-bd2c-278d271b8b35 from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:30:39 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:30:39 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:30:39 user nova-compute[74805]:   <source dev="/dev/sdc"/>
Nov 15 04:30:39 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:30:39 user nova-compute[74805]:   <serial>208e019a-e417-4514-9fa8-051c4a5adc04</serial>
Nov 15 04:30:39 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:30:39 user nova-compute[74805]: </disk>
Nov 15 04:30:39 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:30:39 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Successfully detached device vdb from instance c4968663-4f4f-4db0-bd2c-278d271b8b35 from the persistent domain config.
Nov 15 04:30:39 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c4968663-4f4f-4db0-bd2c-278d271b8b35 from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:30:39 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:30:39 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:30:39 user nova-compute[74805]:   <source dev="/dev/sdc"/>
Nov 15 04:30:39 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:30:39 user nova-compute[74805]:   <serial>208e019a-e417-4514-9fa8-051c4a5adc04</serial>
Nov 15 04:30:39 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:30:39 user nova-compute[74805]: </disk>
Nov 15 04:30:39 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:30:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:39 user nova-compute[74805]: DEBUG nova.network.neutron [req-796ac4ef-05ec-4038-8031-ad29b6fd1d27 req-896b566f-6b47-4b44-990c-1b1c33a04eba service nova] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Updated VIF entry in instance network info cache for port 135c9269-201d-4f8d-958e-8ef2a3e0e375. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:30:39 user nova-compute[74805]: DEBUG nova.network.neutron [req-796ac4ef-05ec-4038-8031-ad29b6fd1d27 req-896b566f-6b47-4b44-990c-1b1c33a04eba service nova] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Updating instance_info_cache with network_info: [{"id": "135c9269-201d-4f8d-958e-8ef2a3e0e375", "address": "fa:16:3e:a3:b6:e0", "network": {"id": "a06a4001-e7e0-4991-b68a-0a0395d22e19", "bridge": "br-int", "label": "tempest-TestStampPattern-341788822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464531969a244952b436e763f17ab970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135c9269-20", "ovs_interfaceid": "135c9269-201d-4f8d-958e-8ef2a3e0e375", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:30:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-796ac4ef-05ec-4038-8031-ad29b6fd1d27 req-896b566f-6b47-4b44-990c-1b1c33a04eba service nova] Releasing lock "refresh_cache-ce0502da-6afb-47b3-a6f0-de5885b52f30" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:30:40 user nova-compute[74805]: DEBUG nova.compute.manager [req-31100c52-112c-4847-9eb3-5e91f853f35d req-0aac3f68-fd46-4d92-a221-2a3051f0554e service nova] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Received event network-vif-unplugged-135c9269-201d-4f8d-958e-8ef2a3e0e375 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:30:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-31100c52-112c-4847-9eb3-5e91f853f35d req-0aac3f68-fd46-4d92-a221-2a3051f0554e service nova] Acquiring lock "ce0502da-6afb-47b3-a6f0-de5885b52f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:30:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-31100c52-112c-4847-9eb3-5e91f853f35d req-0aac3f68-fd46-4d92-a221-2a3051f0554e service nova] Lock "ce0502da-6afb-47b3-a6f0-de5885b52f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:30:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-31100c52-112c-4847-9eb3-5e91f853f35d req-0aac3f68-fd46-4d92-a221-2a3051f0554e service nova] Lock "ce0502da-6afb-47b3-a6f0-de5885b52f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:30:40 user nova-compute[74805]: DEBUG nova.compute.manager [req-31100c52-112c-4847-9eb3-5e91f853f35d req-0aac3f68-fd46-4d92-a221-2a3051f0554e service nova] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] No waiting events found dispatching network-vif-unplugged-135c9269-201d-4f8d-958e-8ef2a3e0e375 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:30:40 user nova-compute[74805]: DEBUG nova.compute.manager [req-31100c52-112c-4847-9eb3-5e91f853f35d req-0aac3f68-fd46-4d92-a221-2a3051f0554e service nova] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Received event network-vif-unplugged-135c9269-201d-4f8d-958e-8ef2a3e0e375 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:30:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:40 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0d2dd021-8223-42f1-9a95-05d0e309fdea tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:30:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c4968663-4f4f-4db0-bd2c-278d271b8b35 {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:30:40 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Instance destroyed successfully.
Nov 15 04:30:40 user nova-compute[74805]: DEBUG nova.objects.instance [None req-6f7aa380-f8a2-480b-88d6-aad46cc88ba0 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lazy-loading 'resources' on Instance uuid ce0502da-6afb-47b3-a6f0-de5885b52f30 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:30:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-6f7aa380-f8a2-480b-88d6-aad46cc88ba0 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:27:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-707806317',display_name='tempest-TestStampPattern-server-707806317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-707806317',id=35,image_ref='af7f66de-f8c0-4ae5-a1f3-1893d3606b05',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0NRAQgDbUZf0EbqtKAGHs4GX+/AbapMrSMTst3yG7lWtxqhChiIE0p667dQ9MtVVa6R0YR0OFwR3oN8tOTGfWd9b0OvJqkw2muo0XPuAEVruetlLFRHgQ9v/OWONwx2w==',key_name='tempest-TestStampPattern-1861490322',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:27:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='464531969a244952b436e763f17ab970',ramdisk_id='',reservation_id='r-zr673lyw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8d27a3c7-54c7-45fd-85ab-05aa3d375a4c',image_min_disk='1',image_min_ram='0',image_owner_id='464531969a244952b436e763f17ab970',image_owner_project_name='tempest-TestStampPattern-1523333335',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1523333335-project-member',image_user_id='147187e3ec664f869db966f1e47a2445',owner_project_name='tempest-TestStampPattern-1523333335',owner_user_name='tempest-TestStampPattern-1523333335-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:27:55Z,user_data=None,user_id='147187e3ec664f869db966f1e47a2445',uuid=ce0502da-6afb-47b3-a6f0-de5885b52f30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "135c9269-201d-4f8d-958e-8ef2a3e0e375", "address": "fa:16:3e:a3:b6:e0", "network": {"id": "a06a4001-e7e0-4991-b68a-0a0395d22e19", "bridge": "br-int", "label": "tempest-TestStampPattern-341788822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464531969a244952b436e763f17ab970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135c9269-20", "ovs_interfaceid": "135c9269-201d-4f8d-958e-8ef2a3e0e375", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:30:40 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-6f7aa380-f8a2-480b-88d6-aad46cc88ba0 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Converting VIF {"id": "135c9269-201d-4f8d-958e-8ef2a3e0e375", "address": "fa:16:3e:a3:b6:e0", "network": {"id": "a06a4001-e7e0-4991-b68a-0a0395d22e19", "bridge": "br-int", "label": "tempest-TestStampPattern-341788822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464531969a244952b436e763f17ab970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135c9269-20", "ovs_interfaceid": "135c9269-201d-4f8d-958e-8ef2a3e0e375", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:30:40 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-6f7aa380-f8a2-480b-88d6-aad46cc88ba0 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:b6:e0,bridge_name='br-int',has_traffic_filtering=True,id=135c9269-201d-4f8d-958e-8ef2a3e0e375,network=Network(a06a4001-e7e0-4991-b68a-0a0395d22e19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135c9269-20') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:30:40 user nova-compute[74805]: DEBUG os_vif [None req-6f7aa380-f8a2-480b-88d6-aad46cc88ba0 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:b6:e0,bridge_name='br-int',has_traffic_filtering=True,id=135c9269-201d-4f8d-958e-8ef2a3e0e375,network=Network(a06a4001-e7e0-4991-b68a-0a0395d22e19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135c9269-20') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:30:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap135c9269-20, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:30:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:30:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c451f0b7-9a55-444d-af72-d4d1efda6961) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:30:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:40 user nova-compute[74805]: INFO os_vif [None req-6f7aa380-f8a2-480b-88d6-aad46cc88ba0 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:b6:e0,bridge_name='br-int',has_traffic_filtering=True,id=135c9269-201d-4f8d-958e-8ef2a3e0e375,network=Network(a06a4001-e7e0-4991-b68a-0a0395d22e19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135c9269-20')
Nov 15 04:30:40 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-6f7aa380-f8a2-480b-88d6-aad46cc88ba0 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Deleting instance files /opt/stack/data/nova/instances/ce0502da-6afb-47b3-a6f0-de5885b52f30_del
Nov 15 04:30:40 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-6f7aa380-f8a2-480b-88d6-aad46cc88ba0 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Deletion of /opt/stack/data/nova/instances/ce0502da-6afb-47b3-a6f0-de5885b52f30_del complete
Nov 15 04:30:40 user nova-compute[74805]: INFO nova.compute.manager [None req-6f7aa380-f8a2-480b-88d6-aad46cc88ba0 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 15 04:30:40 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-6f7aa380-f8a2-480b-88d6-aad46cc88ba0 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:30:40 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:30:40 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:30:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:41 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:30:41 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Took 0.44 seconds to deallocate network for instance.
Nov 15 04:30:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f7aa380-f8a2-480b-88d6-aad46cc88ba0 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:30:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f7aa380-f8a2-480b-88d6-aad46cc88ba0 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:30:41 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-6f7aa380-f8a2-480b-88d6-aad46cc88ba0 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:30:41 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-6f7aa380-f8a2-480b-88d6-aad46cc88ba0 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:30:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f7aa380-f8a2-480b-88d6-aad46cc88ba0 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.299s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:30:41 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-6f7aa380-f8a2-480b-88d6-aad46cc88ba0 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Deleted allocations for instance ce0502da-6afb-47b3-a6f0-de5885b52f30
Nov 15 04:30:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f7aa380-f8a2-480b-88d6-aad46cc88ba0 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "ce0502da-6afb-47b3-a6f0-de5885b52f30" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.866s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:30:41 user nova-compute[74805]: DEBUG nova.compute.manager [req-aad4c14b-de21-450f-a628-5906411d4970 req-022bb82c-5486-4af9-9a11-90d364e2f76a service nova] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Received event network-vif-deleted-135c9269-201d-4f8d-958e-8ef2a3e0e375 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:30:42 user nova-compute[74805]: DEBUG nova.compute.manager [req-f4a4fea9-7982-48ec-9965-afcfeee76b4f req-78ccff73-c370-47c7-bc47-98af41f93f90 service nova] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Received event network-vif-plugged-135c9269-201d-4f8d-958e-8ef2a3e0e375 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:30:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f4a4fea9-7982-48ec-9965-afcfeee76b4f req-78ccff73-c370-47c7-bc47-98af41f93f90 service nova] Acquiring lock "ce0502da-6afb-47b3-a6f0-de5885b52f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:30:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f4a4fea9-7982-48ec-9965-afcfeee76b4f req-78ccff73-c370-47c7-bc47-98af41f93f90 service nova] Lock "ce0502da-6afb-47b3-a6f0-de5885b52f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:30:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f4a4fea9-7982-48ec-9965-afcfeee76b4f req-78ccff73-c370-47c7-bc47-98af41f93f90 service nova] Lock "ce0502da-6afb-47b3-a6f0-de5885b52f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:30:42 user nova-compute[74805]: DEBUG nova.compute.manager [req-f4a4fea9-7982-48ec-9965-afcfeee76b4f req-78ccff73-c370-47c7-bc47-98af41f93f90 service nova] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] No waiting events found dispatching network-vif-plugged-135c9269-201d-4f8d-958e-8ef2a3e0e375 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:30:42 user nova-compute[74805]: WARNING nova.compute.manager [req-f4a4fea9-7982-48ec-9965-afcfeee76b4f req-78ccff73-c370-47c7-bc47-98af41f93f90 service nova] [instance: ce0502da-6afb-47b3-a6f0-de5885b52f30] Received unexpected event network-vif-plugged-135c9269-201d-4f8d-958e-8ef2a3e0e375 for instance with vm_state deleted and task_state None.
Nov 15 04:30:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:30:53 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 6500dfcd-24fb-4683-aa90-3c17420f44c1 is timed out.
Nov 15 04:30:53 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Successfully detached device vdc from instance 6500dfcd-24fb-4683-aa90-3c17420f44c1 from the live domain config.
Nov 15 04:30:53 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NhbVDMls', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:30:53 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:30:53 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[35377cac-5552-4dbb-81fc-7ca9b403e8eb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:30:53 user nova-compute[74805]: No targets found.
Nov 15 04:30:53 user nova-compute[74805]: iSNS:
Nov 15 04:30:53 user nova-compute[74805]: No targets found.
Nov 15 04:30:53 user nova-compute[74805]: STATIC:
Nov 15 04:30:53 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f
Nov 15 04:30:53 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:30:53 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:30:53 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83
Nov 15 04:30:53 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:30:53 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:30:53 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda
Nov 15 04:30:53 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:30:53 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:30:53 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04
Nov 15 04:30:53 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:30:53 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:30:53 user nova-compute[74805]: FIRMWARE:
Nov 15 04:30:53 user nova-compute[74805]: No targets found.
Nov 15 04:30:53 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:30:53 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:30:53 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f033d911-2721-4de7-8981-e0303b24b44b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad7c5ac-d3f1-4f66-8569-6ea2ca4b37cd]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:30:53 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:30:53 user nova-compute[74805]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)
Nov 15 04:30:53 user nova-compute[74805]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda (non-flash)
Nov 15 04:30:53 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:30:53 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:30:53 user nova-compute[74805]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)
Nov 15 04:30:53 user nova-compute[74805]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda (non-flash)
Nov 15 04:30:53 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c69f1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda'): ({'sdg'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Removing single pathed devices sdg {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[02160120-086a-4944-babb-9f17efa059a3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c9b6c8-37b3-4789-93f3-6448d84875c7]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Flushing IO for device /dev/sdg {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7ef97a-293e-45ec-8533-d32be02dbefc]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:30:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.059s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80ab0d1-e2a1-4bec-ad0c-7aa331835060]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:54 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:30:54 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] SCSI volumes sdg have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:30:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:30:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf374b6-724d-4fd5-bc4e-ddec8b00e74c]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:30:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ad0f3b-ba2f-42d4-92ac-1c2ced0c7bae]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda, portal: 172.16.0.220,3260]
Nov 15 04:30:54 user nova-compute[74805]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda, portal: 172.16.0.220,3260] successful.
Nov 15 04:30:54 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:30:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:30:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9d9212-07e3-44dd-9372-df5fa83d5dda -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:30:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ad9dd3-c336-4331-9b6a-e7f4d914b2a3]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:30:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:30:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:30:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] <== disconnect_volume: return (346ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:30:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:30:55 user nova-compute[74805]: DEBUG nova.objects.instance [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'flavor' on Instance uuid 6500dfcd-24fb-4683-aa90-3c17420f44c1 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:30:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-014c112a-d746-404c-b454-fe44ad889714 tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "6500dfcd-24fb-4683-aa90-3c17420f44c1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.996s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:30:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:30:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f1b29e47-c2d1-441f-8926-dce88b609f3f tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "6500dfcd-24fb-4683-aa90-3c17420f44c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:30:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f1b29e47-c2d1-441f-8926-dce88b609f3f tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "6500dfcd-24fb-4683-aa90-3c17420f44c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:30:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f1b29e47-c2d1-441f-8926-dce88b609f3f tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "6500dfcd-24fb-4683-aa90-3c17420f44c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:30:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f1b29e47-c2d1-441f-8926-dce88b609f3f tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "6500dfcd-24fb-4683-aa90-3c17420f44c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:30:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f1b29e47-c2d1-441f-8926-dce88b609f3f tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "6500dfcd-24fb-4683-aa90-3c17420f44c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:30:56 user nova-compute[74805]: INFO nova.compute.manager [None req-f1b29e47-c2d1-441f-8926-dce88b609f3f tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Terminating instance
Nov 15 04:30:56 user nova-compute[74805]: DEBUG nova.compute.manager [None req-f1b29e47-c2d1-441f-8926-dce88b609f3f tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:30:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:56 user nova-compute[74805]: DEBUG nova.compute.manager [req-31bfe32c-0f86-4aab-b7a0-76209e8dca53 req-c2a922af-2853-48d8-b499-216b841258d6 service nova] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Received event network-vif-unplugged-ccd1646c-a99d-46c3-9caa-d1420b79390a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:30:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-31bfe32c-0f86-4aab-b7a0-76209e8dca53 req-c2a922af-2853-48d8-b499-216b841258d6 service nova] Acquiring lock "6500dfcd-24fb-4683-aa90-3c17420f44c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:30:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-31bfe32c-0f86-4aab-b7a0-76209e8dca53 req-c2a922af-2853-48d8-b499-216b841258d6 service nova] Lock "6500dfcd-24fb-4683-aa90-3c17420f44c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:30:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-31bfe32c-0f86-4aab-b7a0-76209e8dca53 req-c2a922af-2853-48d8-b499-216b841258d6 service nova] Lock "6500dfcd-24fb-4683-aa90-3c17420f44c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:30:56 user nova-compute[74805]: DEBUG nova.compute.manager [req-31bfe32c-0f86-4aab-b7a0-76209e8dca53 req-c2a922af-2853-48d8-b499-216b841258d6 service nova] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] No waiting events found dispatching network-vif-unplugged-ccd1646c-a99d-46c3-9caa-d1420b79390a {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:30:56 user nova-compute[74805]: DEBUG nova.compute.manager [req-31bfe32c-0f86-4aab-b7a0-76209e8dca53 req-c2a922af-2853-48d8-b499-216b841258d6 service nova] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Received event network-vif-unplugged-ccd1646c-a99d-46c3-9caa-d1420b79390a for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:30:56 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Instance destroyed successfully.
Nov 15 04:30:56 user nova-compute[74805]: DEBUG nova.objects.instance [None req-f1b29e47-c2d1-441f-8926-dce88b609f3f tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lazy-loading 'resources' on Instance uuid 6500dfcd-24fb-4683-aa90-3c17420f44c1 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:30:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-f1b29e47-c2d1-441f-8926-dce88b609f3f tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-292741836',display_name='tempest-AttachVolumeTestJSON-server-292741836',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-292741836',id=36,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFofT9T8nuqJoYl+xrXEbEiwVCmi9ar+UeVHQ5AJd7Qo7dxDmH8wnwceUhut9M3advHMWouuz1J0oMVLcWqEvdCMpxkl3Tu+90EbbIoXjhlmpGVZhP+6942VyAIEjcBUA==',key_name='tempest-keypair-1597146635',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:28:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7ba201faadb461882c823f9bd895af9',ramdisk_id='',reservation_id='r-skj7gis1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-17326548',owner_user_name='tempest-AttachVolumeTestJSON-17326548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:28:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50fe72dfe19f4c9792c4733f14b2d464',uuid=6500dfcd-24fb-4683-aa90-3c17420f44c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ccd1646c-a99d-46c3-9caa-d1420b79390a", "address": "fa:16:3e:3a:04:cb", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd1646c-a9", "ovs_interfaceid": "ccd1646c-a99d-46c3-9caa-d1420b79390a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:30:56 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-f1b29e47-c2d1-441f-8926-dce88b609f3f tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Converting VIF {"id": "ccd1646c-a99d-46c3-9caa-d1420b79390a", "address": "fa:16:3e:3a:04:cb", "network": {"id": "5b2973a0-643c-4d30-a6cd-3d1391fe2cb8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1430690613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7ba201faadb461882c823f9bd895af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd1646c-a9", "ovs_interfaceid": "ccd1646c-a99d-46c3-9caa-d1420b79390a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:30:56 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-f1b29e47-c2d1-441f-8926-dce88b609f3f tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:04:cb,bridge_name='br-int',has_traffic_filtering=True,id=ccd1646c-a99d-46c3-9caa-d1420b79390a,network=Network(5b2973a0-643c-4d30-a6cd-3d1391fe2cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccd1646c-a9') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:30:56 user nova-compute[74805]: DEBUG os_vif [None req-f1b29e47-c2d1-441f-8926-dce88b609f3f tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:04:cb,bridge_name='br-int',has_traffic_filtering=True,id=ccd1646c-a99d-46c3-9caa-d1420b79390a,network=Network(5b2973a0-643c-4d30-a6cd-3d1391fe2cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccd1646c-a9') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:30:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapccd1646c-a9, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:30:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:30:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=624590aa-e445-4d85-b87a-7a0f52672247) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:30:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:30:56 user nova-compute[74805]: INFO os_vif [None req-f1b29e47-c2d1-441f-8926-dce88b609f3f tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:04:cb,bridge_name='br-int',has_traffic_filtering=True,id=ccd1646c-a99d-46c3-9caa-d1420b79390a,network=Network(5b2973a0-643c-4d30-a6cd-3d1391fe2cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccd1646c-a9')
Nov 15 04:30:56 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-f1b29e47-c2d1-441f-8926-dce88b609f3f tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Deleting instance files /opt/stack/data/nova/instances/6500dfcd-24fb-4683-aa90-3c17420f44c1_del
Nov 15 04:30:56 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-f1b29e47-c2d1-441f-8926-dce88b609f3f tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Deletion of /opt/stack/data/nova/instances/6500dfcd-24fb-4683-aa90-3c17420f44c1_del complete
Nov 15 04:30:56 user nova-compute[74805]: INFO nova.compute.manager [None req-f1b29e47-c2d1-441f-8926-dce88b609f3f tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 04:30:56 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-f1b29e47-c2d1-441f-8926-dce88b609f3f tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:30:56 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:30:56 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:30:57 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:30:57 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Took 0.74 seconds to deallocate network for instance.
Nov 15 04:30:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f1b29e47-c2d1-441f-8926-dce88b609f3f tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:30:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f1b29e47-c2d1-441f-8926-dce88b609f3f tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:30:57 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-f1b29e47-c2d1-441f-8926-dce88b609f3f tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:30:58 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-f1b29e47-c2d1-441f-8926-dce88b609f3f tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:30:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f1b29e47-c2d1-441f-8926-dce88b609f3f tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:30:58 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-f1b29e47-c2d1-441f-8926-dce88b609f3f tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Deleted allocations for instance 6500dfcd-24fb-4683-aa90-3c17420f44c1
Nov 15 04:30:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-f1b29e47-c2d1-441f-8926-dce88b609f3f tempest-AttachVolumeTestJSON-17326548 tempest-AttachVolumeTestJSON-17326548-project-member] Lock "6500dfcd-24fb-4683-aa90-3c17420f44c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.099s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:30:58 user nova-compute[74805]: DEBUG nova.compute.manager [req-8f0e0238-5301-4c12-8066-3439d51bc813 req-2ccebc2e-dd45-4393-8748-6dd069ba654b service nova] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Received event network-vif-plugged-ccd1646c-a99d-46c3-9caa-d1420b79390a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:30:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8f0e0238-5301-4c12-8066-3439d51bc813 req-2ccebc2e-dd45-4393-8748-6dd069ba654b service nova] Acquiring lock "6500dfcd-24fb-4683-aa90-3c17420f44c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:30:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8f0e0238-5301-4c12-8066-3439d51bc813 req-2ccebc2e-dd45-4393-8748-6dd069ba654b service nova] Lock "6500dfcd-24fb-4683-aa90-3c17420f44c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:30:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8f0e0238-5301-4c12-8066-3439d51bc813 req-2ccebc2e-dd45-4393-8748-6dd069ba654b service nova] Lock "6500dfcd-24fb-4683-aa90-3c17420f44c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:30:58 user nova-compute[74805]: DEBUG nova.compute.manager [req-8f0e0238-5301-4c12-8066-3439d51bc813 req-2ccebc2e-dd45-4393-8748-6dd069ba654b service nova] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] No waiting events found dispatching network-vif-plugged-ccd1646c-a99d-46c3-9caa-d1420b79390a {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:30:58 user nova-compute[74805]: WARNING nova.compute.manager [req-8f0e0238-5301-4c12-8066-3439d51bc813 req-2ccebc2e-dd45-4393-8748-6dd069ba654b service nova] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Received unexpected event network-vif-plugged-ccd1646c-a99d-46c3-9caa-d1420b79390a for instance with vm_state deleted and task_state None.
Nov 15 04:30:58 user nova-compute[74805]: DEBUG nova.compute.manager [req-8f0e0238-5301-4c12-8066-3439d51bc813 req-2ccebc2e-dd45-4393-8748-6dd069ba654b service nova] [instance: 6500dfcd-24fb-4683-aa90-3c17420f44c1] Received event network-vif-deleted-ccd1646c-a99d-46c3-9caa-d1420b79390a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:31:00 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c4968663-4f4f-4db0-bd2c-278d271b8b35 is timed out.
Nov 15 04:31:00 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Successfully detached device vdb from instance c4968663-4f4f-4db0-bd2c-278d271b8b35 from the live domain config.
Nov 15 04:31:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vQhFOtja', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:31:00 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:31:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9a503f-3594-4602-9c53-7bc0b5bdc01e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:31:00 user nova-compute[74805]: No targets found.
Nov 15 04:31:00 user nova-compute[74805]: iSNS:
Nov 15 04:31:00 user nova-compute[74805]: No targets found.
Nov 15 04:31:00 user nova-compute[74805]: STATIC:
Nov 15 04:31:00 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f
Nov 15 04:31:00 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:31:00 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:31:00 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83
Nov 15 04:31:00 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:31:00 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:31:00 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04
Nov 15 04:31:00 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:31:00 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:31:00 user nova-compute[74805]: FIRMWARE:
Nov 15 04:31:00 user nova-compute[74805]: No targets found.
Nov 15 04:31:00 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:31:00 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:31:00 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b616d1fc-d79a-417b-93b3-c6a73d2ef616]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8345e946-08a5-4797-a31b-db134992eafd]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:31:00 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:31:00 user nova-compute[74805]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)
Nov 15 04:31:00 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:31:00 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:31:00 user nova-compute[74805]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 (non-flash)
Nov 15 04:31:00 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c7af880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04'): ({'sdc'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Removing single pathed devices sdc {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb1a586-0b63-47fc-8116-f93e51f35a4c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18a1ec6-2349-4c02-af0d-38d894ddb800]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Flushing IO for device /dev/sdc {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b686dd59-e533-45b1-b693-ab293998cdab]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8d2476-1bc5-40c1-b8df-e71574242bce]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdc0ecb-4867-4207-b057-4b68e558f494]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[922e09ef-66ee-4692-b78d-38cd32668375]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04, portal: 172.16.0.220,3260]
Nov 15 04:31:00 user nova-compute[74805]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04, portal: 172.16.0.220,3260] successful.
Nov 15 04:31:00 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:208e019a-e417-4514-9fa8-051c4a5adc04 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[56dc8a68-b616-475e-a798-bff164df09de]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] <== disconnect_volume: return (299ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:31:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:31:01 user nova-compute[74805]: DEBUG nova.objects.instance [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lazy-loading 'flavor' on Instance uuid c4968663-4f4f-4db0-bd2c-278d271b8b35 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:31:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6a240338-fcdc-403c-8486-b2a37b774c5f tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "c4968663-4f4f-4db0-bd2c-278d271b8b35" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.743s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:31:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:05 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:31:05 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Triggering sync for uuid d63f3726-27df-455f-bda0-3ddca95b70d9 {{(pid=74805) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 04:31:05 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Triggering sync for uuid 9f267864-0b72-431d-9b0d-c63436002a4c {{(pid=74805) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 04:31:05 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Triggering sync for uuid 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c {{(pid=74805) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 04:31:05 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Triggering sync for uuid fda0e490-03e3-4cf5-b22d-aab83d715616 {{(pid=74805) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 04:31:05 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Triggering sync for uuid 38196606-a9c9-4604-ad21-2ec7511a8b28 {{(pid=74805) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 04:31:05 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Triggering sync for uuid c4968663-4f4f-4db0-bd2c-278d271b8b35 {{(pid=74805) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 04:31:05 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Triggering sync for uuid 2d9a5b2b-7196-4ec9-8afc-cac356fe1495 {{(pid=74805) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 04:31:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "d63f3726-27df-455f-bda0-3ddca95b70d9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:31:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "d63f3726-27df-455f-bda0-3ddca95b70d9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:31:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "9f267864-0b72-431d-9b0d-c63436002a4c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:31:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "9f267864-0b72-431d-9b0d-c63436002a4c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:31:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:31:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:31:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "fda0e490-03e3-4cf5-b22d-aab83d715616" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:31:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "fda0e490-03e3-4cf5-b22d-aab83d715616" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:31:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "38196606-a9c9-4604-ad21-2ec7511a8b28" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:31:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:31:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "c4968663-4f4f-4db0-bd2c-278d271b8b35" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:31:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "c4968663-4f4f-4db0-bd2c-278d271b8b35" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:31:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:31:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:31:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "9f267864-0b72-431d-9b0d-c63436002a4c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:31:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "d63f3726-27df-455f-bda0-3ddca95b70d9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:31:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:31:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "fda0e490-03e3-4cf5-b22d-aab83d715616" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:31:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:31:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "c4968663-4f4f-4db0-bd2c-278d271b8b35" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:31:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:31:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:31:11 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:31:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:31:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:31:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:31:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:31:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:12 user nova-compute[74805]: INFO nova.compute.manager [None req-d578ff59-e124-4c88-acdc-62027ee5e62f tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Get console output
Nov 15 04:31:12 user nova-compute[74805]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 15 04:31:15 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:31:15 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:31:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:31:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:31:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:31:15 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:31:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:31:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:31:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:31:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:31:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:31:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:31:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:31:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:31:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:31:15 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:31:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:31:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:31:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:31:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:31:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:31:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:31:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:31:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:31:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:31:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:31:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:31:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:31:17 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:31:17 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:31:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=8202MB free_disk=24.969730377197266GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:31:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:31:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:31:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance d63f3726-27df-455f-bda0-3ddca95b70d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:31:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 9f267864-0b72-431d-9b0d-c63436002a4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:31:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:31:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 38196606-a9c9-4604-ad21-2ec7511a8b28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:31:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance fda0e490-03e3-4cf5-b22d-aab83d715616 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:31:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance c4968663-4f4f-4db0-bd2c-278d271b8b35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:31:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 2d9a5b2b-7196-4ec9-8afc-cac356fe1495 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:31:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:31:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:31:17 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Refreshing inventories for resource provider ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 04:31:17 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Updating ProviderTree inventory for provider ada87504-5552-4a33-b754-f9a54c67fe39 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 04:31:17 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Updating inventory in ProviderTree for provider ada87504-5552-4a33-b754-f9a54c67fe39 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 04:31:17 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Refreshing aggregate associations for resource provider ada87504-5552-4a33-b754-f9a54c67fe39, aggregates: None {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 04:31:17 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Refreshing trait associations for resource provider ada87504-5552-4a33-b754-f9a54c67fe39, traits: COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 04:31:17 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:31:17 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:31:18 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:31:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.632s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:31:19 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:31:19 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:31:19 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:31:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-9f267864-0b72-431d-9b0d-c63436002a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:31:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-9f267864-0b72-431d-9b0d-c63436002a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:31:19 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:31:19 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Updating instance_info_cache with network_info: [{"id": "bd5458e6-03d9-4fab-bbfb-23989a82c193", "address": "fa:16:3e:86:87:bc", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5458e6-03", "ovs_interfaceid": "bd5458e6-03d9-4fab-bbfb-23989a82c193", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:31:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-9f267864-0b72-431d-9b0d-c63436002a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:31:19 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:31:19 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:31:19 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:31:19 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:31:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:31:23 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:31:23 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:31:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f5e4053-3f7a-4093-807d-0d92952a57d2 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Acquiring lock "c4968663-4f4f-4db0-bd2c-278d271b8b35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:31:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f5e4053-3f7a-4093-807d-0d92952a57d2 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "c4968663-4f4f-4db0-bd2c-278d271b8b35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:31:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f5e4053-3f7a-4093-807d-0d92952a57d2 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Acquiring lock "c4968663-4f4f-4db0-bd2c-278d271b8b35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:31:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f5e4053-3f7a-4093-807d-0d92952a57d2 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "c4968663-4f4f-4db0-bd2c-278d271b8b35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:31:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f5e4053-3f7a-4093-807d-0d92952a57d2 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "c4968663-4f4f-4db0-bd2c-278d271b8b35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:31:29 user nova-compute[74805]: INFO nova.compute.manager [None req-6f5e4053-3f7a-4093-807d-0d92952a57d2 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Terminating instance
Nov 15 04:31:29 user nova-compute[74805]: DEBUG nova.compute.manager [None req-6f5e4053-3f7a-4093-807d-0d92952a57d2 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:31:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:30 user nova-compute[74805]: DEBUG nova.compute.manager [req-5c77aef9-0262-439f-ae37-57acc31cd0d1 req-40da0f55-552d-424c-b13a-ddd1f1c1195e service nova] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Received event network-vif-unplugged-2c5ba330-8197-41a2-8ab4-d967a03ec2fc {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:31:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5c77aef9-0262-439f-ae37-57acc31cd0d1 req-40da0f55-552d-424c-b13a-ddd1f1c1195e service nova] Acquiring lock "c4968663-4f4f-4db0-bd2c-278d271b8b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:31:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5c77aef9-0262-439f-ae37-57acc31cd0d1 req-40da0f55-552d-424c-b13a-ddd1f1c1195e service nova] Lock "c4968663-4f4f-4db0-bd2c-278d271b8b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:31:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5c77aef9-0262-439f-ae37-57acc31cd0d1 req-40da0f55-552d-424c-b13a-ddd1f1c1195e service nova] Lock "c4968663-4f4f-4db0-bd2c-278d271b8b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:31:30 user nova-compute[74805]: DEBUG nova.compute.manager [req-5c77aef9-0262-439f-ae37-57acc31cd0d1 req-40da0f55-552d-424c-b13a-ddd1f1c1195e service nova] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] No waiting events found dispatching network-vif-unplugged-2c5ba330-8197-41a2-8ab4-d967a03ec2fc {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:31:30 user nova-compute[74805]: DEBUG nova.compute.manager [req-5c77aef9-0262-439f-ae37-57acc31cd0d1 req-40da0f55-552d-424c-b13a-ddd1f1c1195e service nova] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Received event network-vif-unplugged-2c5ba330-8197-41a2-8ab4-d967a03ec2fc for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:31:30 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Instance destroyed successfully.
Nov 15 04:31:30 user nova-compute[74805]: DEBUG nova.objects.instance [None req-6f5e4053-3f7a-4093-807d-0d92952a57d2 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lazy-loading 'resources' on Instance uuid c4968663-4f4f-4db0-bd2c-278d271b8b35 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:31:30 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-6f5e4053-3f7a-4093-807d-0d92952a57d2 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:27:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1260660019',display_name='tempest-TestServerVolumeAttachmentScenario-server-1260660019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1260660019',id=34,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtSu5/6pqHRmNrszt7k7zYYiV3vxbfyDlRCX6lJzqnVrsozMJj+mTHNRGxgeD8Z9rYUEo3y8x8GUncUp84hIUWZMuDwfMLae7SR9ybL/WedIX4XMgPO06ehDdgZHbdaQg==',key_name='tempest-keypair-1606383151',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:27:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4790ff8a50a0448ebee83043e2fe764b',ramdisk_id='',reservation_id='r-w270l28c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1993127584',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1993127584-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:27:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de8e84dbb0854fdb913c900a34b404bf',uuid=c4968663-4f4f-4db0-bd2c-278d271b8b35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c5ba330-8197-41a2-8ab4-d967a03ec2fc", "address": "fa:16:3e:66:db:14", "network": {"id": "3948912e-ebae-4493-938d-3cf6366cf59f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1304629230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4790ff8a50a0448ebee83043e2fe764b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c5ba330-81", "ovs_interfaceid": "2c5ba330-8197-41a2-8ab4-d967a03ec2fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:31:30 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-6f5e4053-3f7a-4093-807d-0d92952a57d2 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Converting VIF {"id": "2c5ba330-8197-41a2-8ab4-d967a03ec2fc", "address": "fa:16:3e:66:db:14", "network": {"id": "3948912e-ebae-4493-938d-3cf6366cf59f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1304629230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4790ff8a50a0448ebee83043e2fe764b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c5ba330-81", "ovs_interfaceid": "2c5ba330-8197-41a2-8ab4-d967a03ec2fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:31:30 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-6f5e4053-3f7a-4093-807d-0d92952a57d2 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:db:14,bridge_name='br-int',has_traffic_filtering=True,id=2c5ba330-8197-41a2-8ab4-d967a03ec2fc,network=Network(3948912e-ebae-4493-938d-3cf6366cf59f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c5ba330-81') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:31:30 user nova-compute[74805]: DEBUG os_vif [None req-6f5e4053-3f7a-4093-807d-0d92952a57d2 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:db:14,bridge_name='br-int',has_traffic_filtering=True,id=2c5ba330-8197-41a2-8ab4-d967a03ec2fc,network=Network(3948912e-ebae-4493-938d-3cf6366cf59f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c5ba330-81') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:31:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c5ba330-81, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:31:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:31:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7842d5e6-bdbe-4f7d-86f0-e25a2f765bb6) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:31:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:30 user nova-compute[74805]: INFO os_vif [None req-6f5e4053-3f7a-4093-807d-0d92952a57d2 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:db:14,bridge_name='br-int',has_traffic_filtering=True,id=2c5ba330-8197-41a2-8ab4-d967a03ec2fc,network=Network(3948912e-ebae-4493-938d-3cf6366cf59f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c5ba330-81')
Nov 15 04:31:30 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-6f5e4053-3f7a-4093-807d-0d92952a57d2 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Deleting instance files /opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35_del
Nov 15 04:31:30 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-6f5e4053-3f7a-4093-807d-0d92952a57d2 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Deletion of /opt/stack/data/nova/instances/c4968663-4f4f-4db0-bd2c-278d271b8b35_del complete
Nov 15 04:31:30 user nova-compute[74805]: INFO nova.compute.manager [None req-6f5e4053-3f7a-4093-807d-0d92952a57d2 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 15 04:31:30 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-6f5e4053-3f7a-4093-807d-0d92952a57d2 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:31:30 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:31:30 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:31:31 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:31:31 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Took 1.02 seconds to deallocate network for instance.
Nov 15 04:31:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f5e4053-3f7a-4093-807d-0d92952a57d2 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:31:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f5e4053-3f7a-4093-807d-0d92952a57d2 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:31:32 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-6f5e4053-3f7a-4093-807d-0d92952a57d2 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:31:32 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-6f5e4053-3f7a-4093-807d-0d92952a57d2 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:31:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f5e4053-3f7a-4093-807d-0d92952a57d2 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:31:32 user nova-compute[74805]: DEBUG nova.compute.manager [req-bcf4e89a-70cd-46a9-9c8a-7c1c649a2968 req-94cccfd3-8429-47b0-aa06-c69c760aea63 service nova] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Received event network-vif-plugged-2c5ba330-8197-41a2-8ab4-d967a03ec2fc {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:31:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bcf4e89a-70cd-46a9-9c8a-7c1c649a2968 req-94cccfd3-8429-47b0-aa06-c69c760aea63 service nova] Acquiring lock "c4968663-4f4f-4db0-bd2c-278d271b8b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:31:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bcf4e89a-70cd-46a9-9c8a-7c1c649a2968 req-94cccfd3-8429-47b0-aa06-c69c760aea63 service nova] Lock "c4968663-4f4f-4db0-bd2c-278d271b8b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:31:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bcf4e89a-70cd-46a9-9c8a-7c1c649a2968 req-94cccfd3-8429-47b0-aa06-c69c760aea63 service nova] Lock "c4968663-4f4f-4db0-bd2c-278d271b8b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:31:32 user nova-compute[74805]: DEBUG nova.compute.manager [req-bcf4e89a-70cd-46a9-9c8a-7c1c649a2968 req-94cccfd3-8429-47b0-aa06-c69c760aea63 service nova] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] No waiting events found dispatching network-vif-plugged-2c5ba330-8197-41a2-8ab4-d967a03ec2fc {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:31:32 user nova-compute[74805]: WARNING nova.compute.manager [req-bcf4e89a-70cd-46a9-9c8a-7c1c649a2968 req-94cccfd3-8429-47b0-aa06-c69c760aea63 service nova] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Received unexpected event network-vif-plugged-2c5ba330-8197-41a2-8ab4-d967a03ec2fc for instance with vm_state deleted and task_state None.
Nov 15 04:31:32 user nova-compute[74805]: DEBUG nova.compute.manager [req-bcf4e89a-70cd-46a9-9c8a-7c1c649a2968 req-94cccfd3-8429-47b0-aa06-c69c760aea63 service nova] [instance: c4968663-4f4f-4db0-bd2c-278d271b8b35] Received event network-vif-deleted-2c5ba330-8197-41a2-8ab4-d967a03ec2fc {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:31:32 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-6f5e4053-3f7a-4093-807d-0d92952a57d2 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Deleted allocations for instance c4968663-4f4f-4db0-bd2c-278d271b8b35
Nov 15 04:31:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f5e4053-3f7a-4093-807d-0d92952a57d2 tempest-TestServerVolumeAttachmentScenario-1993127584 tempest-TestServerVolumeAttachmentScenario-1993127584-project-member] Lock "c4968663-4f4f-4db0-bd2c-278d271b8b35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.581s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:31:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:34 user nova-compute[74805]: DEBUG nova.compute.manager [req-6f072595-0f37-4278-baf5-c5a54931e053 req-be2e57e5-c760-4db7-a0b5-7d7f151c31fd service nova] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Received event network-changed-b5adbddb-acb3-40b1-9768-923daa9f3a29 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:31:34 user nova-compute[74805]: DEBUG nova.compute.manager [req-6f072595-0f37-4278-baf5-c5a54931e053 req-be2e57e5-c760-4db7-a0b5-7d7f151c31fd service nova] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Refreshing instance network info cache due to event network-changed-b5adbddb-acb3-40b1-9768-923daa9f3a29. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:31:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6f072595-0f37-4278-baf5-c5a54931e053 req-be2e57e5-c760-4db7-a0b5-7d7f151c31fd service nova] Acquiring lock "refresh_cache-8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:31:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6f072595-0f37-4278-baf5-c5a54931e053 req-be2e57e5-c760-4db7-a0b5-7d7f151c31fd service nova] Acquired lock "refresh_cache-8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:31:34 user nova-compute[74805]: DEBUG nova.network.neutron [req-6f072595-0f37-4278-baf5-c5a54931e053 req-be2e57e5-c760-4db7-a0b5-7d7f151c31fd service nova] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Refreshing network info cache for port b5adbddb-acb3-40b1-9768-923daa9f3a29 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:31:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-051007d6-55fe-4e4e-aec3-0451e08ecc82 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:31:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-051007d6-55fe-4e4e-aec3-0451e08ecc82 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:31:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-051007d6-55fe-4e4e-aec3-0451e08ecc82 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:31:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-051007d6-55fe-4e4e-aec3-0451e08ecc82 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:31:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-051007d6-55fe-4e4e-aec3-0451e08ecc82 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:31:34 user nova-compute[74805]: INFO nova.compute.manager [None req-051007d6-55fe-4e4e-aec3-0451e08ecc82 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Terminating instance
Nov 15 04:31:34 user nova-compute[74805]: DEBUG nova.compute.manager [None req-051007d6-55fe-4e4e-aec3-0451e08ecc82 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:31:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:34 user nova-compute[74805]: DEBUG nova.compute.manager [req-448b80f8-1170-485f-816d-c549d7e866cc req-862747e2-d431-438f-8e3d-d776828c859f service nova] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Received event network-vif-unplugged-b5adbddb-acb3-40b1-9768-923daa9f3a29 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:31:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-448b80f8-1170-485f-816d-c549d7e866cc req-862747e2-d431-438f-8e3d-d776828c859f service nova] Acquiring lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:31:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-448b80f8-1170-485f-816d-c549d7e866cc req-862747e2-d431-438f-8e3d-d776828c859f service nova] Lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:31:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-448b80f8-1170-485f-816d-c549d7e866cc req-862747e2-d431-438f-8e3d-d776828c859f service nova] Lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:31:34 user nova-compute[74805]: DEBUG nova.compute.manager [req-448b80f8-1170-485f-816d-c549d7e866cc req-862747e2-d431-438f-8e3d-d776828c859f service nova] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] No waiting events found dispatching network-vif-unplugged-b5adbddb-acb3-40b1-9768-923daa9f3a29 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:31:34 user nova-compute[74805]: DEBUG nova.compute.manager [req-448b80f8-1170-485f-816d-c549d7e866cc req-862747e2-d431-438f-8e3d-d776828c859f service nova] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Received event network-vif-unplugged-b5adbddb-acb3-40b1-9768-923daa9f3a29 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:31:35 user nova-compute[74805]: DEBUG nova.network.neutron [req-6f072595-0f37-4278-baf5-c5a54931e053 req-be2e57e5-c760-4db7-a0b5-7d7f151c31fd service nova] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Updated VIF entry in instance network info cache for port b5adbddb-acb3-40b1-9768-923daa9f3a29. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:31:35 user nova-compute[74805]: DEBUG nova.network.neutron [req-6f072595-0f37-4278-baf5-c5a54931e053 req-be2e57e5-c760-4db7-a0b5-7d7f151c31fd service nova] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Updating instance_info_cache with network_info: [{"id": "b5adbddb-acb3-40b1-9768-923daa9f3a29", "address": "fa:16:3e:7f:dc:30", "network": {"id": "a06a4001-e7e0-4991-b68a-0a0395d22e19", "bridge": "br-int", "label": "tempest-TestStampPattern-341788822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464531969a244952b436e763f17ab970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5adbddb-ac", "ovs_interfaceid": "b5adbddb-acb3-40b1-9768-923daa9f3a29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:31:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-6f072595-0f37-4278-baf5-c5a54931e053 req-be2e57e5-c760-4db7-a0b5-7d7f151c31fd service nova] Releasing lock "refresh_cache-8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:31:35 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Instance destroyed successfully.
Nov 15 04:31:35 user nova-compute[74805]: DEBUG nova.objects.instance [None req-051007d6-55fe-4e4e-aec3-0451e08ecc82 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lazy-loading 'resources' on Instance uuid 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:31:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-051007d6-55fe-4e4e-aec3-0451e08ecc82 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:24:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1181153034',display_name='tempest-TestStampPattern-server-1181153034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1181153034',id=30,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0NRAQgDbUZf0EbqtKAGHs4GX+/AbapMrSMTst3yG7lWtxqhChiIE0p667dQ9MtVVa6R0YR0OFwR3oN8tOTGfWd9b0OvJqkw2muo0XPuAEVruetlLFRHgQ9v/OWONwx2w==',key_name='tempest-TestStampPattern-1861490322',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:24:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='464531969a244952b436e763f17ab970',ramdisk_id='',reservation_id='r-ymdi31sg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1523333335',owner_user_name='tempest-TestStampPattern-1523333335-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:27:45Z,user_data=None,user_id='147187e3ec664f869db966f1e47a2445',uuid=8d27a3c7-54c7-45fd-85ab-05aa3d375a4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5adbddb-acb3-40b1-9768-923daa9f3a29", "address": "fa:16:3e:7f:dc:30", "network": {"id": "a06a4001-e7e0-4991-b68a-0a0395d22e19", "bridge": "br-int", "label": "tempest-TestStampPattern-341788822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464531969a244952b436e763f17ab970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5adbddb-ac", "ovs_interfaceid": "b5adbddb-acb3-40b1-9768-923daa9f3a29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:31:35 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-051007d6-55fe-4e4e-aec3-0451e08ecc82 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Converting VIF {"id": "b5adbddb-acb3-40b1-9768-923daa9f3a29", "address": "fa:16:3e:7f:dc:30", "network": {"id": "a06a4001-e7e0-4991-b68a-0a0395d22e19", "bridge": "br-int", "label": "tempest-TestStampPattern-341788822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464531969a244952b436e763f17ab970", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5adbddb-ac", "ovs_interfaceid": "b5adbddb-acb3-40b1-9768-923daa9f3a29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:31:35 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-051007d6-55fe-4e4e-aec3-0451e08ecc82 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:dc:30,bridge_name='br-int',has_traffic_filtering=True,id=b5adbddb-acb3-40b1-9768-923daa9f3a29,network=Network(a06a4001-e7e0-4991-b68a-0a0395d22e19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5adbddb-ac') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:31:35 user nova-compute[74805]: DEBUG os_vif [None req-051007d6-55fe-4e4e-aec3-0451e08ecc82 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:dc:30,bridge_name='br-int',has_traffic_filtering=True,id=b5adbddb-acb3-40b1-9768-923daa9f3a29,network=Network(a06a4001-e7e0-4991-b68a-0a0395d22e19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5adbddb-ac') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:31:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5adbddb-ac, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:31:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bff699ff-1ca0-484f-8c0f-1b4371cbe3e6) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:31:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:31:35 user nova-compute[74805]: INFO os_vif [None req-051007d6-55fe-4e4e-aec3-0451e08ecc82 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:dc:30,bridge_name='br-int',has_traffic_filtering=True,id=b5adbddb-acb3-40b1-9768-923daa9f3a29,network=Network(a06a4001-e7e0-4991-b68a-0a0395d22e19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5adbddb-ac')
Nov 15 04:31:35 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-051007d6-55fe-4e4e-aec3-0451e08ecc82 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Deleting instance files /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c_del
Nov 15 04:31:35 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-051007d6-55fe-4e4e-aec3-0451e08ecc82 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Deletion of /opt/stack/data/nova/instances/8d27a3c7-54c7-45fd-85ab-05aa3d375a4c_del complete
Nov 15 04:31:35 user nova-compute[74805]: INFO nova.compute.manager [None req-051007d6-55fe-4e4e-aec3-0451e08ecc82 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 15 04:31:35 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-051007d6-55fe-4e4e-aec3-0451e08ecc82 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:31:35 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:31:35 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:31:35 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:31:35 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Took 0.42 seconds to deallocate network for instance.
Nov 15 04:31:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-051007d6-55fe-4e4e-aec3-0451e08ecc82 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:31:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-051007d6-55fe-4e4e-aec3-0451e08ecc82 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:31:36 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-051007d6-55fe-4e4e-aec3-0451e08ecc82 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:31:36 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-051007d6-55fe-4e4e-aec3-0451e08ecc82 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:31:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-051007d6-55fe-4e4e-aec3-0451e08ecc82 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:31:36 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-051007d6-55fe-4e4e-aec3-0451e08ecc82 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Deleted allocations for instance 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c
Nov 15 04:31:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-051007d6-55fe-4e4e-aec3-0451e08ecc82 tempest-TestStampPattern-1523333335 tempest-TestStampPattern-1523333335-project-member] Lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.700s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:31:36 user nova-compute[74805]: DEBUG nova.compute.manager [req-5b263a66-819c-4919-9319-e99524cbbb0d req-dbd6d801-010b-4c43-bc38-29cf04276c1d service nova] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Received event network-vif-plugged-b5adbddb-acb3-40b1-9768-923daa9f3a29 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:31:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5b263a66-819c-4919-9319-e99524cbbb0d req-dbd6d801-010b-4c43-bc38-29cf04276c1d service nova] Acquiring lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:31:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5b263a66-819c-4919-9319-e99524cbbb0d req-dbd6d801-010b-4c43-bc38-29cf04276c1d service nova] Lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:31:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5b263a66-819c-4919-9319-e99524cbbb0d req-dbd6d801-010b-4c43-bc38-29cf04276c1d service nova] Lock "8d27a3c7-54c7-45fd-85ab-05aa3d375a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:31:36 user nova-compute[74805]: DEBUG nova.compute.manager [req-5b263a66-819c-4919-9319-e99524cbbb0d req-dbd6d801-010b-4c43-bc38-29cf04276c1d service nova] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] No waiting events found dispatching network-vif-plugged-b5adbddb-acb3-40b1-9768-923daa9f3a29 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:31:36 user nova-compute[74805]: WARNING nova.compute.manager [req-5b263a66-819c-4919-9319-e99524cbbb0d req-dbd6d801-010b-4c43-bc38-29cf04276c1d service nova] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Received unexpected event network-vif-plugged-b5adbddb-acb3-40b1-9768-923daa9f3a29 for instance with vm_state deleted and task_state None.
Nov 15 04:31:36 user nova-compute[74805]: DEBUG nova.compute.manager [req-5b263a66-819c-4919-9319-e99524cbbb0d req-dbd6d801-010b-4c43-bc38-29cf04276c1d service nova] [instance: 8d27a3c7-54c7-45fd-85ab-05aa3d375a4c] Received event network-vif-deleted-b5adbddb-acb3-40b1-9768-923daa9f3a29 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:31:40 user nova-compute[74805]: DEBUG nova.compute.manager [req-b9a99b7a-2a55-4bd8-8eb8-c935651fd1cf req-d680e240-1558-48eb-a8ce-fede74f91211 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Received event network-changed-64bc8d35-4c9d-40db-ac46-46d6a3476698 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:31:40 user nova-compute[74805]: DEBUG nova.compute.manager [req-b9a99b7a-2a55-4bd8-8eb8-c935651fd1cf req-d680e240-1558-48eb-a8ce-fede74f91211 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Refreshing instance network info cache due to event network-changed-64bc8d35-4c9d-40db-ac46-46d6a3476698. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:31:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b9a99b7a-2a55-4bd8-8eb8-c935651fd1cf req-d680e240-1558-48eb-a8ce-fede74f91211 service nova] Acquiring lock "refresh_cache-2d9a5b2b-7196-4ec9-8afc-cac356fe1495" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:31:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b9a99b7a-2a55-4bd8-8eb8-c935651fd1cf req-d680e240-1558-48eb-a8ce-fede74f91211 service nova] Acquired lock "refresh_cache-2d9a5b2b-7196-4ec9-8afc-cac356fe1495" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:31:40 user nova-compute[74805]: DEBUG nova.network.neutron [req-b9a99b7a-2a55-4bd8-8eb8-c935651fd1cf req-d680e240-1558-48eb-a8ce-fede74f91211 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Refreshing network info cache for port 64bc8d35-4c9d-40db-ac46-46d6a3476698 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:31:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:40 user nova-compute[74805]: DEBUG nova.network.neutron [req-b9a99b7a-2a55-4bd8-8eb8-c935651fd1cf req-d680e240-1558-48eb-a8ce-fede74f91211 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Updated VIF entry in instance network info cache for port 64bc8d35-4c9d-40db-ac46-46d6a3476698. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:31:40 user nova-compute[74805]: DEBUG nova.network.neutron [req-b9a99b7a-2a55-4bd8-8eb8-c935651fd1cf req-d680e240-1558-48eb-a8ce-fede74f91211 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Updating instance_info_cache with network_info: [{"id": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "address": "fa:16:3e:22:73:22", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bc8d35-4c", "ovs_interfaceid": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:31:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b9a99b7a-2a55-4bd8-8eb8-c935651fd1cf req-d680e240-1558-48eb-a8ce-fede74f91211 service nova] Releasing lock "refresh_cache-2d9a5b2b-7196-4ec9-8afc-cac356fe1495" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:31:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:31:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:31:42 user nova-compute[74805]: INFO nova.compute.manager [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Shelving
Nov 15 04:31:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:43 user nova-compute[74805]: DEBUG nova.compute.manager [req-56156b85-a12b-4625-a903-99fd00b5bc30 req-189f65da-d87d-4076-a7b8-2fdb5956363a service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Received event network-vif-unplugged-64bc8d35-4c9d-40db-ac46-46d6a3476698 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:31:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-56156b85-a12b-4625-a903-99fd00b5bc30 req-189f65da-d87d-4076-a7b8-2fdb5956363a service nova] Acquiring lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:31:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-56156b85-a12b-4625-a903-99fd00b5bc30 req-189f65da-d87d-4076-a7b8-2fdb5956363a service nova] Lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:31:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-56156b85-a12b-4625-a903-99fd00b5bc30 req-189f65da-d87d-4076-a7b8-2fdb5956363a service nova] Lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:31:43 user nova-compute[74805]: DEBUG nova.compute.manager [req-56156b85-a12b-4625-a903-99fd00b5bc30 req-189f65da-d87d-4076-a7b8-2fdb5956363a service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] No waiting events found dispatching network-vif-unplugged-64bc8d35-4c9d-40db-ac46-46d6a3476698 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:31:43 user nova-compute[74805]: WARNING nova.compute.manager [req-56156b85-a12b-4625-a903-99fd00b5bc30 req-189f65da-d87d-4076-a7b8-2fdb5956363a service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Received unexpected event network-vif-unplugged-64bc8d35-4c9d-40db-ac46-46d6a3476698 for instance with vm_state active and task_state shelving.
Nov 15 04:31:43 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Instance destroyed successfully.
Nov 15 04:31:43 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Beginning cold snapshot process
Nov 15 04:31:43 user nova-compute[74805]: DEBUG nova.privsep.utils [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74805) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 04:31:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk /opt/stack/data/nova/instances/snapshots/tmp0fbchmuu/30b21b565378436c839cc04c9a4a1afb {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:31:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk /opt/stack/data/nova/instances/snapshots/tmp0fbchmuu/30b21b565378436c839cc04c9a4a1afb" returned: 0 in 0.604s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:31:44 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Snapshot extracted, beginning image upload
Nov 15 04:31:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-0299df00-4599-4aa6-8d9c-e75c1d025fae req-baf4755b-7bb9-4ae7-a101-bf8d6147dd67 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Received event network-vif-plugged-64bc8d35-4c9d-40db-ac46-46d6a3476698 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:31:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0299df00-4599-4aa6-8d9c-e75c1d025fae req-baf4755b-7bb9-4ae7-a101-bf8d6147dd67 service nova] Acquiring lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:31:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0299df00-4599-4aa6-8d9c-e75c1d025fae req-baf4755b-7bb9-4ae7-a101-bf8d6147dd67 service nova] Lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:31:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0299df00-4599-4aa6-8d9c-e75c1d025fae req-baf4755b-7bb9-4ae7-a101-bf8d6147dd67 service nova] Lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:31:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-0299df00-4599-4aa6-8d9c-e75c1d025fae req-baf4755b-7bb9-4ae7-a101-bf8d6147dd67 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] No waiting events found dispatching network-vif-plugged-64bc8d35-4c9d-40db-ac46-46d6a3476698 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:31:45 user nova-compute[74805]: WARNING nova.compute.manager [req-0299df00-4599-4aa6-8d9c-e75c1d025fae req-baf4755b-7bb9-4ae7-a101-bf8d6147dd67 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Received unexpected event network-vif-plugged-64bc8d35-4c9d-40db-ac46-46d6a3476698 for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 04:31:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:46 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Snapshot image upload complete
Nov 15 04:31:46 user nova-compute[74805]: DEBUG nova.compute.manager [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:31:46 user nova-compute[74805]: INFO nova.compute.manager [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Shelve offloading
Nov 15 04:31:46 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Instance destroyed successfully.
Nov 15 04:31:46 user nova-compute[74805]: DEBUG nova.compute.manager [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:31:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "refresh_cache-2d9a5b2b-7196-4ec9-8afc-cac356fe1495" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:31:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquired lock "refresh_cache-2d9a5b2b-7196-4ec9-8afc-cac356fe1495" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:31:46 user nova-compute[74805]: DEBUG nova.network.neutron [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:31:47 user nova-compute[74805]: DEBUG nova.network.neutron [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Updating instance_info_cache with network_info: [{"id": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "address": "fa:16:3e:22:73:22", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bc8d35-4c", "ovs_interfaceid": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:31:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Releasing lock "refresh_cache-2d9a5b2b-7196-4ec9-8afc-cac356fe1495" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:31:47 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Instance destroyed successfully.
Nov 15 04:31:47 user nova-compute[74805]: DEBUG nova.objects.instance [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lazy-loading 'resources' on Instance uuid 2d9a5b2b-7196-4ec9-8afc-cac356fe1495 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:31:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:29:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-404241420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-404241420',id=37,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKBur/RpyELDGs8OS+fGtmcJkicDq1Ji9wOx9nR/Hhap23qoGdzn+AKk78C/EboXmcHvLGWAUzOVtcD86a/Pmez/PS1wixMd9BxHxz0S3w0qb3gYKb+8AZmYpR6qLmaow==',key_name='tempest-keypair-498211884',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:29:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5e01874e82ed4ae08813343751506eeb',ramdisk_id='',reservation_id='r-d0v3uxp3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2114494734',owner_user_name='tempest-AttachVolumeShelveTestJSON-2114494734-project-member',shelved_at='2023-11-15T04:31:46.665509',shelved_host='user',shelved_image_id='1a8a0e2f-fb76-4cf3-aad1-de2736951676'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:31:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2876983d30794d8db191857d2f420f7d',uuid=2d9a5b2b-7196-4ec9-8afc-cac356fe1495,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "address": "fa:16:3e:22:73:22", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bc8d35-4c", "ovs_interfaceid": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:31:47 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Converting VIF {"id": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "address": "fa:16:3e:22:73:22", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bc8d35-4c", "ovs_interfaceid": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:31:47 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:73:22,bridge_name='br-int',has_traffic_filtering=True,id=64bc8d35-4c9d-40db-ac46-46d6a3476698,network=Network(5febf498-f447-4e3b-a484-320124bd0158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bc8d35-4c') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:31:47 user nova-compute[74805]: DEBUG os_vif [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:73:22,bridge_name='br-int',has_traffic_filtering=True,id=64bc8d35-4c9d-40db-ac46-46d6a3476698,network=Network(5febf498-f447-4e3b-a484-320124bd0158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bc8d35-4c') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:31:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64bc8d35-4c, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:31:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:31:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc0d5fdc-4128-4052-bda3-7c3409c5ccc4) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:31:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:47 user nova-compute[74805]: INFO os_vif [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:73:22,bridge_name='br-int',has_traffic_filtering=True,id=64bc8d35-4c9d-40db-ac46-46d6a3476698,network=Network(5febf498-f447-4e3b-a484-320124bd0158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bc8d35-4c')
Nov 15 04:31:47 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Deleting instance files /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495_del
Nov 15 04:31:47 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Deletion of /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495_del complete
Nov 15 04:31:47 user nova-compute[74805]: DEBUG nova.compute.manager [req-62d7792e-f9f2-450b-8810-8dfd122a3422 req-181cc7ca-830d-4707-8f66-7a8d6c89c081 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Received event network-changed-64bc8d35-4c9d-40db-ac46-46d6a3476698 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:31:47 user nova-compute[74805]: DEBUG nova.compute.manager [req-62d7792e-f9f2-450b-8810-8dfd122a3422 req-181cc7ca-830d-4707-8f66-7a8d6c89c081 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Refreshing instance network info cache due to event network-changed-64bc8d35-4c9d-40db-ac46-46d6a3476698. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:31:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-62d7792e-f9f2-450b-8810-8dfd122a3422 req-181cc7ca-830d-4707-8f66-7a8d6c89c081 service nova] Acquiring lock "refresh_cache-2d9a5b2b-7196-4ec9-8afc-cac356fe1495" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:31:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-62d7792e-f9f2-450b-8810-8dfd122a3422 req-181cc7ca-830d-4707-8f66-7a8d6c89c081 service nova] Acquired lock "refresh_cache-2d9a5b2b-7196-4ec9-8afc-cac356fe1495" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:31:47 user nova-compute[74805]: DEBUG nova.network.neutron [req-62d7792e-f9f2-450b-8810-8dfd122a3422 req-181cc7ca-830d-4707-8f66-7a8d6c89c081 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Refreshing network info cache for port 64bc8d35-4c9d-40db-ac46-46d6a3476698 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:31:48 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Deleted allocations for instance 2d9a5b2b-7196-4ec9-8afc-cac356fe1495
Nov 15 04:31:48 user nova-compute[74805]: DEBUG nova.network.neutron [req-62d7792e-f9f2-450b-8810-8dfd122a3422 req-181cc7ca-830d-4707-8f66-7a8d6c89c081 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Updated VIF entry in instance network info cache for port 64bc8d35-4c9d-40db-ac46-46d6a3476698. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:31:48 user nova-compute[74805]: DEBUG nova.network.neutron [req-62d7792e-f9f2-450b-8810-8dfd122a3422 req-181cc7ca-830d-4707-8f66-7a8d6c89c081 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Updating instance_info_cache with network_info: [{"id": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "address": "fa:16:3e:22:73:22", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap64bc8d35-4c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:31:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:31:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:31:48 user nova-compute[74805]: DEBUG nova.objects.instance [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lazy-loading 'numa_topology' on Instance uuid 2d9a5b2b-7196-4ec9-8afc-cac356fe1495 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:31:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-62d7792e-f9f2-450b-8810-8dfd122a3422 req-181cc7ca-830d-4707-8f66-7a8d6c89c081 service nova] Releasing lock "refresh_cache-2d9a5b2b-7196-4ec9-8afc-cac356fe1495" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:31:48 user nova-compute[74805]: DEBUG nova.objects.base [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Object Instance<2d9a5b2b-7196-4ec9-8afc-cac356fe1495> lazy-loaded attributes: resources,numa_topology {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:31:48 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:31:48 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:31:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:31:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1187e300-0021-483e-9b62-2aec0f15e75e tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.804s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:31:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:31:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:32:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:32:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:32:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:32:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:32:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:11 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:32:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "fda0e490-03e3-4cf5-b22d-aab83d715616" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:32:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "fda0e490-03e3-4cf5-b22d-aab83d715616" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:32:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:32:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:32:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:32:13 user nova-compute[74805]: INFO nova.compute.manager [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Terminating instance
Nov 15 04:32:13 user nova-compute[74805]: DEBUG nova.compute.manager [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:32:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG nova.compute.manager [req-1c7ec69d-b5d8-41f1-9f6a-b3fa00931530 req-7444de1f-612d-428f-979a-6f6618629bb8 service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Received event network-vif-unplugged-26c6a394-5344-46d4-abf8-e49600450a07 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1c7ec69d-b5d8-41f1-9f6a-b3fa00931530 req-7444de1f-612d-428f-979a-6f6618629bb8 service nova] Acquiring lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1c7ec69d-b5d8-41f1-9f6a-b3fa00931530 req-7444de1f-612d-428f-979a-6f6618629bb8 service nova] Lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1c7ec69d-b5d8-41f1-9f6a-b3fa00931530 req-7444de1f-612d-428f-979a-6f6618629bb8 service nova] Lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG nova.compute.manager [req-1c7ec69d-b5d8-41f1-9f6a-b3fa00931530 req-7444de1f-612d-428f-979a-6f6618629bb8 service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] No waiting events found dispatching network-vif-unplugged-26c6a394-5344-46d4-abf8-e49600450a07 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG nova.compute.manager [req-1c7ec69d-b5d8-41f1-9f6a-b3fa00931530 req-7444de1f-612d-428f-979a-6f6618629bb8 service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Received event network-vif-unplugged-26c6a394-5344-46d4-abf8-e49600450a07 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:14 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Instance destroyed successfully.
Nov 15 04:32:14 user nova-compute[74805]: DEBUG nova.objects.instance [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lazy-loading 'resources' on Instance uuid fda0e490-03e3-4cf5-b22d-aab83d715616 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:25:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-741514273',display_name='tempest-ServerActionsTestOtherA-server-741514273',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-741514273',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGV8yvKXomaZF0BD7dR1o4bDaZdfuwtMvfH2u8DYsuFF6EZbmfxZGzCOIo9eDRbRFMNzHBU8sLiuRkxRud23xuRO+aBfUN0XRumVbmJ/zSOioI/76XwN4XIsuXVKkxna2w==',key_name='tempest-keypair-1041116715',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:27:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6dcdb40f067540dab36661ea0586f1d5',ramdisk_id='',reservation_id='r-7f40nzuc',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1623992712',owner_user_name='tempest-ServerActionsTestOtherA-1623992712-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:29:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b6a8eff61f4d6ba2e83d7939143112',uuid=fda0e490-03e3-4cf5-b22d-aab83d715616,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26c6a394-5344-46d4-abf8-e49600450a07", "address": "fa:16:3e:e3:5f:9a", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c6a394-53", "ovs_interfaceid": "26c6a394-5344-46d4-abf8-e49600450a07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converting VIF {"id": "26c6a394-5344-46d4-abf8-e49600450a07", "address": "fa:16:3e:e3:5f:9a", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c6a394-53", "ovs_interfaceid": "26c6a394-5344-46d4-abf8-e49600450a07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:5f:9a,bridge_name='br-int',has_traffic_filtering=True,id=26c6a394-5344-46d4-abf8-e49600450a07,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c6a394-53') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG os_vif [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:5f:9a,bridge_name='br-int',has_traffic_filtering=True,id=26c6a394-5344-46d4-abf8-e49600450a07,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c6a394-53') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26c6a394-53, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=20fdf42e-4043-48a5-8cc1-2fac026cdbcb) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:32:14 user nova-compute[74805]: INFO os_vif [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:5f:9a,bridge_name='br-int',has_traffic_filtering=True,id=26c6a394-5344-46d4-abf8-e49600450a07,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c6a394-53')
Nov 15 04:32:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rBTNyREf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:32:14 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:32:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d6e3d1-8f3a-4b4a-a8f5-191d9e4feffd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:32:14 user nova-compute[74805]: No targets found.
Nov 15 04:32:14 user nova-compute[74805]: iSNS:
Nov 15 04:32:14 user nova-compute[74805]: No targets found.
Nov 15 04:32:14 user nova-compute[74805]: STATIC:
Nov 15 04:32:14 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f
Nov 15 04:32:14 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:32:14 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:32:14 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83
Nov 15 04:32:14 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:32:14 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:32:14 user nova-compute[74805]: FIRMWARE:
Nov 15 04:32:14 user nova-compute[74805]: No targets found.
Nov 15 04:32:14 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:32:14 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:32:14 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdabd998-8151-4676-98ee-e3227914d811]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de99d22-559c-438f-bc43-883c7734d3b9]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:32:14 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:32:14 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:32:14 user nova-compute[74805]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 (non-flash)
Nov 15 04:32:14 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c4dfd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83'): ({'sdb'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Removing single pathed devices sdb {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b573c0b-d93e-46c3-9305-afedf961ec70]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[421572c7-bd2e-4008-b3eb-49fb36227655]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Flushing IO for device /dev/sdb {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[943596f2-b280-43f7-a730-0fac986f882f]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[741b9757-8a0e-4c19-bb70-b7a154dc6d68]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26338356166633835', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1da365f2', '/dev/disk/by-id/scsi-1SCST_BIO1da365f2-c85afc8533d48b17') {{(pid=85029) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 04:32:14 user nova-compute[74805]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26338356166633835
Nov 15 04:32:14 user nova-compute[74805]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_1da365f2
Nov 15 04:32:14 user nova-compute[74805]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO1da365f2-c85afc8533d48b17
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2207dd0-5610-4407-95fe-dc51cad77833]: (4, None) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b66b79-b3cf-45d2-897a-92854df9ef95]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[149c0b7c-92a5-46ac-a407-ae66ddfef47f]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83, portal: 172.16.0.220,3260]
Nov 15 04:32:14 user nova-compute[74805]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83, portal: 172.16.0.220,3260] successful.
Nov 15 04:32:14 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf88a15-d65a-43d6-aea2-07c232ecfd83 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6667df-942b-40cd-81ac-5fc01b580e6a]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] <== disconnect_volume: return (326ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:32:14 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Deleting instance files /opt/stack/data/nova/instances/fda0e490-03e3-4cf5-b22d-aab83d715616_del
Nov 15 04:32:14 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Deletion of /opt/stack/data/nova/instances/fda0e490-03e3-4cf5-b22d-aab83d715616_del complete
Nov 15 04:32:14 user nova-compute[74805]: INFO nova.compute.manager [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 15 04:32:14 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:32:14 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:32:15 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:32:15 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Took 0.76 seconds to deallocate network for instance.
Nov 15 04:32:16 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:32:16 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:32:16 user nova-compute[74805]: DEBUG nova.compute.manager [req-8636d685-1f07-47d3-910d-92c22e0a8fe7 req-a5e55707-75e6-454b-907c-5649718f93d6 service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Received event network-vif-plugged-26c6a394-5344-46d4-abf8-e49600450a07 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:32:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8636d685-1f07-47d3-910d-92c22e0a8fe7 req-a5e55707-75e6-454b-907c-5649718f93d6 service nova] Acquiring lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:32:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8636d685-1f07-47d3-910d-92c22e0a8fe7 req-a5e55707-75e6-454b-907c-5649718f93d6 service nova] Lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:32:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8636d685-1f07-47d3-910d-92c22e0a8fe7 req-a5e55707-75e6-454b-907c-5649718f93d6 service nova] Lock "fda0e490-03e3-4cf5-b22d-aab83d715616-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:32:16 user nova-compute[74805]: DEBUG nova.compute.manager [req-8636d685-1f07-47d3-910d-92c22e0a8fe7 req-a5e55707-75e6-454b-907c-5649718f93d6 service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] No waiting events found dispatching network-vif-plugged-26c6a394-5344-46d4-abf8-e49600450a07 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:32:16 user nova-compute[74805]: WARNING nova.compute.manager [req-8636d685-1f07-47d3-910d-92c22e0a8fe7 req-a5e55707-75e6-454b-907c-5649718f93d6 service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Received unexpected event network-vif-plugged-26c6a394-5344-46d4-abf8-e49600450a07 for instance with vm_state active and task_state deleting.
Nov 15 04:32:16 user nova-compute[74805]: DEBUG nova.compute.manager [req-8636d685-1f07-47d3-910d-92c22e0a8fe7 req-a5e55707-75e6-454b-907c-5649718f93d6 service nova] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Received event network-vif-deleted-26c6a394-5344-46d4-abf8-e49600450a07 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:32:16 user nova-compute[74805]: INFO nova.compute.manager [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Took 0.75 seconds to detach 1 volumes for instance.
Nov 15 04:32:16 user nova-compute[74805]: DEBUG nova.compute.manager [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: fda0e490-03e3-4cf5-b22d-aab83d715616] Deleting volume: bdf88a15-d65a-43d6-aea2-07c232ecfd83 {{(pid=74805) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 04:32:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:32:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:32:16 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:32:16 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:32:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:32:16 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Deleted allocations for instance fda0e490-03e3-4cf5-b22d-aab83d715616
Nov 15 04:32:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-37b119bd-20ff-4393-bd98-b39839830415 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "fda0e490-03e3-4cf5-b22d-aab83d715616" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.128s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:32:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:17 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:32:17 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:32:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:32:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:32:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:32:17 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:32:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:32:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:32:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:32:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:32:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:32:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:32:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:32:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:32:18 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:32:18 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:32:18 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:32:18 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=8628MB free_disk=25.099136352539062GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:32:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:32:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:32:18 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance d63f3726-27df-455f-bda0-3ddca95b70d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:32:18 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 9f267864-0b72-431d-9b0d-c63436002a4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:32:18 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 38196606-a9c9-4604-ad21-2ec7511a8b28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:32:18 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:32:18 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:32:18 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:32:18 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:32:18 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:32:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:32:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:19 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:32:19 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:32:19 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:32:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-38196606-a9c9-4604-ad21-2ec7511a8b28" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:32:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-38196606-a9c9-4604-ad21-2ec7511a8b28" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:32:19 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:32:20 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Updating instance_info_cache with network_info: [{"id": "23517101-97ec-4772-ab6b-6f626a6547bc", "address": "fa:16:3e:da:ef:08", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23517101-97", "ovs_interfaceid": "23517101-97ec-4772-ab6b-6f626a6547bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:32:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-38196606-a9c9-4604-ad21-2ec7511a8b28" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:32:20 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:32:20 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:32:20 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:32:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:24 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:32:24 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:32:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "a2875e85-f7ff-445d-ac92-133ef145ec93" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:32:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "a2875e85-f7ff-445d-ac92-133ef145ec93" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:32:25 user nova-compute[74805]: DEBUG nova.compute.manager [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:32:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:32:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:32:25 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:32:25 user nova-compute[74805]: INFO nova.compute.claims [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Claim successful on node user
Nov 15 04:32:26 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:32:26 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:32:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:32:26 user nova-compute[74805]: DEBUG nova.compute.manager [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:32:26 user nova-compute[74805]: DEBUG nova.compute.manager [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:32:26 user nova-compute[74805]: DEBUG nova.network.neutron [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:32:26 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:32:26 user nova-compute[74805]: DEBUG nova.compute.manager [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:32:26 user nova-compute[74805]: DEBUG nova.policy [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ef3764d29074d9ebb8f7c0b62b4cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b66fd3bcaa4720a38b00388797825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:32:26 user nova-compute[74805]: DEBUG nova.compute.manager [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:32:26 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:32:26 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Creating image(s)
Nov 15 04:32:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2875e85-f7ff-445d-ac92-133ef145ec93/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:32:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "/opt/stack/data/nova/instances/a2875e85-f7ff-445d-ac92-133ef145ec93/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:32:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "/opt/stack/data/nova/instances/a2875e85-f7ff-445d-ac92-133ef145ec93/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:32:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:32:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.208s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:32:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:32:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:32:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:32:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.232s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:32:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/a2875e85-f7ff-445d-ac92-133ef145ec93/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:32:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/a2875e85-f7ff-445d-ac92-133ef145ec93/disk 1073741824" returned: 0 in 0.083s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:32:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.323s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:32:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:32:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.203s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:32:27 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2875e85-f7ff-445d-ac92-133ef145ec93/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:32:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2875e85-f7ff-445d-ac92-133ef145ec93/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:32:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "288a5e5c-f8e9-4507-b29c-93e7595922ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:32:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "288a5e5c-f8e9-4507-b29c-93e7595922ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:32:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:32:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2875e85-f7ff-445d-ac92-133ef145ec93/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:32:27 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Cannot resize image /opt/stack/data/nova/instances/a2875e85-f7ff-445d-ac92-133ef145ec93/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:32:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:32:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Ensure instance console log exists: /opt/stack/data/nova/instances/a2875e85-f7ff-445d-ac92-133ef145ec93/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:32:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:32:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:32:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:32:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:32:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:32:27 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:32:27 user nova-compute[74805]: INFO nova.compute.claims [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Claim successful on node user
Nov 15 04:32:27 user nova-compute[74805]: DEBUG nova.network.neutron [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Successfully created port: 1ed6482a-faf3-4cd0-b4ea-eb4140350a0a {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:32:27 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:32:27 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:32:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:32:28 user nova-compute[74805]: DEBUG nova.compute.manager [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:32:28 user nova-compute[74805]: DEBUG nova.compute.manager [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:32:28 user nova-compute[74805]: DEBUG nova.network.neutron [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:32:28 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:32:28 user nova-compute[74805]: DEBUG nova.compute.manager [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:32:28 user nova-compute[74805]: DEBUG nova.policy [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8cba9273daa1478fa6cc8274443b4f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11645073d58476491d101b9f3ee4052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:32:28 user nova-compute[74805]: DEBUG nova.compute.manager [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:32:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:32:28 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Creating image(s)
Nov 15 04:32:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "/opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:32:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "/opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:32:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "/opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:32:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:32:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.173s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:32:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:32:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:32:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:32:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.188s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:32:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:32:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk 1073741824" returned: 0 in 0.055s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:32:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:32:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:32:28 user nova-compute[74805]: DEBUG nova.network.neutron [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Successfully created port: e0bce47a-8a77-465f-806c-8d4e9b38ca63 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:32:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.191s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:32:28 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Checking if we can resize image /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:32:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:32:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Cannot resize image /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Ensure instance console log exists: /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.network.neutron [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Successfully updated port: 1ed6482a-faf3-4cd0-b4ea-eb4140350a0a {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "refresh_cache-a2875e85-f7ff-445d-ac92-133ef145ec93" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquired lock "refresh_cache-a2875e85-f7ff-445d-ac92-133ef145ec93" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.network.neutron [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.compute.manager [req-dc56349d-a8f5-4adb-857f-e5e85797ce8f req-0cc061ef-2941-4c31-8dfb-0c8783103ed8 service nova] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Received event network-changed-1ed6482a-faf3-4cd0-b4ea-eb4140350a0a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.compute.manager [req-dc56349d-a8f5-4adb-857f-e5e85797ce8f req-0cc061ef-2941-4c31-8dfb-0c8783103ed8 service nova] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Refreshing instance network info cache due to event network-changed-1ed6482a-faf3-4cd0-b4ea-eb4140350a0a. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-dc56349d-a8f5-4adb-857f-e5e85797ce8f req-0cc061ef-2941-4c31-8dfb-0c8783103ed8 service nova] Acquiring lock "refresh_cache-a2875e85-f7ff-445d-ac92-133ef145ec93" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.network.neutron [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.network.neutron [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Updating instance_info_cache with network_info: [{"id": "1ed6482a-faf3-4cd0-b4ea-eb4140350a0a", "address": "fa:16:3e:3d:7f:62", "network": {"id": "56e28167-fe83-43e1-9efc-81f625e2b727", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760042206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3b66fd3bcaa4720a38b00388797825a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ed6482a-fa", "ovs_interfaceid": "1ed6482a-faf3-4cd0-b4ea-eb4140350a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Releasing lock "refresh_cache-a2875e85-f7ff-445d-ac92-133ef145ec93" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.compute.manager [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Instance network_info: |[{"id": "1ed6482a-faf3-4cd0-b4ea-eb4140350a0a", "address": "fa:16:3e:3d:7f:62", "network": {"id": "56e28167-fe83-43e1-9efc-81f625e2b727", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760042206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3b66fd3bcaa4720a38b00388797825a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ed6482a-fa", "ovs_interfaceid": "1ed6482a-faf3-4cd0-b4ea-eb4140350a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-dc56349d-a8f5-4adb-857f-e5e85797ce8f req-0cc061ef-2941-4c31-8dfb-0c8783103ed8 service nova] Acquired lock "refresh_cache-a2875e85-f7ff-445d-ac92-133ef145ec93" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.network.neutron [req-dc56349d-a8f5-4adb-857f-e5e85797ce8f req-0cc061ef-2941-4c31-8dfb-0c8783103ed8 service nova] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Refreshing network info cache for port 1ed6482a-faf3-4cd0-b4ea-eb4140350a0a {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Start _get_guest_xml network_info=[{"id": "1ed6482a-faf3-4cd0-b4ea-eb4140350a0a", "address": "fa:16:3e:3d:7f:62", "network": {"id": "56e28167-fe83-43e1-9efc-81f625e2b727", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760042206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3b66fd3bcaa4720a38b00388797825a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ed6482a-fa", "ovs_interfaceid": "1ed6482a-faf3-4cd0-b4ea-eb4140350a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:32:29 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:32:29 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-201929926',display_name='tempest-VolumesSnapshotTestJSON-instance-201929926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-201929926',id=38,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/QnP41DmPnb3IERZmleKJU0QyP9KwVBrYIGUI6DpOsj6OkoaFi2xPZLIxvbxKSUO2y1nOVyodm5gI9x6UPTgPlSUjsgU+9woK74EgJ9TiFQ0RrkmOSKIiowjxlxSpggQ==',key_name='tempest-keypair-1065420475',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3b66fd3bcaa4720a38b00388797825a',ramdisk_id='',reservation_id='r-hc49xyu2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1020343559',owner_user_name='tempest-VolumesSnapshotTestJSON-1020343559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:32:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ef3764d29074d9ebb8f7c0b62b4cf4f',uuid=a2875e85-f7ff-445d-ac92-133ef145ec93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ed6482a-faf3-4cd0-b4ea-eb4140350a0a", "address": "fa:16:3e:3d:7f:62", "network": {"id": "56e28167-fe83-43e1-9efc-81f625e2b727", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760042206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3b66fd3bcaa4720a38b00388797825a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ed6482a-fa", "ovs_interfaceid": "1ed6482a-faf3-4cd0-b4ea-eb4140350a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Converting VIF {"id": "1ed6482a-faf3-4cd0-b4ea-eb4140350a0a", "address": "fa:16:3e:3d:7f:62", "network": {"id": "56e28167-fe83-43e1-9efc-81f625e2b727", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760042206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3b66fd3bcaa4720a38b00388797825a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ed6482a-fa", "ovs_interfaceid": "1ed6482a-faf3-4cd0-b4ea-eb4140350a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:7f:62,bridge_name='br-int',has_traffic_filtering=True,id=1ed6482a-faf3-4cd0-b4ea-eb4140350a0a,network=Network(56e28167-fe83-43e1-9efc-81f625e2b727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ed6482a-fa') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.objects.instance [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lazy-loading 'pci_devices' on Instance uuid a2875e85-f7ff-445d-ac92-133ef145ec93 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:32:29 user nova-compute[74805]:   <uuid>a2875e85-f7ff-445d-ac92-133ef145ec93</uuid>
Nov 15 04:32:29 user nova-compute[74805]:   <name>instance-00000026</name>
Nov 15 04:32:29 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:32:29 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:32:29 user nova-compute[74805]:   <metadata>
Nov 15 04:32:29 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:32:29 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:32:29 user nova-compute[74805]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-201929926</nova:name>
Nov 15 04:32:29 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:32:29</nova:creationTime>
Nov 15 04:32:29 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:32:29 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:32:29 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:32:29 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:32:29 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:32:29 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:32:29 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:32:29 user nova-compute[74805]:       <nova:owner>
Nov 15 04:32:29 user nova-compute[74805]:         <nova:user uuid="9ef3764d29074d9ebb8f7c0b62b4cf4f">tempest-VolumesSnapshotTestJSON-1020343559-project-member</nova:user>
Nov 15 04:32:29 user nova-compute[74805]:         <nova:project uuid="e3b66fd3bcaa4720a38b00388797825a">tempest-VolumesSnapshotTestJSON-1020343559</nova:project>
Nov 15 04:32:29 user nova-compute[74805]:       </nova:owner>
Nov 15 04:32:29 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:32:29 user nova-compute[74805]:       <nova:ports>
Nov 15 04:32:29 user nova-compute[74805]:         <nova:port uuid="1ed6482a-faf3-4cd0-b4ea-eb4140350a0a">
Nov 15 04:32:29 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 04:32:29 user nova-compute[74805]:         </nova:port>
Nov 15 04:32:29 user nova-compute[74805]:       </nova:ports>
Nov 15 04:32:29 user nova-compute[74805]:     </nova:instance>
Nov 15 04:32:29 user nova-compute[74805]:   </metadata>
Nov 15 04:32:29 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:32:29 user nova-compute[74805]:     <system>
Nov 15 04:32:29 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:32:29 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:32:29 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:32:29 user nova-compute[74805]:       <entry name="serial">a2875e85-f7ff-445d-ac92-133ef145ec93</entry>
Nov 15 04:32:29 user nova-compute[74805]:       <entry name="uuid">a2875e85-f7ff-445d-ac92-133ef145ec93</entry>
Nov 15 04:32:29 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:32:29 user nova-compute[74805]:     </system>
Nov 15 04:32:29 user nova-compute[74805]:   </sysinfo>
Nov 15 04:32:29 user nova-compute[74805]:   <os>
Nov 15 04:32:29 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:32:29 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:32:29 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:32:29 user nova-compute[74805]:   </os>
Nov 15 04:32:29 user nova-compute[74805]:   <features>
Nov 15 04:32:29 user nova-compute[74805]:     <acpi/>
Nov 15 04:32:29 user nova-compute[74805]:     <apic/>
Nov 15 04:32:29 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:32:29 user nova-compute[74805]:   </features>
Nov 15 04:32:29 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:32:29 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:32:29 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:32:29 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:32:29 user nova-compute[74805]:   </clock>
Nov 15 04:32:29 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:32:29 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:32:29 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:32:29 user nova-compute[74805]:   </cpu>
Nov 15 04:32:29 user nova-compute[74805]:   <devices>
Nov 15 04:32:29 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:32:29 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:32:29 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/a2875e85-f7ff-445d-ac92-133ef145ec93/disk"/>
Nov 15 04:32:29 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:32:29 user nova-compute[74805]:     </disk>
Nov 15 04:32:29 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:32:29 user nova-compute[74805]:       <mac address="fa:16:3e:3d:7f:62"/>
Nov 15 04:32:29 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:32:29 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:32:29 user nova-compute[74805]:       <target dev="tap1ed6482a-fa"/>
Nov 15 04:32:29 user nova-compute[74805]:     </interface>
Nov 15 04:32:29 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:32:29 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/a2875e85-f7ff-445d-ac92-133ef145ec93/console.log" append="off"/>
Nov 15 04:32:29 user nova-compute[74805]:     </serial>
Nov 15 04:32:29 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:32:29 user nova-compute[74805]:     <video>
Nov 15 04:32:29 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:32:29 user nova-compute[74805]:     </video>
Nov 15 04:32:29 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:32:29 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:32:29 user nova-compute[74805]:     </rng>
Nov 15 04:32:29 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:32:29 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:32:29 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:32:29 user nova-compute[74805]:     </memballoon>
Nov 15 04:32:29 user nova-compute[74805]:   </devices>
Nov 15 04:32:29 user nova-compute[74805]: </domain>
Nov 15 04:32:29 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-201929926',display_name='tempest-VolumesSnapshotTestJSON-instance-201929926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-201929926',id=38,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/QnP41DmPnb3IERZmleKJU0QyP9KwVBrYIGUI6DpOsj6OkoaFi2xPZLIxvbxKSUO2y1nOVyodm5gI9x6UPTgPlSUjsgU+9woK74EgJ9TiFQ0RrkmOSKIiowjxlxSpggQ==',key_name='tempest-keypair-1065420475',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3b66fd3bcaa4720a38b00388797825a',ramdisk_id='',reservation_id='r-hc49xyu2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1020343559',owner_user_name='tempest-VolumesSnapshotTestJSON-1020343559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:32:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ef3764d29074d9ebb8f7c0b62b4cf4f',uuid=a2875e85-f7ff-445d-ac92-133ef145ec93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ed6482a-faf3-4cd0-b4ea-eb4140350a0a", "address": "fa:16:3e:3d:7f:62", "network": {"id": "56e28167-fe83-43e1-9efc-81f625e2b727", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760042206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3b66fd3bcaa4720a38b00388797825a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ed6482a-fa", "ovs_interfaceid": "1ed6482a-faf3-4cd0-b4ea-eb4140350a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Converting VIF {"id": "1ed6482a-faf3-4cd0-b4ea-eb4140350a0a", "address": "fa:16:3e:3d:7f:62", "network": {"id": "56e28167-fe83-43e1-9efc-81f625e2b727", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760042206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3b66fd3bcaa4720a38b00388797825a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ed6482a-fa", "ovs_interfaceid": "1ed6482a-faf3-4cd0-b4ea-eb4140350a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:7f:62,bridge_name='br-int',has_traffic_filtering=True,id=1ed6482a-faf3-4cd0-b4ea-eb4140350a0a,network=Network(56e28167-fe83-43e1-9efc-81f625e2b727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ed6482a-fa') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG os_vif [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:7f:62,bridge_name='br-int',has_traffic_filtering=True,id=1ed6482a-faf3-4cd0-b4ea-eb4140350a0a,network=Network(56e28167-fe83-43e1-9efc-81f625e2b727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ed6482a-fa') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7da8734a-85ae-51d1-85a3-a12932df6415', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ed6482a-fa, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1ed6482a-fa, col_values=(('qos', UUID('3361ac17-04a4-4475-967b-1a446c57b1d4')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1ed6482a-fa, col_values=(('external_ids', {'iface-id': '1ed6482a-faf3-4cd0-b4ea-eb4140350a0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:7f:62', 'vm-uuid': 'a2875e85-f7ff-445d-ac92-133ef145ec93'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:29 user nova-compute[74805]: INFO os_vif [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:7f:62,bridge_name='br-int',has_traffic_filtering=True,id=1ed6482a-faf3-4cd0-b4ea-eb4140350a0a,network=Network(56e28167-fe83-43e1-9efc-81f625e2b727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ed6482a-fa')
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] No VIF found with MAC fa:16:3e:3d:7f:62, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.network.neutron [req-dc56349d-a8f5-4adb-857f-e5e85797ce8f req-0cc061ef-2941-4c31-8dfb-0c8783103ed8 service nova] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Updated VIF entry in instance network info cache for port 1ed6482a-faf3-4cd0-b4ea-eb4140350a0a. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG nova.network.neutron [req-dc56349d-a8f5-4adb-857f-e5e85797ce8f req-0cc061ef-2941-4c31-8dfb-0c8783103ed8 service nova] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Updating instance_info_cache with network_info: [{"id": "1ed6482a-faf3-4cd0-b4ea-eb4140350a0a", "address": "fa:16:3e:3d:7f:62", "network": {"id": "56e28167-fe83-43e1-9efc-81f625e2b727", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760042206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3b66fd3bcaa4720a38b00388797825a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ed6482a-fa", "ovs_interfaceid": "1ed6482a-faf3-4cd0-b4ea-eb4140350a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:32:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-dc56349d-a8f5-4adb-857f-e5e85797ce8f req-0cc061ef-2941-4c31-8dfb-0c8783103ed8 service nova] Releasing lock "refresh_cache-a2875e85-f7ff-445d-ac92-133ef145ec93" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:32:30 user nova-compute[74805]: DEBUG nova.network.neutron [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Successfully updated port: e0bce47a-8a77-465f-806c-8d4e9b38ca63 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:32:30 user nova-compute[74805]: DEBUG nova.compute.manager [req-4943c519-78db-45e4-b30b-7d1e95b9b787 req-3f827425-5b16-4cb6-91d8-450ac2b6b3d1 service nova] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Received event network-changed-e0bce47a-8a77-465f-806c-8d4e9b38ca63 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:32:30 user nova-compute[74805]: DEBUG nova.compute.manager [req-4943c519-78db-45e4-b30b-7d1e95b9b787 req-3f827425-5b16-4cb6-91d8-450ac2b6b3d1 service nova] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Refreshing instance network info cache due to event network-changed-e0bce47a-8a77-465f-806c-8d4e9b38ca63. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:32:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-4943c519-78db-45e4-b30b-7d1e95b9b787 req-3f827425-5b16-4cb6-91d8-450ac2b6b3d1 service nova] Acquiring lock "refresh_cache-288a5e5c-f8e9-4507-b29c-93e7595922ac" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:32:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-4943c519-78db-45e4-b30b-7d1e95b9b787 req-3f827425-5b16-4cb6-91d8-450ac2b6b3d1 service nova] Acquired lock "refresh_cache-288a5e5c-f8e9-4507-b29c-93e7595922ac" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:32:30 user nova-compute[74805]: DEBUG nova.network.neutron [req-4943c519-78db-45e4-b30b-7d1e95b9b787 req-3f827425-5b16-4cb6-91d8-450ac2b6b3d1 service nova] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Refreshing network info cache for port e0bce47a-8a77-465f-806c-8d4e9b38ca63 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:32:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "refresh_cache-288a5e5c-f8e9-4507-b29c-93e7595922ac" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:32:30 user nova-compute[74805]: DEBUG nova.network.neutron [req-4943c519-78db-45e4-b30b-7d1e95b9b787 req-3f827425-5b16-4cb6-91d8-450ac2b6b3d1 service nova] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:32:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.network.neutron [req-4943c519-78db-45e4-b30b-7d1e95b9b787 req-3f827425-5b16-4cb6-91d8-450ac2b6b3d1 service nova] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-4943c519-78db-45e4-b30b-7d1e95b9b787 req-3f827425-5b16-4cb6-91d8-450ac2b6b3d1 service nova] Releasing lock "refresh_cache-288a5e5c-f8e9-4507-b29c-93e7595922ac" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquired lock "refresh_cache-288a5e5c-f8e9-4507-b29c-93e7595922ac" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.network.neutron [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.compute.manager [req-cddcaa1d-d492-49fc-8a87-057d67c9d776 req-7e755541-c648-4330-ae73-937b12835263 service nova] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Received event network-vif-plugged-1ed6482a-faf3-4cd0-b4ea-eb4140350a0a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-cddcaa1d-d492-49fc-8a87-057d67c9d776 req-7e755541-c648-4330-ae73-937b12835263 service nova] Acquiring lock "a2875e85-f7ff-445d-ac92-133ef145ec93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-cddcaa1d-d492-49fc-8a87-057d67c9d776 req-7e755541-c648-4330-ae73-937b12835263 service nova] Lock "a2875e85-f7ff-445d-ac92-133ef145ec93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-cddcaa1d-d492-49fc-8a87-057d67c9d776 req-7e755541-c648-4330-ae73-937b12835263 service nova] Lock "a2875e85-f7ff-445d-ac92-133ef145ec93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.compute.manager [req-cddcaa1d-d492-49fc-8a87-057d67c9d776 req-7e755541-c648-4330-ae73-937b12835263 service nova] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] No waiting events found dispatching network-vif-plugged-1ed6482a-faf3-4cd0-b4ea-eb4140350a0a {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:32:31 user nova-compute[74805]: WARNING nova.compute.manager [req-cddcaa1d-d492-49fc-8a87-057d67c9d776 req-7e755541-c648-4330-ae73-937b12835263 service nova] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Received unexpected event network-vif-plugged-1ed6482a-faf3-4cd0-b4ea-eb4140350a0a for instance with vm_state building and task_state spawning.
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.network.neutron [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.network.neutron [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Updating instance_info_cache with network_info: [{"id": "e0bce47a-8a77-465f-806c-8d4e9b38ca63", "address": "fa:16:3e:23:45:c9", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bce47a-8a", "ovs_interfaceid": "e0bce47a-8a77-465f-806c-8d4e9b38ca63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Releasing lock "refresh_cache-288a5e5c-f8e9-4507-b29c-93e7595922ac" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.compute.manager [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Instance network_info: |[{"id": "e0bce47a-8a77-465f-806c-8d4e9b38ca63", "address": "fa:16:3e:23:45:c9", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bce47a-8a", "ovs_interfaceid": "e0bce47a-8a77-465f-806c-8d4e9b38ca63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Start _get_guest_xml network_info=[{"id": "e0bce47a-8a77-465f-806c-8d4e9b38ca63", "address": "fa:16:3e:23:45:c9", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bce47a-8a", "ovs_interfaceid": "e0bce47a-8a77-465f-806c-8d4e9b38ca63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:32:31 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:32:31 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:32:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1748075818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1748075818',id=39,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d11645073d58476491d101b9f3ee4052',ramdisk_id='',reservation_id='r-rvscidhn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1297861260',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:32:28Z,user_data=None,user_id='8cba9273daa1478fa6cc8274443b4f40',uuid=288a5e5c-f8e9-4507-b29c-93e7595922ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0bce47a-8a77-465f-806c-8d4e9b38ca63", "address": "fa:16:3e:23:45:c9", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bce47a-8a", "ovs_interfaceid": "e0bce47a-8a77-465f-806c-8d4e9b38ca63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Converting VIF {"id": "e0bce47a-8a77-465f-806c-8d4e9b38ca63", "address": "fa:16:3e:23:45:c9", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bce47a-8a", "ovs_interfaceid": "e0bce47a-8a77-465f-806c-8d4e9b38ca63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:45:c9,bridge_name='br-int',has_traffic_filtering=True,id=e0bce47a-8a77-465f-806c-8d4e9b38ca63,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0bce47a-8a') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.objects.instance [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lazy-loading 'pci_devices' on Instance uuid 288a5e5c-f8e9-4507-b29c-93e7595922ac {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:32:31 user nova-compute[74805]:   <uuid>288a5e5c-f8e9-4507-b29c-93e7595922ac</uuid>
Nov 15 04:32:31 user nova-compute[74805]:   <name>instance-00000027</name>
Nov 15 04:32:31 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:32:31 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:32:31 user nova-compute[74805]:   <metadata>
Nov 15 04:32:31 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:32:31 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:32:31 user nova-compute[74805]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1748075818</nova:name>
Nov 15 04:32:31 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:32:31</nova:creationTime>
Nov 15 04:32:31 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:32:31 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:32:31 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:32:31 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:32:31 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:32:31 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:32:31 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:32:31 user nova-compute[74805]:       <nova:owner>
Nov 15 04:32:31 user nova-compute[74805]:         <nova:user uuid="8cba9273daa1478fa6cc8274443b4f40">tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member</nova:user>
Nov 15 04:32:31 user nova-compute[74805]:         <nova:project uuid="d11645073d58476491d101b9f3ee4052">tempest-ServerBootFromVolumeStableRescueTest-1297861260</nova:project>
Nov 15 04:32:31 user nova-compute[74805]:       </nova:owner>
Nov 15 04:32:31 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:32:31 user nova-compute[74805]:       <nova:ports>
Nov 15 04:32:31 user nova-compute[74805]:         <nova:port uuid="e0bce47a-8a77-465f-806c-8d4e9b38ca63">
Nov 15 04:32:31 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 04:32:31 user nova-compute[74805]:         </nova:port>
Nov 15 04:32:31 user nova-compute[74805]:       </nova:ports>
Nov 15 04:32:31 user nova-compute[74805]:     </nova:instance>
Nov 15 04:32:31 user nova-compute[74805]:   </metadata>
Nov 15 04:32:31 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:32:31 user nova-compute[74805]:     <system>
Nov 15 04:32:31 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:32:31 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:32:31 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:32:31 user nova-compute[74805]:       <entry name="serial">288a5e5c-f8e9-4507-b29c-93e7595922ac</entry>
Nov 15 04:32:31 user nova-compute[74805]:       <entry name="uuid">288a5e5c-f8e9-4507-b29c-93e7595922ac</entry>
Nov 15 04:32:31 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:32:31 user nova-compute[74805]:     </system>
Nov 15 04:32:31 user nova-compute[74805]:   </sysinfo>
Nov 15 04:32:31 user nova-compute[74805]:   <os>
Nov 15 04:32:31 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:32:31 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:32:31 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:32:31 user nova-compute[74805]:   </os>
Nov 15 04:32:31 user nova-compute[74805]:   <features>
Nov 15 04:32:31 user nova-compute[74805]:     <acpi/>
Nov 15 04:32:31 user nova-compute[74805]:     <apic/>
Nov 15 04:32:31 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:32:31 user nova-compute[74805]:   </features>
Nov 15 04:32:31 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:32:31 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:32:31 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:32:31 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:32:31 user nova-compute[74805]:   </clock>
Nov 15 04:32:31 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:32:31 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:32:31 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:32:31 user nova-compute[74805]:   </cpu>
Nov 15 04:32:31 user nova-compute[74805]:   <devices>
Nov 15 04:32:31 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:32:31 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:32:31 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk"/>
Nov 15 04:32:31 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:32:31 user nova-compute[74805]:     </disk>
Nov 15 04:32:31 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:32:31 user nova-compute[74805]:       <mac address="fa:16:3e:23:45:c9"/>
Nov 15 04:32:31 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:32:31 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:32:31 user nova-compute[74805]:       <target dev="tape0bce47a-8a"/>
Nov 15 04:32:31 user nova-compute[74805]:     </interface>
Nov 15 04:32:31 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:32:31 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/console.log" append="off"/>
Nov 15 04:32:31 user nova-compute[74805]:     </serial>
Nov 15 04:32:31 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:32:31 user nova-compute[74805]:     <video>
Nov 15 04:32:31 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:32:31 user nova-compute[74805]:     </video>
Nov 15 04:32:31 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:32:31 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:32:31 user nova-compute[74805]:     </rng>
Nov 15 04:32:31 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:32:31 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:32:31 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:32:31 user nova-compute[74805]:     </memballoon>
Nov 15 04:32:31 user nova-compute[74805]:   </devices>
Nov 15 04:32:31 user nova-compute[74805]: </domain>
Nov 15 04:32:31 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:32:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1748075818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1748075818',id=39,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d11645073d58476491d101b9f3ee4052',ramdisk_id='',reservation_id='r-rvscidhn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1297861260',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:32:28Z,user_data=None,user_id='8cba9273daa1478fa6cc8274443b4f40',uuid=288a5e5c-f8e9-4507-b29c-93e7595922ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0bce47a-8a77-465f-806c-8d4e9b38ca63", "address": "fa:16:3e:23:45:c9", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bce47a-8a", "ovs_interfaceid": "e0bce47a-8a77-465f-806c-8d4e9b38ca63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Converting VIF {"id": "e0bce47a-8a77-465f-806c-8d4e9b38ca63", "address": "fa:16:3e:23:45:c9", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bce47a-8a", "ovs_interfaceid": "e0bce47a-8a77-465f-806c-8d4e9b38ca63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:45:c9,bridge_name='br-int',has_traffic_filtering=True,id=e0bce47a-8a77-465f-806c-8d4e9b38ca63,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0bce47a-8a') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG os_vif [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:45:c9,bridge_name='br-int',has_traffic_filtering=True,id=e0bce47a-8a77-465f-806c-8d4e9b38ca63,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0bce47a-8a') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e5b80df-7c9a-57be-8fe7-30075d4c255b', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0bce47a-8a, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape0bce47a-8a, col_values=(('qos', UUID('e58d72ea-cf4a-45f0-be1a-a23b8fe7a403')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape0bce47a-8a, col_values=(('external_ids', {'iface-id': 'e0bce47a-8a77-465f-806c-8d4e9b38ca63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:45:c9', 'vm-uuid': '288a5e5c-f8e9-4507-b29c-93e7595922ac'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:31 user nova-compute[74805]: INFO os_vif [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:45:c9,bridge_name='br-int',has_traffic_filtering=True,id=e0bce47a-8a77-465f-806c-8d4e9b38ca63,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0bce47a-8a')
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:32:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] No VIF found with MAC fa:16:3e:23:45:c9, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:32:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:33 user nova-compute[74805]: DEBUG nova.compute.manager [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:32:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:32:33 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Instance spawned successfully.
Nov 15 04:32:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:32:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:32:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:32:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:32:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:32:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:32:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:32:33 user nova-compute[74805]: DEBUG nova.compute.manager [req-1e03d2a9-e949-4eba-b3a7-cf6d4586e404 req-78e7f247-c37c-4e03-8d91-3e0a1d3ee526 service nova] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Received event network-vif-plugged-1ed6482a-faf3-4cd0-b4ea-eb4140350a0a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:32:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1e03d2a9-e949-4eba-b3a7-cf6d4586e404 req-78e7f247-c37c-4e03-8d91-3e0a1d3ee526 service nova] Acquiring lock "a2875e85-f7ff-445d-ac92-133ef145ec93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:32:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1e03d2a9-e949-4eba-b3a7-cf6d4586e404 req-78e7f247-c37c-4e03-8d91-3e0a1d3ee526 service nova] Lock "a2875e85-f7ff-445d-ac92-133ef145ec93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:32:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1e03d2a9-e949-4eba-b3a7-cf6d4586e404 req-78e7f247-c37c-4e03-8d91-3e0a1d3ee526 service nova] Lock "a2875e85-f7ff-445d-ac92-133ef145ec93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:32:33 user nova-compute[74805]: DEBUG nova.compute.manager [req-1e03d2a9-e949-4eba-b3a7-cf6d4586e404 req-78e7f247-c37c-4e03-8d91-3e0a1d3ee526 service nova] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] No waiting events found dispatching network-vif-plugged-1ed6482a-faf3-4cd0-b4ea-eb4140350a0a {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:32:33 user nova-compute[74805]: WARNING nova.compute.manager [req-1e03d2a9-e949-4eba-b3a7-cf6d4586e404 req-78e7f247-c37c-4e03-8d91-3e0a1d3ee526 service nova] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Received unexpected event network-vif-plugged-1ed6482a-faf3-4cd0-b4ea-eb4140350a0a for instance with vm_state building and task_state spawning.
Nov 15 04:32:33 user nova-compute[74805]: INFO nova.compute.manager [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Took 6.71 seconds to spawn the instance on the hypervisor.
Nov 15 04:32:33 user nova-compute[74805]: DEBUG nova.compute.manager [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:32:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:33 user nova-compute[74805]: DEBUG nova.compute.manager [req-1adffee0-f1dd-4b1b-a655-5bf038f45b18 req-d0631138-3264-483f-b4c4-810960579427 service nova] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Received event network-vif-plugged-e0bce47a-8a77-465f-806c-8d4e9b38ca63 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:32:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1adffee0-f1dd-4b1b-a655-5bf038f45b18 req-d0631138-3264-483f-b4c4-810960579427 service nova] Acquiring lock "288a5e5c-f8e9-4507-b29c-93e7595922ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:32:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1adffee0-f1dd-4b1b-a655-5bf038f45b18 req-d0631138-3264-483f-b4c4-810960579427 service nova] Lock "288a5e5c-f8e9-4507-b29c-93e7595922ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:32:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1adffee0-f1dd-4b1b-a655-5bf038f45b18 req-d0631138-3264-483f-b4c4-810960579427 service nova] Lock "288a5e5c-f8e9-4507-b29c-93e7595922ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:32:33 user nova-compute[74805]: DEBUG nova.compute.manager [req-1adffee0-f1dd-4b1b-a655-5bf038f45b18 req-d0631138-3264-483f-b4c4-810960579427 service nova] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] No waiting events found dispatching network-vif-plugged-e0bce47a-8a77-465f-806c-8d4e9b38ca63 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:32:33 user nova-compute[74805]: WARNING nova.compute.manager [req-1adffee0-f1dd-4b1b-a655-5bf038f45b18 req-d0631138-3264-483f-b4c4-810960579427 service nova] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Received unexpected event network-vif-plugged-e0bce47a-8a77-465f-806c-8d4e9b38ca63 for instance with vm_state building and task_state spawning.
Nov 15 04:32:33 user nova-compute[74805]: INFO nova.compute.manager [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Took 7.61 seconds to build instance.
Nov 15 04:32:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-7a2fb0fb-fa1b-4335-bcfa-ebb88fe7b477 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "a2875e85-f7ff-445d-ac92-133ef145ec93" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.713s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:32:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:35 user nova-compute[74805]: DEBUG nova.compute.manager [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:32:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:32:35 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Instance spawned successfully.
Nov 15 04:32:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:32:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:32:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:32:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:32:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:32:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:32:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:32:35 user nova-compute[74805]: DEBUG nova.compute.manager [req-3d453b1f-479f-42a2-84e7-190eaabd5ef2 req-22448974-57d7-46d8-a3cc-2a742e419054 service nova] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Received event network-vif-plugged-e0bce47a-8a77-465f-806c-8d4e9b38ca63 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:32:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3d453b1f-479f-42a2-84e7-190eaabd5ef2 req-22448974-57d7-46d8-a3cc-2a742e419054 service nova] Acquiring lock "288a5e5c-f8e9-4507-b29c-93e7595922ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:32:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3d453b1f-479f-42a2-84e7-190eaabd5ef2 req-22448974-57d7-46d8-a3cc-2a742e419054 service nova] Lock "288a5e5c-f8e9-4507-b29c-93e7595922ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:32:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3d453b1f-479f-42a2-84e7-190eaabd5ef2 req-22448974-57d7-46d8-a3cc-2a742e419054 service nova] Lock "288a5e5c-f8e9-4507-b29c-93e7595922ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:32:35 user nova-compute[74805]: DEBUG nova.compute.manager [req-3d453b1f-479f-42a2-84e7-190eaabd5ef2 req-22448974-57d7-46d8-a3cc-2a742e419054 service nova] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] No waiting events found dispatching network-vif-plugged-e0bce47a-8a77-465f-806c-8d4e9b38ca63 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:32:35 user nova-compute[74805]: WARNING nova.compute.manager [req-3d453b1f-479f-42a2-84e7-190eaabd5ef2 req-22448974-57d7-46d8-a3cc-2a742e419054 service nova] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Received unexpected event network-vif-plugged-e0bce47a-8a77-465f-806c-8d4e9b38ca63 for instance with vm_state building and task_state spawning.
Nov 15 04:32:35 user nova-compute[74805]: INFO nova.compute.manager [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Took 7.28 seconds to spawn the instance on the hypervisor.
Nov 15 04:32:35 user nova-compute[74805]: DEBUG nova.compute.manager [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:32:35 user nova-compute[74805]: INFO nova.compute.manager [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Took 8.01 seconds to build instance.
Nov 15 04:32:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a28528f7-b912-4f2d-82fb-09b3bd65980d tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "288a5e5c-f8e9-4507-b29c-93e7595922ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.150s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:32:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "f99a9557-4951-49f0-931c-0dbab16478d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:32:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:32:52 user nova-compute[74805]: DEBUG nova.compute.manager [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:32:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:32:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:32:52 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:32:52 user nova-compute[74805]: INFO nova.compute.claims [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Claim successful on node user
Nov 15 04:32:53 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:32:53 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:32:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.307s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:32:53 user nova-compute[74805]: DEBUG nova.compute.manager [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:32:53 user nova-compute[74805]: DEBUG nova.compute.manager [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:32:53 user nova-compute[74805]: DEBUG nova.network.neutron [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:32:53 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:32:53 user nova-compute[74805]: DEBUG nova.compute.manager [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:32:53 user nova-compute[74805]: DEBUG nova.policy [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bbd120c964844bf93a8df3fad453cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8464c1b545064c9f8e5f20d23417ed48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:32:53 user nova-compute[74805]: DEBUG nova.compute.manager [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:32:53 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:32:53 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Creating image(s)
Nov 15 04:32:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "/opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:32:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "/opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:32:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "/opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:32:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:32:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.181s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:32:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:32:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:32:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:32:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.170s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:32:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:32:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk 1073741824" returned: 0 in 0.054s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:32:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:32:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:32:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.173s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:32:53 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:32:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:32:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:32:54 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Cannot resize image /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:32:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:32:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Ensure instance console log exists: /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:32:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:32:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:32:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:32:54 user nova-compute[74805]: DEBUG nova.network.neutron [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Successfully created port: 36f925e7-241b-453e-84bd-a6dc8c213650 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:32:54 user nova-compute[74805]: DEBUG nova.network.neutron [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Successfully updated port: 36f925e7-241b-453e-84bd-a6dc8c213650 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:32:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "refresh_cache-f99a9557-4951-49f0-931c-0dbab16478d8" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:32:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquired lock "refresh_cache-f99a9557-4951-49f0-931c-0dbab16478d8" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:32:54 user nova-compute[74805]: DEBUG nova.network.neutron [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:32:54 user nova-compute[74805]: DEBUG nova.compute.manager [req-ba273ea6-50b8-4e9b-8161-2fe108bae7aa req-4b382595-a530-4eca-b16c-ef6cee28188b service nova] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Received event network-changed-36f925e7-241b-453e-84bd-a6dc8c213650 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:32:54 user nova-compute[74805]: DEBUG nova.compute.manager [req-ba273ea6-50b8-4e9b-8161-2fe108bae7aa req-4b382595-a530-4eca-b16c-ef6cee28188b service nova] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Refreshing instance network info cache due to event network-changed-36f925e7-241b-453e-84bd-a6dc8c213650. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:32:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ba273ea6-50b8-4e9b-8161-2fe108bae7aa req-4b382595-a530-4eca-b16c-ef6cee28188b service nova] Acquiring lock "refresh_cache-f99a9557-4951-49f0-931c-0dbab16478d8" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:32:54 user nova-compute[74805]: DEBUG nova.network.neutron [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.network.neutron [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Updating instance_info_cache with network_info: [{"id": "36f925e7-241b-453e-84bd-a6dc8c213650", "address": "fa:16:3e:f6:5f:e4", "network": {"id": "c5d73469-8aa8-4d7b-bee8-ffcedcaae340", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1298527383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8464c1b545064c9f8e5f20d23417ed48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f925e7-24", "ovs_interfaceid": "36f925e7-241b-453e-84bd-a6dc8c213650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Releasing lock "refresh_cache-f99a9557-4951-49f0-931c-0dbab16478d8" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.compute.manager [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Instance network_info: |[{"id": "36f925e7-241b-453e-84bd-a6dc8c213650", "address": "fa:16:3e:f6:5f:e4", "network": {"id": "c5d73469-8aa8-4d7b-bee8-ffcedcaae340", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1298527383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8464c1b545064c9f8e5f20d23417ed48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f925e7-24", "ovs_interfaceid": "36f925e7-241b-453e-84bd-a6dc8c213650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ba273ea6-50b8-4e9b-8161-2fe108bae7aa req-4b382595-a530-4eca-b16c-ef6cee28188b service nova] Acquired lock "refresh_cache-f99a9557-4951-49f0-931c-0dbab16478d8" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.network.neutron [req-ba273ea6-50b8-4e9b-8161-2fe108bae7aa req-4b382595-a530-4eca-b16c-ef6cee28188b service nova] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Refreshing network info cache for port 36f925e7-241b-453e-84bd-a6dc8c213650 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Start _get_guest_xml network_info=[{"id": "36f925e7-241b-453e-84bd-a6dc8c213650", "address": "fa:16:3e:f6:5f:e4", "network": {"id": "c5d73469-8aa8-4d7b-bee8-ffcedcaae340", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1298527383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8464c1b545064c9f8e5f20d23417ed48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f925e7-24", "ovs_interfaceid": "36f925e7-241b-453e-84bd-a6dc8c213650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:32:55 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:32:55 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:32:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-124357738',display_name='tempest-SnapshotDataIntegrityTests-server-124357738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-124357738',id=40,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdWApAF8/n64KUzvHQdqifpjanLu6B37SuhfpePZVT/97i3CRnT59nnDVWT+Fl4iL1jZbsr6kolFi8r5TV7yEVhKsxwxp71vlHXJXt1VvonUbMOXIvcPljkOkUTuo7AGg==',key_name='tempest-keypair-799908981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8464c1b545064c9f8e5f20d23417ed48',ramdisk_id='',reservation_id='r-v3q0eazd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-251201261',owner_user_name='tempest-SnapshotDataIntegrityTests-251201261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:32:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bbd120c964844bf93a8df3fad453cc9',uuid=f99a9557-4951-49f0-931c-0dbab16478d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36f925e7-241b-453e-84bd-a6dc8c213650", "address": "fa:16:3e:f6:5f:e4", "network": {"id": "c5d73469-8aa8-4d7b-bee8-ffcedcaae340", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1298527383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8464c1b545064c9f8e5f20d23417ed48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f925e7-24", "ovs_interfaceid": "36f925e7-241b-453e-84bd-a6dc8c213650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Converting VIF {"id": "36f925e7-241b-453e-84bd-a6dc8c213650", "address": "fa:16:3e:f6:5f:e4", "network": {"id": "c5d73469-8aa8-4d7b-bee8-ffcedcaae340", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1298527383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8464c1b545064c9f8e5f20d23417ed48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f925e7-24", "ovs_interfaceid": "36f925e7-241b-453e-84bd-a6dc8c213650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:5f:e4,bridge_name='br-int',has_traffic_filtering=True,id=36f925e7-241b-453e-84bd-a6dc8c213650,network=Network(c5d73469-8aa8-4d7b-bee8-ffcedcaae340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f925e7-24') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.objects.instance [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lazy-loading 'pci_devices' on Instance uuid f99a9557-4951-49f0-931c-0dbab16478d8 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:32:55 user nova-compute[74805]:   <uuid>f99a9557-4951-49f0-931c-0dbab16478d8</uuid>
Nov 15 04:32:55 user nova-compute[74805]:   <name>instance-00000028</name>
Nov 15 04:32:55 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:32:55 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:32:55 user nova-compute[74805]:   <metadata>
Nov 15 04:32:55 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:32:55 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:32:55 user nova-compute[74805]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-124357738</nova:name>
Nov 15 04:32:55 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:32:55</nova:creationTime>
Nov 15 04:32:55 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:32:55 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:32:55 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:32:55 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:32:55 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:32:55 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:32:55 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:32:55 user nova-compute[74805]:       <nova:owner>
Nov 15 04:32:55 user nova-compute[74805]:         <nova:user uuid="5bbd120c964844bf93a8df3fad453cc9">tempest-SnapshotDataIntegrityTests-251201261-project-member</nova:user>
Nov 15 04:32:55 user nova-compute[74805]:         <nova:project uuid="8464c1b545064c9f8e5f20d23417ed48">tempest-SnapshotDataIntegrityTests-251201261</nova:project>
Nov 15 04:32:55 user nova-compute[74805]:       </nova:owner>
Nov 15 04:32:55 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:32:55 user nova-compute[74805]:       <nova:ports>
Nov 15 04:32:55 user nova-compute[74805]:         <nova:port uuid="36f925e7-241b-453e-84bd-a6dc8c213650">
Nov 15 04:32:55 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 04:32:55 user nova-compute[74805]:         </nova:port>
Nov 15 04:32:55 user nova-compute[74805]:       </nova:ports>
Nov 15 04:32:55 user nova-compute[74805]:     </nova:instance>
Nov 15 04:32:55 user nova-compute[74805]:   </metadata>
Nov 15 04:32:55 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:32:55 user nova-compute[74805]:     <system>
Nov 15 04:32:55 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:32:55 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:32:55 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:32:55 user nova-compute[74805]:       <entry name="serial">f99a9557-4951-49f0-931c-0dbab16478d8</entry>
Nov 15 04:32:55 user nova-compute[74805]:       <entry name="uuid">f99a9557-4951-49f0-931c-0dbab16478d8</entry>
Nov 15 04:32:55 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:32:55 user nova-compute[74805]:     </system>
Nov 15 04:32:55 user nova-compute[74805]:   </sysinfo>
Nov 15 04:32:55 user nova-compute[74805]:   <os>
Nov 15 04:32:55 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:32:55 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:32:55 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:32:55 user nova-compute[74805]:   </os>
Nov 15 04:32:55 user nova-compute[74805]:   <features>
Nov 15 04:32:55 user nova-compute[74805]:     <acpi/>
Nov 15 04:32:55 user nova-compute[74805]:     <apic/>
Nov 15 04:32:55 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:32:55 user nova-compute[74805]:   </features>
Nov 15 04:32:55 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:32:55 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:32:55 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:32:55 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:32:55 user nova-compute[74805]:   </clock>
Nov 15 04:32:55 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:32:55 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:32:55 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:32:55 user nova-compute[74805]:   </cpu>
Nov 15 04:32:55 user nova-compute[74805]:   <devices>
Nov 15 04:32:55 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:32:55 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:32:55 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk"/>
Nov 15 04:32:55 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:32:55 user nova-compute[74805]:     </disk>
Nov 15 04:32:55 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:32:55 user nova-compute[74805]:       <mac address="fa:16:3e:f6:5f:e4"/>
Nov 15 04:32:55 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:32:55 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:32:55 user nova-compute[74805]:       <target dev="tap36f925e7-24"/>
Nov 15 04:32:55 user nova-compute[74805]:     </interface>
Nov 15 04:32:55 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:32:55 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/console.log" append="off"/>
Nov 15 04:32:55 user nova-compute[74805]:     </serial>
Nov 15 04:32:55 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:32:55 user nova-compute[74805]:     <video>
Nov 15 04:32:55 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:32:55 user nova-compute[74805]:     </video>
Nov 15 04:32:55 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:32:55 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:32:55 user nova-compute[74805]:     </rng>
Nov 15 04:32:55 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:32:55 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:32:55 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:32:55 user nova-compute[74805]:     </memballoon>
Nov 15 04:32:55 user nova-compute[74805]:   </devices>
Nov 15 04:32:55 user nova-compute[74805]: </domain>
Nov 15 04:32:55 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:32:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-124357738',display_name='tempest-SnapshotDataIntegrityTests-server-124357738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-124357738',id=40,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdWApAF8/n64KUzvHQdqifpjanLu6B37SuhfpePZVT/97i3CRnT59nnDVWT+Fl4iL1jZbsr6kolFi8r5TV7yEVhKsxwxp71vlHXJXt1VvonUbMOXIvcPljkOkUTuo7AGg==',key_name='tempest-keypair-799908981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8464c1b545064c9f8e5f20d23417ed48',ramdisk_id='',reservation_id='r-v3q0eazd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-251201261',owner_user_name='tempest-SnapshotDataIntegrityTests-251201261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:32:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bbd120c964844bf93a8df3fad453cc9',uuid=f99a9557-4951-49f0-931c-0dbab16478d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36f925e7-241b-453e-84bd-a6dc8c213650", "address": "fa:16:3e:f6:5f:e4", "network": {"id": "c5d73469-8aa8-4d7b-bee8-ffcedcaae340", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1298527383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8464c1b545064c9f8e5f20d23417ed48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f925e7-24", "ovs_interfaceid": "36f925e7-241b-453e-84bd-a6dc8c213650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Converting VIF {"id": "36f925e7-241b-453e-84bd-a6dc8c213650", "address": "fa:16:3e:f6:5f:e4", "network": {"id": "c5d73469-8aa8-4d7b-bee8-ffcedcaae340", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1298527383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8464c1b545064c9f8e5f20d23417ed48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f925e7-24", "ovs_interfaceid": "36f925e7-241b-453e-84bd-a6dc8c213650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:5f:e4,bridge_name='br-int',has_traffic_filtering=True,id=36f925e7-241b-453e-84bd-a6dc8c213650,network=Network(c5d73469-8aa8-4d7b-bee8-ffcedcaae340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f925e7-24') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG os_vif [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:5f:e4,bridge_name='br-int',has_traffic_filtering=True,id=36f925e7-241b-453e-84bd-a6dc8c213650,network=Network(c5d73469-8aa8-4d7b-bee8-ffcedcaae340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f925e7-24') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e1f9d67-7e13-565a-88be-0923ca757956', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36f925e7-24, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36f925e7-24, col_values=(('qos', UUID('f3677555-d75f-4fec-a181-8128a98022fb')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36f925e7-24, col_values=(('external_ids', {'iface-id': '36f925e7-241b-453e-84bd-a6dc8c213650', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:5f:e4', 'vm-uuid': 'f99a9557-4951-49f0-931c-0dbab16478d8'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:55 user nova-compute[74805]: INFO os_vif [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:5f:e4,bridge_name='br-int',has_traffic_filtering=True,id=36f925e7-241b-453e-84bd-a6dc8c213650,network=Network(c5d73469-8aa8-4d7b-bee8-ffcedcaae340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f925e7-24')
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] No VIF found with MAC fa:16:3e:f6:5f:e4, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.network.neutron [req-ba273ea6-50b8-4e9b-8161-2fe108bae7aa req-4b382595-a530-4eca-b16c-ef6cee28188b service nova] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Updated VIF entry in instance network info cache for port 36f925e7-241b-453e-84bd-a6dc8c213650. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG nova.network.neutron [req-ba273ea6-50b8-4e9b-8161-2fe108bae7aa req-4b382595-a530-4eca-b16c-ef6cee28188b service nova] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Updating instance_info_cache with network_info: [{"id": "36f925e7-241b-453e-84bd-a6dc8c213650", "address": "fa:16:3e:f6:5f:e4", "network": {"id": "c5d73469-8aa8-4d7b-bee8-ffcedcaae340", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1298527383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8464c1b545064c9f8e5f20d23417ed48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f925e7-24", "ovs_interfaceid": "36f925e7-241b-453e-84bd-a6dc8c213650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:32:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ba273ea6-50b8-4e9b-8161-2fe108bae7aa req-4b382595-a530-4eca-b16c-ef6cee28188b service nova] Releasing lock "refresh_cache-f99a9557-4951-49f0-931c-0dbab16478d8" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:32:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:56 user nova-compute[74805]: DEBUG nova.compute.manager [req-bfd83436-ece5-4769-b849-21b19d3e67f4 req-a4180255-2e79-45f6-a970-66548f0cee44 service nova] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Received event network-vif-plugged-36f925e7-241b-453e-84bd-a6dc8c213650 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:32:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bfd83436-ece5-4769-b849-21b19d3e67f4 req-a4180255-2e79-45f6-a970-66548f0cee44 service nova] Acquiring lock "f99a9557-4951-49f0-931c-0dbab16478d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:32:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bfd83436-ece5-4769-b849-21b19d3e67f4 req-a4180255-2e79-45f6-a970-66548f0cee44 service nova] Lock "f99a9557-4951-49f0-931c-0dbab16478d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:32:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bfd83436-ece5-4769-b849-21b19d3e67f4 req-a4180255-2e79-45f6-a970-66548f0cee44 service nova] Lock "f99a9557-4951-49f0-931c-0dbab16478d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:32:56 user nova-compute[74805]: DEBUG nova.compute.manager [req-bfd83436-ece5-4769-b849-21b19d3e67f4 req-a4180255-2e79-45f6-a970-66548f0cee44 service nova] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] No waiting events found dispatching network-vif-plugged-36f925e7-241b-453e-84bd-a6dc8c213650 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:32:56 user nova-compute[74805]: WARNING nova.compute.manager [req-bfd83436-ece5-4769-b849-21b19d3e67f4 req-a4180255-2e79-45f6-a970-66548f0cee44 service nova] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Received unexpected event network-vif-plugged-36f925e7-241b-453e-84bd-a6dc8c213650 for instance with vm_state building and task_state spawning.
Nov 15 04:32:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:32:58 user nova-compute[74805]: DEBUG nova.compute.manager [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:32:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:32:58 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Instance spawned successfully.
Nov 15 04:32:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:32:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:32:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:32:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:32:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:32:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:32:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:32:58 user nova-compute[74805]: INFO nova.compute.manager [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Took 5.64 seconds to spawn the instance on the hypervisor.
Nov 15 04:32:58 user nova-compute[74805]: DEBUG nova.compute.manager [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:32:58 user nova-compute[74805]: DEBUG nova.compute.manager [req-b82c8256-d5e0-4473-a000-d82eb4ce98ab req-631af8a4-8571-4ca0-b3bf-2916f3ff39a2 service nova] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Received event network-vif-plugged-36f925e7-241b-453e-84bd-a6dc8c213650 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:32:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b82c8256-d5e0-4473-a000-d82eb4ce98ab req-631af8a4-8571-4ca0-b3bf-2916f3ff39a2 service nova] Acquiring lock "f99a9557-4951-49f0-931c-0dbab16478d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:32:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b82c8256-d5e0-4473-a000-d82eb4ce98ab req-631af8a4-8571-4ca0-b3bf-2916f3ff39a2 service nova] Lock "f99a9557-4951-49f0-931c-0dbab16478d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:32:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b82c8256-d5e0-4473-a000-d82eb4ce98ab req-631af8a4-8571-4ca0-b3bf-2916f3ff39a2 service nova] Lock "f99a9557-4951-49f0-931c-0dbab16478d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:32:58 user nova-compute[74805]: DEBUG nova.compute.manager [req-b82c8256-d5e0-4473-a000-d82eb4ce98ab req-631af8a4-8571-4ca0-b3bf-2916f3ff39a2 service nova] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] No waiting events found dispatching network-vif-plugged-36f925e7-241b-453e-84bd-a6dc8c213650 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:32:58 user nova-compute[74805]: WARNING nova.compute.manager [req-b82c8256-d5e0-4473-a000-d82eb4ce98ab req-631af8a4-8571-4ca0-b3bf-2916f3ff39a2 service nova] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Received unexpected event network-vif-plugged-36f925e7-241b-453e-84bd-a6dc8c213650 for instance with vm_state building and task_state spawning.
Nov 15 04:32:59 user nova-compute[74805]: INFO nova.compute.manager [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Took 6.28 seconds to build instance.
Nov 15 04:32:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-46bb9ffb-01d4-4ffc-a27b-027db4cd124f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.381s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:33:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6b3c5d41-64f9-486b-8773-4e2d3cc243d0 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "d63f3726-27df-455f-bda0-3ddca95b70d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:33:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6b3c5d41-64f9-486b-8773-4e2d3cc243d0 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "d63f3726-27df-455f-bda0-3ddca95b70d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:33:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6b3c5d41-64f9-486b-8773-4e2d3cc243d0 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "d63f3726-27df-455f-bda0-3ddca95b70d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:33:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6b3c5d41-64f9-486b-8773-4e2d3cc243d0 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "d63f3726-27df-455f-bda0-3ddca95b70d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:33:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6b3c5d41-64f9-486b-8773-4e2d3cc243d0 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "d63f3726-27df-455f-bda0-3ddca95b70d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:33:06 user nova-compute[74805]: INFO nova.compute.manager [None req-6b3c5d41-64f9-486b-8773-4e2d3cc243d0 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Terminating instance
Nov 15 04:33:06 user nova-compute[74805]: DEBUG nova.compute.manager [None req-6b3c5d41-64f9-486b-8773-4e2d3cc243d0 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:33:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:06 user nova-compute[74805]: DEBUG nova.compute.manager [req-bde4996f-fb1b-499a-ba0b-181b2708d79d req-8c61cb8c-a7e8-497c-9cc1-d43b61baab01 service nova] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Received event network-vif-unplugged-0d0a11b6-25c5-4478-8c6f-40ac41f83b3d {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:33:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bde4996f-fb1b-499a-ba0b-181b2708d79d req-8c61cb8c-a7e8-497c-9cc1-d43b61baab01 service nova] Acquiring lock "d63f3726-27df-455f-bda0-3ddca95b70d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:33:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bde4996f-fb1b-499a-ba0b-181b2708d79d req-8c61cb8c-a7e8-497c-9cc1-d43b61baab01 service nova] Lock "d63f3726-27df-455f-bda0-3ddca95b70d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:33:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bde4996f-fb1b-499a-ba0b-181b2708d79d req-8c61cb8c-a7e8-497c-9cc1-d43b61baab01 service nova] Lock "d63f3726-27df-455f-bda0-3ddca95b70d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:33:06 user nova-compute[74805]: DEBUG nova.compute.manager [req-bde4996f-fb1b-499a-ba0b-181b2708d79d req-8c61cb8c-a7e8-497c-9cc1-d43b61baab01 service nova] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] No waiting events found dispatching network-vif-unplugged-0d0a11b6-25c5-4478-8c6f-40ac41f83b3d {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:33:06 user nova-compute[74805]: DEBUG nova.compute.manager [req-bde4996f-fb1b-499a-ba0b-181b2708d79d req-8c61cb8c-a7e8-497c-9cc1-d43b61baab01 service nova] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Received event network-vif-unplugged-0d0a11b6-25c5-4478-8c6f-40ac41f83b3d for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:33:07 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Instance destroyed successfully.
Nov 15 04:33:07 user nova-compute[74805]: DEBUG nova.objects.instance [None req-6b3c5d41-64f9-486b-8773-4e2d3cc243d0 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lazy-loading 'resources' on Instance uuid d63f3726-27df-455f-bda0-3ddca95b70d9 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:33:07 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-6b3c5d41-64f9-486b-8773-4e2d3cc243d0 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:14:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-538134777',display_name='tempest-ServerActionsTestOtherA-server-538134777',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-538134777',id=6,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGV8yvKXomaZF0BD7dR1o4bDaZdfuwtMvfH2u8DYsuFF6EZbmfxZGzCOIo9eDRbRFMNzHBU8sLiuRkxRud23xuRO+aBfUN0XRumVbmJ/zSOioI/76XwN4XIsuXVKkxna2w==',key_name='tempest-keypair-1041116715',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:14:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6dcdb40f067540dab36661ea0586f1d5',ramdisk_id='',reservation_id='r-tk2u5nsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1623992712',owner_user_name='tempest-ServerActionsTestOtherA-1623992712-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:14:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b6a8eff61f4d6ba2e83d7939143112',uuid=d63f3726-27df-455f-bda0-3ddca95b70d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "address": "fa:16:3e:b1:3d:ff", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d0a11b6-25", "ovs_interfaceid": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:33:07 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-6b3c5d41-64f9-486b-8773-4e2d3cc243d0 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converting VIF {"id": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "address": "fa:16:3e:b1:3d:ff", "network": {"id": "5fec0c5a-a4de-4856-8682-dbf3e3307a5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490336790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcdb40f067540dab36661ea0586f1d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d0a11b6-25", "ovs_interfaceid": "0d0a11b6-25c5-4478-8c6f-40ac41f83b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:33:07 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-6b3c5d41-64f9-486b-8773-4e2d3cc243d0 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:3d:ff,bridge_name='br-int',has_traffic_filtering=True,id=0d0a11b6-25c5-4478-8c6f-40ac41f83b3d,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d0a11b6-25') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:33:07 user nova-compute[74805]: DEBUG os_vif [None req-6b3c5d41-64f9-486b-8773-4e2d3cc243d0 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:3d:ff,bridge_name='br-int',has_traffic_filtering=True,id=0d0a11b6-25c5-4478-8c6f-40ac41f83b3d,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d0a11b6-25') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:33:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d0a11b6-25, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:33:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:33:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd2fcab0-541f-4205-a07c-bbdcb0f3db29) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:33:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:07 user nova-compute[74805]: INFO os_vif [None req-6b3c5d41-64f9-486b-8773-4e2d3cc243d0 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:3d:ff,bridge_name='br-int',has_traffic_filtering=True,id=0d0a11b6-25c5-4478-8c6f-40ac41f83b3d,network=Network(5fec0c5a-a4de-4856-8682-dbf3e3307a5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d0a11b6-25')
Nov 15 04:33:07 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-6b3c5d41-64f9-486b-8773-4e2d3cc243d0 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Deleting instance files /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9_del
Nov 15 04:33:07 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-6b3c5d41-64f9-486b-8773-4e2d3cc243d0 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Deletion of /opt/stack/data/nova/instances/d63f3726-27df-455f-bda0-3ddca95b70d9_del complete
Nov 15 04:33:07 user nova-compute[74805]: INFO nova.compute.manager [None req-6b3c5d41-64f9-486b-8773-4e2d3cc243d0 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 15 04:33:07 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-6b3c5d41-64f9-486b-8773-4e2d3cc243d0 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:33:07 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:33:07 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:33:07 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:33:07 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Took 0.43 seconds to deallocate network for instance.
Nov 15 04:33:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6b3c5d41-64f9-486b-8773-4e2d3cc243d0 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:33:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6b3c5d41-64f9-486b-8773-4e2d3cc243d0 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:33:07 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-6b3c5d41-64f9-486b-8773-4e2d3cc243d0 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:33:07 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-6b3c5d41-64f9-486b-8773-4e2d3cc243d0 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:33:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6b3c5d41-64f9-486b-8773-4e2d3cc243d0 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.233s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:33:07 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-6b3c5d41-64f9-486b-8773-4e2d3cc243d0 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Deleted allocations for instance d63f3726-27df-455f-bda0-3ddca95b70d9
Nov 15 04:33:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6b3c5d41-64f9-486b-8773-4e2d3cc243d0 tempest-ServerActionsTestOtherA-1623992712 tempest-ServerActionsTestOtherA-1623992712-project-member] Lock "d63f3726-27df-455f-bda0-3ddca95b70d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.568s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:33:08 user nova-compute[74805]: DEBUG nova.compute.manager [req-8647a963-e6af-429b-98a0-fe7f674b3f50 req-f0d22cf0-e0ce-4e02-a6b9-67a6ce22ddc8 service nova] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Received event network-vif-plugged-0d0a11b6-25c5-4478-8c6f-40ac41f83b3d {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:33:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8647a963-e6af-429b-98a0-fe7f674b3f50 req-f0d22cf0-e0ce-4e02-a6b9-67a6ce22ddc8 service nova] Acquiring lock "d63f3726-27df-455f-bda0-3ddca95b70d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:33:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8647a963-e6af-429b-98a0-fe7f674b3f50 req-f0d22cf0-e0ce-4e02-a6b9-67a6ce22ddc8 service nova] Lock "d63f3726-27df-455f-bda0-3ddca95b70d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:33:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8647a963-e6af-429b-98a0-fe7f674b3f50 req-f0d22cf0-e0ce-4e02-a6b9-67a6ce22ddc8 service nova] Lock "d63f3726-27df-455f-bda0-3ddca95b70d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:33:08 user nova-compute[74805]: DEBUG nova.compute.manager [req-8647a963-e6af-429b-98a0-fe7f674b3f50 req-f0d22cf0-e0ce-4e02-a6b9-67a6ce22ddc8 service nova] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] No waiting events found dispatching network-vif-plugged-0d0a11b6-25c5-4478-8c6f-40ac41f83b3d {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:33:08 user nova-compute[74805]: WARNING nova.compute.manager [req-8647a963-e6af-429b-98a0-fe7f674b3f50 req-f0d22cf0-e0ce-4e02-a6b9-67a6ce22ddc8 service nova] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Received unexpected event network-vif-plugged-0d0a11b6-25c5-4478-8c6f-40ac41f83b3d for instance with vm_state deleted and task_state None.
Nov 15 04:33:08 user nova-compute[74805]: DEBUG nova.compute.manager [req-8647a963-e6af-429b-98a0-fe7f674b3f50 req-f0d22cf0-e0ce-4e02-a6b9-67a6ce22ddc8 service nova] [instance: d63f3726-27df-455f-bda0-3ddca95b70d9] Received event network-vif-deleted-0d0a11b6-25c5-4478-8c6f-40ac41f83b3d {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:33:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:13 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:33:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:16 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:33:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:17 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:33:18 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:33:19 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:33:19 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:33:19 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 15 04:33:19 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Didn't find any instances for network info cache update. {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 04:33:19 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:33:19 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:33:19 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:33:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:33:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:33:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:33:19 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:33:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:33:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:33:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:33:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:33:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:33:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:33:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:33:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:33:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:33:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2875e85-f7ff-445d-ac92-133ef145ec93/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:33:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2875e85-f7ff-445d-ac92-133ef145ec93/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:33:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2875e85-f7ff-445d-ac92-133ef145ec93/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:33:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2875e85-f7ff-445d-ac92-133ef145ec93/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:33:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:33:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:33:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:33:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:33:21 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:33:21 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:33:21 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=8330MB free_disk=25.030475616455078GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:33:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:33:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:33:21 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 9f267864-0b72-431d-9b0d-c63436002a4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:33:21 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 38196606-a9c9-4604-ad21-2ec7511a8b28 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:33:21 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance a2875e85-f7ff-445d-ac92-133ef145ec93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:33:21 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 288a5e5c-f8e9-4507-b29c-93e7595922ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:33:21 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance f99a9557-4951-49f0-931c-0dbab16478d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:33:21 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:33:21 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:33:21 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:33:21 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:33:21 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:33:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.317s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:33:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:27 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:33:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:33:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:33:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:33:35 user nova-compute[74805]: INFO nova.compute.manager [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Unshelving
Nov 15 04:33:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:33:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:33:35 user nova-compute[74805]: DEBUG nova.objects.instance [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lazy-loading 'pci_requests' on Instance uuid 2d9a5b2b-7196-4ec9-8afc-cac356fe1495 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:33:35 user nova-compute[74805]: DEBUG nova.objects.instance [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lazy-loading 'numa_topology' on Instance uuid 2d9a5b2b-7196-4ec9-8afc-cac356fe1495 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:33:35 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:33:35 user nova-compute[74805]: INFO nova.compute.claims [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Claim successful on node user
Nov 15 04:33:35 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:33:35 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:33:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:33:35 user nova-compute[74805]: INFO nova.network.neutron [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Updating port 64bc8d35-4c9d-40db-ac46-46d6a3476698 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 04:33:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "refresh_cache-2d9a5b2b-7196-4ec9-8afc-cac356fe1495" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:33:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquired lock "refresh_cache-2d9a5b2b-7196-4ec9-8afc-cac356fe1495" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:33:36 user nova-compute[74805]: DEBUG nova.network.neutron [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:33:36 user nova-compute[74805]: DEBUG nova.compute.manager [req-ac82abee-e356-484c-9962-377d906dd17c req-a32cd1e2-d990-4b8e-b175-d66125d48e3c service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Received event network-changed-64bc8d35-4c9d-40db-ac46-46d6a3476698 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:33:36 user nova-compute[74805]: DEBUG nova.compute.manager [req-ac82abee-e356-484c-9962-377d906dd17c req-a32cd1e2-d990-4b8e-b175-d66125d48e3c service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Refreshing instance network info cache due to event network-changed-64bc8d35-4c9d-40db-ac46-46d6a3476698. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:33:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ac82abee-e356-484c-9962-377d906dd17c req-a32cd1e2-d990-4b8e-b175-d66125d48e3c service nova] Acquiring lock "refresh_cache-2d9a5b2b-7196-4ec9-8afc-cac356fe1495" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:33:36 user nova-compute[74805]: DEBUG nova.network.neutron [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Updating instance_info_cache with network_info: [{"id": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "address": "fa:16:3e:22:73:22", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bc8d35-4c", "ovs_interfaceid": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:33:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Releasing lock "refresh_cache-2d9a5b2b-7196-4ec9-8afc-cac356fe1495" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:33:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:33:36 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Creating image(s)
Nov 15 04:33:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:33:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "/opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:33:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "/opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:33:36 user nova-compute[74805]: DEBUG nova.objects.instance [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2d9a5b2b-7196-4ec9-8afc-cac356fe1495 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:33:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ac82abee-e356-484c-9962-377d906dd17c req-a32cd1e2-d990-4b8e-b175-d66125d48e3c service nova] Acquired lock "refresh_cache-2d9a5b2b-7196-4ec9-8afc-cac356fe1495" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:33:36 user nova-compute[74805]: DEBUG nova.network.neutron [req-ac82abee-e356-484c-9962-377d906dd17c req-a32cd1e2-d990-4b8e-b175-d66125d48e3c service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Refreshing network info cache for port 64bc8d35-4c9d-40db-ac46-46d6a3476698 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:33:36 user nova-compute[74805]: DEBUG nova.objects.base [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Object Instance<2d9a5b2b-7196-4ec9-8afc-cac356fe1495> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:33:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "c1cec425695dd7fabc345043db8586bf910327aa" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:33:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "c1cec425695dd7fabc345043db8586bf910327aa" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:33:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1cec425695dd7fabc345043db8586bf910327aa.part --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:33:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1cec425695dd7fabc345043db8586bf910327aa.part --force-share --output=json" returned: 0 in 0.170s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:33:37 user nova-compute[74805]: DEBUG nova.virt.images [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] 1a8a0e2f-fb76-4cf3-aad1-de2736951676 was qcow2, converting to raw {{(pid=74805) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 04:33:37 user nova-compute[74805]: DEBUG nova.privsep.utils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74805) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 04:33:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c1cec425695dd7fabc345043db8586bf910327aa.part /opt/stack/data/nova/instances/_base/c1cec425695dd7fabc345043db8586bf910327aa.converted {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:33:38 user nova-compute[74805]: DEBUG nova.network.neutron [req-ac82abee-e356-484c-9962-377d906dd17c req-a32cd1e2-d990-4b8e-b175-d66125d48e3c service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Updated VIF entry in instance network info cache for port 64bc8d35-4c9d-40db-ac46-46d6a3476698. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:33:38 user nova-compute[74805]: DEBUG nova.network.neutron [req-ac82abee-e356-484c-9962-377d906dd17c req-a32cd1e2-d990-4b8e-b175-d66125d48e3c service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Updating instance_info_cache with network_info: [{"id": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "address": "fa:16:3e:22:73:22", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bc8d35-4c", "ovs_interfaceid": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:33:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ac82abee-e356-484c-9962-377d906dd17c req-a32cd1e2-d990-4b8e-b175-d66125d48e3c service nova] Releasing lock "refresh_cache-2d9a5b2b-7196-4ec9-8afc-cac356fe1495" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:33:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c1cec425695dd7fabc345043db8586bf910327aa.part /opt/stack/data/nova/instances/_base/c1cec425695dd7fabc345043db8586bf910327aa.converted" returned: 0 in 0.931s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:33:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1cec425695dd7fabc345043db8586bf910327aa.converted --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:33:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1cec425695dd7fabc345043db8586bf910327aa.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:33:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "c1cec425695dd7fabc345043db8586bf910327aa" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.454s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:33:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1cec425695dd7fabc345043db8586bf910327aa --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:33:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1cec425695dd7fabc345043db8586bf910327aa --force-share --output=json" returned: 0 in 0.169s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:33:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "c1cec425695dd7fabc345043db8586bf910327aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:33:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "c1cec425695dd7fabc345043db8586bf910327aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:33:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1cec425695dd7fabc345043db8586bf910327aa --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:33:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1cec425695dd7fabc345043db8586bf910327aa --force-share --output=json" returned: 0 in 0.171s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:33:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1cec425695dd7fabc345043db8586bf910327aa,backing_fmt=raw /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:33:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1cec425695dd7fabc345043db8586bf910327aa,backing_fmt=raw /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk 1073741824" returned: 0 in 0.048s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:33:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "c1cec425695dd7fabc345043db8586bf910327aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:33:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1cec425695dd7fabc345043db8586bf910327aa --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:33:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1cec425695dd7fabc345043db8586bf910327aa --force-share --output=json" returned: 0 in 0.172s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:33:39 user nova-compute[74805]: DEBUG nova.objects.instance [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lazy-loading 'migration_context' on Instance uuid 2d9a5b2b-7196-4ec9-8afc-cac356fe1495 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:33:39 user nova-compute[74805]: DEBUG nova.objects.base [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Object Instance<2d9a5b2b-7196-4ec9-8afc-cac356fe1495> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:33:39 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Rebasing disk image.
Nov 15 04:33:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:33:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.167s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:33:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 -F raw /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 -F raw /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk" returned: 0 in 2.526s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Ensure instance console log exists: /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Start _get_guest_xml network_info=[{"id": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "address": "fa:16:3e:22:73:22", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bc8d35-4c", "ovs_interfaceid": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='2acdc2947a70c50ee4e94b5343247822',container_format='bare',created_at=2023-11-15T04:31:43Z,direct_url=<?>,disk_format='qcow2',id=1a8a0e2f-fb76-4cf3-aad1-de2736951676,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-404241420-shelved',owner='5e01874e82ed4ae08813343751506eeb',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T04:31:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:33:42 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:33:42 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='2acdc2947a70c50ee4e94b5343247822',container_format='bare',created_at=2023-11-15T04:31:43Z,direct_url=<?>,disk_format='qcow2',id=1a8a0e2f-fb76-4cf3-aad1-de2736951676,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-404241420-shelved',owner='5e01874e82ed4ae08813343751506eeb',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T04:31:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.objects.instance [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2d9a5b2b-7196-4ec9-8afc-cac356fe1495 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.objects.base [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Object Instance<2d9a5b2b-7196-4ec9-8afc-cac356fe1495> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T04:29:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-404241420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-404241420',id=37,image_ref='1a8a0e2f-fb76-4cf3-aad1-de2736951676',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-498211884',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:29:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5e01874e82ed4ae08813343751506eeb',ramdisk_id='',reservation_id='r-d0v3uxp3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2114494734',owner_user_name='tempest-AttachVolumeShelveTestJSON-2114494734-project-member',shelved_at='2023-11-15T04:31:46.665509',shelved_host='user',shelved_image_id='1a8a0e2f-fb76-4cf3-aad1-de2736951676'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:33:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2876983d30794d8db191857d2f420f7d',uuid=2d9a5b2b-7196-4ec9-8afc-cac356fe1495,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "address": "fa:16:3e:22:73:22", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bc8d35-4c", "ovs_interfaceid": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Converting VIF {"id": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "address": "fa:16:3e:22:73:22", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bc8d35-4c", "ovs_interfaceid": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:73:22,bridge_name='br-int',has_traffic_filtering=True,id=64bc8d35-4c9d-40db-ac46-46d6a3476698,network=Network(5febf498-f447-4e3b-a484-320124bd0158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bc8d35-4c') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.objects.instance [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d9a5b2b-7196-4ec9-8afc-cac356fe1495 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.objects.base [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Object Instance<2d9a5b2b-7196-4ec9-8afc-cac356fe1495> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:33:42 user nova-compute[74805]:   <uuid>2d9a5b2b-7196-4ec9-8afc-cac356fe1495</uuid>
Nov 15 04:33:42 user nova-compute[74805]:   <name>instance-00000025</name>
Nov 15 04:33:42 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:33:42 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:33:42 user nova-compute[74805]:   <metadata>
Nov 15 04:33:42 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:33:42 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:33:42 user nova-compute[74805]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-404241420</nova:name>
Nov 15 04:33:42 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:33:42</nova:creationTime>
Nov 15 04:33:42 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:33:42 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:33:42 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:33:42 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:33:42 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:33:42 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:33:42 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:33:42 user nova-compute[74805]:       <nova:owner>
Nov 15 04:33:42 user nova-compute[74805]:         <nova:user uuid="2876983d30794d8db191857d2f420f7d">tempest-AttachVolumeShelveTestJSON-2114494734-project-member</nova:user>
Nov 15 04:33:42 user nova-compute[74805]:         <nova:project uuid="5e01874e82ed4ae08813343751506eeb">tempest-AttachVolumeShelveTestJSON-2114494734</nova:project>
Nov 15 04:33:42 user nova-compute[74805]:       </nova:owner>
Nov 15 04:33:42 user nova-compute[74805]:       <nova:root type="image" uuid="1a8a0e2f-fb76-4cf3-aad1-de2736951676"/>
Nov 15 04:33:42 user nova-compute[74805]:       <nova:ports>
Nov 15 04:33:42 user nova-compute[74805]:         <nova:port uuid="64bc8d35-4c9d-40db-ac46-46d6a3476698">
Nov 15 04:33:42 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 04:33:42 user nova-compute[74805]:         </nova:port>
Nov 15 04:33:42 user nova-compute[74805]:       </nova:ports>
Nov 15 04:33:42 user nova-compute[74805]:     </nova:instance>
Nov 15 04:33:42 user nova-compute[74805]:   </metadata>
Nov 15 04:33:42 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:33:42 user nova-compute[74805]:     <system>
Nov 15 04:33:42 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:33:42 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:33:42 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:33:42 user nova-compute[74805]:       <entry name="serial">2d9a5b2b-7196-4ec9-8afc-cac356fe1495</entry>
Nov 15 04:33:42 user nova-compute[74805]:       <entry name="uuid">2d9a5b2b-7196-4ec9-8afc-cac356fe1495</entry>
Nov 15 04:33:42 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:33:42 user nova-compute[74805]:     </system>
Nov 15 04:33:42 user nova-compute[74805]:   </sysinfo>
Nov 15 04:33:42 user nova-compute[74805]:   <os>
Nov 15 04:33:42 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:33:42 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:33:42 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:33:42 user nova-compute[74805]:   </os>
Nov 15 04:33:42 user nova-compute[74805]:   <features>
Nov 15 04:33:42 user nova-compute[74805]:     <acpi/>
Nov 15 04:33:42 user nova-compute[74805]:     <apic/>
Nov 15 04:33:42 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:33:42 user nova-compute[74805]:   </features>
Nov 15 04:33:42 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:33:42 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:33:42 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:33:42 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:33:42 user nova-compute[74805]:   </clock>
Nov 15 04:33:42 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:33:42 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:33:42 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:33:42 user nova-compute[74805]:   </cpu>
Nov 15 04:33:42 user nova-compute[74805]:   <devices>
Nov 15 04:33:42 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:33:42 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:33:42 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk"/>
Nov 15 04:33:42 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:33:42 user nova-compute[74805]:     </disk>
Nov 15 04:33:42 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:33:42 user nova-compute[74805]:       <mac address="fa:16:3e:22:73:22"/>
Nov 15 04:33:42 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:33:42 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:33:42 user nova-compute[74805]:       <target dev="tap64bc8d35-4c"/>
Nov 15 04:33:42 user nova-compute[74805]:     </interface>
Nov 15 04:33:42 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:33:42 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/console.log" append="off"/>
Nov 15 04:33:42 user nova-compute[74805]:     </serial>
Nov 15 04:33:42 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:33:42 user nova-compute[74805]:     <video>
Nov 15 04:33:42 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:33:42 user nova-compute[74805]:     </video>
Nov 15 04:33:42 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:33:42 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:33:42 user nova-compute[74805]:     </rng>
Nov 15 04:33:42 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:33:42 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:33:42 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:33:42 user nova-compute[74805]:     </memballoon>
Nov 15 04:33:42 user nova-compute[74805]:   </devices>
Nov 15 04:33:42 user nova-compute[74805]: </domain>
Nov 15 04:33:42 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T04:29:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-404241420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-404241420',id=37,image_ref='1a8a0e2f-fb76-4cf3-aad1-de2736951676',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-498211884',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:29:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5e01874e82ed4ae08813343751506eeb',ramdisk_id='',reservation_id='r-d0v3uxp3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2114494734',owner_user_name='tempest-AttachVolumeShelveTestJSON-2114494734-project-member',shelved_at='2023-11-15T04:31:46.665509',shelved_host='user',shelved_image_id='1a8a0e2f-fb76-4cf3-aad1-de2736951676'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:33:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2876983d30794d8db191857d2f420f7d',uuid=2d9a5b2b-7196-4ec9-8afc-cac356fe1495,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "address": "fa:16:3e:22:73:22", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bc8d35-4c", "ovs_interfaceid": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Converting VIF {"id": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "address": "fa:16:3e:22:73:22", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bc8d35-4c", "ovs_interfaceid": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:73:22,bridge_name='br-int',has_traffic_filtering=True,id=64bc8d35-4c9d-40db-ac46-46d6a3476698,network=Network(5febf498-f447-4e3b-a484-320124bd0158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bc8d35-4c') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG os_vif [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:73:22,bridge_name='br-int',has_traffic_filtering=True,id=64bc8d35-4c9d-40db-ac46-46d6a3476698,network=Network(5febf498-f447-4e3b-a484-320124bd0158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bc8d35-4c') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'feffbabc-011b-5b66-b1c1-387905705513', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64bc8d35-4c, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64bc8d35-4c, col_values=(('qos', UUID('581bcd6d-ee82-45d3-be5a-f9a6a31cdea5')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64bc8d35-4c, col_values=(('external_ids', {'iface-id': '64bc8d35-4c9d-40db-ac46-46d6a3476698', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:73:22', 'vm-uuid': '2d9a5b2b-7196-4ec9-8afc-cac356fe1495'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:42 user nova-compute[74805]: INFO os_vif [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:73:22,bridge_name='br-int',has_traffic_filtering=True,id=64bc8d35-4c9d-40db-ac46-46d6a3476698,network=Network(5febf498-f447-4e3b-a484-320124bd0158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bc8d35-4c')
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:33:42 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] No VIF found with MAC fa:16:3e:22:73:22, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:33:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:43 user nova-compute[74805]: DEBUG nova.compute.manager [req-cd71d568-2072-4e96-91a9-80e2537e7229 req-2ec869f4-1b53-4dec-9fe7-23eaf69c20a7 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Received event network-vif-plugged-64bc8d35-4c9d-40db-ac46-46d6a3476698 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:33:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-cd71d568-2072-4e96-91a9-80e2537e7229 req-2ec869f4-1b53-4dec-9fe7-23eaf69c20a7 service nova] Acquiring lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:33:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-cd71d568-2072-4e96-91a9-80e2537e7229 req-2ec869f4-1b53-4dec-9fe7-23eaf69c20a7 service nova] Lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:33:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-cd71d568-2072-4e96-91a9-80e2537e7229 req-2ec869f4-1b53-4dec-9fe7-23eaf69c20a7 service nova] Lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:33:43 user nova-compute[74805]: DEBUG nova.compute.manager [req-cd71d568-2072-4e96-91a9-80e2537e7229 req-2ec869f4-1b53-4dec-9fe7-23eaf69c20a7 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] No waiting events found dispatching network-vif-plugged-64bc8d35-4c9d-40db-ac46-46d6a3476698 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:33:43 user nova-compute[74805]: WARNING nova.compute.manager [req-cd71d568-2072-4e96-91a9-80e2537e7229 req-2ec869f4-1b53-4dec-9fe7-23eaf69c20a7 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Received unexpected event network-vif-plugged-64bc8d35-4c9d-40db-ac46-46d6a3476698 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 04:33:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:45 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:33:45 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:33:45 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Instance spawned successfully.
Nov 15 04:33:46 user nova-compute[74805]: DEBUG nova.compute.manager [req-9871a138-b43f-4685-9206-6eaf785c2384 req-1ef6bdf6-dc55-4e64-aaf5-d1c7a3e1e262 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Received event network-vif-plugged-64bc8d35-4c9d-40db-ac46-46d6a3476698 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:33:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9871a138-b43f-4685-9206-6eaf785c2384 req-1ef6bdf6-dc55-4e64-aaf5-d1c7a3e1e262 service nova] Acquiring lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:33:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9871a138-b43f-4685-9206-6eaf785c2384 req-1ef6bdf6-dc55-4e64-aaf5-d1c7a3e1e262 service nova] Lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:33:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9871a138-b43f-4685-9206-6eaf785c2384 req-1ef6bdf6-dc55-4e64-aaf5-d1c7a3e1e262 service nova] Lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:33:46 user nova-compute[74805]: DEBUG nova.compute.manager [req-9871a138-b43f-4685-9206-6eaf785c2384 req-1ef6bdf6-dc55-4e64-aaf5-d1c7a3e1e262 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] No waiting events found dispatching network-vif-plugged-64bc8d35-4c9d-40db-ac46-46d6a3476698 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:33:46 user nova-compute[74805]: WARNING nova.compute.manager [req-9871a138-b43f-4685-9206-6eaf785c2384 req-1ef6bdf6-dc55-4e64-aaf5-d1c7a3e1e262 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Received unexpected event network-vif-plugged-64bc8d35-4c9d-40db-ac46-46d6a3476698 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 04:33:46 user nova-compute[74805]: DEBUG nova.compute.manager [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:33:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0bafbfea-2a4e-44f1-92c9-809d9d0e8942 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.154s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:33:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:33:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:34:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:34:08 user nova-compute[74805]: DEBUG nova.compute.manager [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:34:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:34:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:34:08 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:34:08 user nova-compute[74805]: INFO nova.compute.claims [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Claim successful on node user
Nov 15 04:34:08 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:34:08 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:34:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.305s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:34:08 user nova-compute[74805]: DEBUG nova.compute.manager [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:34:08 user nova-compute[74805]: DEBUG nova.compute.manager [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:34:08 user nova-compute[74805]: DEBUG nova.network.neutron [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:34:08 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:34:08 user nova-compute[74805]: DEBUG nova.compute.manager [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG nova.policy [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6da72213d3ae446088876b3a3c34f976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fc455c6c7049d79a5c64451c126d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG nova.compute.manager [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:34:09 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Creating image(s)
Nov 15 04:34:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "/opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "/opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "/opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG nova.compute.manager [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:34:09 user nova-compute[74805]: INFO nova.compute.claims [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Claim successful on node user
Nov 15 04:34:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk 1073741824" returned: 0 in 0.050s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG nova.network.neutron [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Successfully created port: 39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Checking if we can resize image /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.544s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG nova.compute.manager [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG nova.compute.manager [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG nova.network.neutron [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Cannot resize image /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Ensure instance console log exists: /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:34:09 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:34:09 user nova-compute[74805]: DEBUG nova.compute.manager [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG nova.policy [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6da72213d3ae446088876b3a3c34f976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fc455c6c7049d79a5c64451c126d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG nova.compute.manager [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:34:09 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Creating image(s)
Nov 15 04:34:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "/opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "/opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "/opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:34:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.196s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:34:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:34:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.213s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk 1073741824" returned: 0 in 0.056s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:34:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:10 user nova-compute[74805]: DEBUG nova.network.neutron [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Successfully created port: 4d9bd2e9-b1dc-4fc8-b045-6e5513061c22 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:34:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:10 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:34:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:10 user nova-compute[74805]: DEBUG nova.network.neutron [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Successfully updated port: 39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:34:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "refresh_cache-75731a3d-3c78-4014-a8dc-f38c3d7b3305" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:34:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquired lock "refresh_cache-75731a3d-3c78-4014-a8dc-f38c3d7b3305" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:34:10 user nova-compute[74805]: DEBUG nova.network.neutron [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:34:10 user nova-compute[74805]: DEBUG nova.compute.manager [req-7e3fd703-0af4-479e-a37f-28e50ffce4ec req-6ca9c910-5cc5-460c-a02e-5a0ac4666552 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received event network-changed-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:34:10 user nova-compute[74805]: DEBUG nova.compute.manager [req-7e3fd703-0af4-479e-a37f-28e50ffce4ec req-6ca9c910-5cc5-460c-a02e-5a0ac4666552 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Refreshing instance network info cache due to event network-changed-39aa6c19-c319-4f9d-ac4e-a1deccecc95a. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:34:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7e3fd703-0af4-479e-a37f-28e50ffce4ec req-6ca9c910-5cc5-460c-a02e-5a0ac4666552 service nova] Acquiring lock "refresh_cache-75731a3d-3c78-4014-a8dc-f38c3d7b3305" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:34:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:10 user nova-compute[74805]: DEBUG nova.network.neutron [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:34:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:10 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Cannot resize image /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:34:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:34:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Ensure instance console log exists: /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:34:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:34:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:34:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.network.neutron [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Updating instance_info_cache with network_info: [{"id": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "address": "fa:16:3e:8f:e3:f6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39aa6c19-c3", "ovs_interfaceid": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Releasing lock "refresh_cache-75731a3d-3c78-4014-a8dc-f38c3d7b3305" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.compute.manager [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Instance network_info: |[{"id": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "address": "fa:16:3e:8f:e3:f6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39aa6c19-c3", "ovs_interfaceid": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7e3fd703-0af4-479e-a37f-28e50ffce4ec req-6ca9c910-5cc5-460c-a02e-5a0ac4666552 service nova] Acquired lock "refresh_cache-75731a3d-3c78-4014-a8dc-f38c3d7b3305" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.network.neutron [req-7e3fd703-0af4-479e-a37f-28e50ffce4ec req-6ca9c910-5cc5-460c-a02e-5a0ac4666552 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Refreshing network info cache for port 39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Start _get_guest_xml network_info=[{"id": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "address": "fa:16:3e:8f:e3:f6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39aa6c19-c3", "ovs_interfaceid": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:34:11 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:34:11 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:34:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2014027379',display_name='tempest-ServerRescueNegativeTestJSON-server-2014027379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2014027379',id=41,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66fc455c6c7049d79a5c64451c126d56',ramdisk_id='',reservation_id='r-xszr1u4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-370335706',owner_user_name='tempest-ServerRescueNegativeTestJSON-370335706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:34:09Z,user_data=None,user_id='6da72213d3ae446088876b3a3c34f976',uuid=75731a3d-3c78-4014-a8dc-f38c3d7b3305,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "address": "fa:16:3e:8f:e3:f6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39aa6c19-c3", "ovs_interfaceid": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Converting VIF {"id": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "address": "fa:16:3e:8f:e3:f6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39aa6c19-c3", "ovs_interfaceid": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:e3:f6,bridge_name='br-int',has_traffic_filtering=True,id=39aa6c19-c319-4f9d-ac4e-a1deccecc95a,network=Network(98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39aa6c19-c3') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.objects.instance [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lazy-loading 'pci_devices' on Instance uuid 75731a3d-3c78-4014-a8dc-f38c3d7b3305 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:34:11 user nova-compute[74805]:   <uuid>75731a3d-3c78-4014-a8dc-f38c3d7b3305</uuid>
Nov 15 04:34:11 user nova-compute[74805]:   <name>instance-00000029</name>
Nov 15 04:34:11 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:34:11 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:34:11 user nova-compute[74805]:   <metadata>
Nov 15 04:34:11 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:34:11 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:34:11 user nova-compute[74805]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2014027379</nova:name>
Nov 15 04:34:11 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:34:11</nova:creationTime>
Nov 15 04:34:11 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:34:11 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:34:11 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:34:11 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:34:11 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:34:11 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:34:11 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:34:11 user nova-compute[74805]:       <nova:owner>
Nov 15 04:34:11 user nova-compute[74805]:         <nova:user uuid="6da72213d3ae446088876b3a3c34f976">tempest-ServerRescueNegativeTestJSON-370335706-project-member</nova:user>
Nov 15 04:34:11 user nova-compute[74805]:         <nova:project uuid="66fc455c6c7049d79a5c64451c126d56">tempest-ServerRescueNegativeTestJSON-370335706</nova:project>
Nov 15 04:34:11 user nova-compute[74805]:       </nova:owner>
Nov 15 04:34:11 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:34:11 user nova-compute[74805]:       <nova:ports>
Nov 15 04:34:11 user nova-compute[74805]:         <nova:port uuid="39aa6c19-c319-4f9d-ac4e-a1deccecc95a">
Nov 15 04:34:11 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 04:34:11 user nova-compute[74805]:         </nova:port>
Nov 15 04:34:11 user nova-compute[74805]:       </nova:ports>
Nov 15 04:34:11 user nova-compute[74805]:     </nova:instance>
Nov 15 04:34:11 user nova-compute[74805]:   </metadata>
Nov 15 04:34:11 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:34:11 user nova-compute[74805]:     <system>
Nov 15 04:34:11 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:34:11 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:34:11 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:34:11 user nova-compute[74805]:       <entry name="serial">75731a3d-3c78-4014-a8dc-f38c3d7b3305</entry>
Nov 15 04:34:11 user nova-compute[74805]:       <entry name="uuid">75731a3d-3c78-4014-a8dc-f38c3d7b3305</entry>
Nov 15 04:34:11 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:34:11 user nova-compute[74805]:     </system>
Nov 15 04:34:11 user nova-compute[74805]:   </sysinfo>
Nov 15 04:34:11 user nova-compute[74805]:   <os>
Nov 15 04:34:11 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:34:11 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:34:11 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:34:11 user nova-compute[74805]:   </os>
Nov 15 04:34:11 user nova-compute[74805]:   <features>
Nov 15 04:34:11 user nova-compute[74805]:     <acpi/>
Nov 15 04:34:11 user nova-compute[74805]:     <apic/>
Nov 15 04:34:11 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:34:11 user nova-compute[74805]:   </features>
Nov 15 04:34:11 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:34:11 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:34:11 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:34:11 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:34:11 user nova-compute[74805]:   </clock>
Nov 15 04:34:11 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:34:11 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:34:11 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:34:11 user nova-compute[74805]:   </cpu>
Nov 15 04:34:11 user nova-compute[74805]:   <devices>
Nov 15 04:34:11 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:34:11 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:34:11 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk"/>
Nov 15 04:34:11 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:34:11 user nova-compute[74805]:     </disk>
Nov 15 04:34:11 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:34:11 user nova-compute[74805]:       <mac address="fa:16:3e:8f:e3:f6"/>
Nov 15 04:34:11 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:34:11 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:34:11 user nova-compute[74805]:       <target dev="tap39aa6c19-c3"/>
Nov 15 04:34:11 user nova-compute[74805]:     </interface>
Nov 15 04:34:11 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:34:11 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/console.log" append="off"/>
Nov 15 04:34:11 user nova-compute[74805]:     </serial>
Nov 15 04:34:11 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:34:11 user nova-compute[74805]:     <video>
Nov 15 04:34:11 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:34:11 user nova-compute[74805]:     </video>
Nov 15 04:34:11 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:34:11 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:34:11 user nova-compute[74805]:     </rng>
Nov 15 04:34:11 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:34:11 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:34:11 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:34:11 user nova-compute[74805]:     </memballoon>
Nov 15 04:34:11 user nova-compute[74805]:   </devices>
Nov 15 04:34:11 user nova-compute[74805]: </domain>
Nov 15 04:34:11 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:34:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2014027379',display_name='tempest-ServerRescueNegativeTestJSON-server-2014027379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2014027379',id=41,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66fc455c6c7049d79a5c64451c126d56',ramdisk_id='',reservation_id='r-xszr1u4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-370335706',owner_user_name='tempest-ServerRescueNegativeTestJSON-370335706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:34:09Z,user_data=None,user_id='6da72213d3ae446088876b3a3c34f976',uuid=75731a3d-3c78-4014-a8dc-f38c3d7b3305,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "address": "fa:16:3e:8f:e3:f6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39aa6c19-c3", "ovs_interfaceid": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Converting VIF {"id": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "address": "fa:16:3e:8f:e3:f6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39aa6c19-c3", "ovs_interfaceid": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:e3:f6,bridge_name='br-int',has_traffic_filtering=True,id=39aa6c19-c319-4f9d-ac4e-a1deccecc95a,network=Network(98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39aa6c19-c3') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG os_vif [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:e3:f6,bridge_name='br-int',has_traffic_filtering=True,id=39aa6c19-c319-4f9d-ac4e-a1deccecc95a,network=Network(98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39aa6c19-c3') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82099214-5511-503f-8906-e4c0a56653f8', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39aa6c19-c3, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap39aa6c19-c3, col_values=(('qos', UUID('3727c9c1-77fd-4274-bb83-adc36c8c7d60')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap39aa6c19-c3, col_values=(('external_ids', {'iface-id': '39aa6c19-c319-4f9d-ac4e-a1deccecc95a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:e3:f6', 'vm-uuid': '75731a3d-3c78-4014-a8dc-f38c3d7b3305'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:11 user nova-compute[74805]: INFO os_vif [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:e3:f6,bridge_name='br-int',has_traffic_filtering=True,id=39aa6c19-c319-4f9d-ac4e-a1deccecc95a,network=Network(98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39aa6c19-c3')
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.network.neutron [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Successfully updated port: 4d9bd2e9-b1dc-4fc8-b045-6e5513061c22 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "refresh_cache-01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquired lock "refresh_cache-01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.network.neutron [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] No VIF found with MAC fa:16:3e:8f:e3:f6, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.compute.manager [req-dc447ed5-e908-4a37-8dea-bf1dbc96ed78 req-498c8455-c90f-497b-b6a0-4b0df6617a2f service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Received event network-changed-4d9bd2e9-b1dc-4fc8-b045-6e5513061c22 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.compute.manager [req-dc447ed5-e908-4a37-8dea-bf1dbc96ed78 req-498c8455-c90f-497b-b6a0-4b0df6617a2f service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Refreshing instance network info cache due to event network-changed-4d9bd2e9-b1dc-4fc8-b045-6e5513061c22. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-dc447ed5-e908-4a37-8dea-bf1dbc96ed78 req-498c8455-c90f-497b-b6a0-4b0df6617a2f service nova] Acquiring lock "refresh_cache-01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.network.neutron [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.network.neutron [req-7e3fd703-0af4-479e-a37f-28e50ffce4ec req-6ca9c910-5cc5-460c-a02e-5a0ac4666552 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Updated VIF entry in instance network info cache for port 39aa6c19-c319-4f9d-ac4e-a1deccecc95a. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.network.neutron [req-7e3fd703-0af4-479e-a37f-28e50ffce4ec req-6ca9c910-5cc5-460c-a02e-5a0ac4666552 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Updating instance_info_cache with network_info: [{"id": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "address": "fa:16:3e:8f:e3:f6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39aa6c19-c3", "ovs_interfaceid": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7e3fd703-0af4-479e-a37f-28e50ffce4ec req-6ca9c910-5cc5-460c-a02e-5a0ac4666552 service nova] Releasing lock "refresh_cache-75731a3d-3c78-4014-a8dc-f38c3d7b3305" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.network.neutron [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Updating instance_info_cache with network_info: [{"id": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "address": "fa:16:3e:c6:13:c6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9bd2e9-b1", "ovs_interfaceid": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Releasing lock "refresh_cache-01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.compute.manager [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Instance network_info: |[{"id": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "address": "fa:16:3e:c6:13:c6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9bd2e9-b1", "ovs_interfaceid": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-dc447ed5-e908-4a37-8dea-bf1dbc96ed78 req-498c8455-c90f-497b-b6a0-4b0df6617a2f service nova] Acquired lock "refresh_cache-01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.network.neutron [req-dc447ed5-e908-4a37-8dea-bf1dbc96ed78 req-498c8455-c90f-497b-b6a0-4b0df6617a2f service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Refreshing network info cache for port 4d9bd2e9-b1dc-4fc8-b045-6e5513061c22 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Start _get_guest_xml network_info=[{"id": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "address": "fa:16:3e:c6:13:c6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9bd2e9-b1", "ovs_interfaceid": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:34:11 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:34:11 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:34:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-715241780',display_name='tempest-ServerRescueNegativeTestJSON-server-715241780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-715241780',id=42,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66fc455c6c7049d79a5c64451c126d56',ramdisk_id='',reservation_id='r-nfy5l0dx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-370335706',owner_user_name='tempest-ServerRescueNegativeTestJSON-370335706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:34:10Z,user_data=None,user_id='6da72213d3ae446088876b3a3c34f976',uuid=01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "address": "fa:16:3e:c6:13:c6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9bd2e9-b1", "ovs_interfaceid": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Converting VIF {"id": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "address": "fa:16:3e:c6:13:c6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9bd2e9-b1", "ovs_interfaceid": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:13:c6,bridge_name='br-int',has_traffic_filtering=True,id=4d9bd2e9-b1dc-4fc8-b045-6e5513061c22,network=Network(98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d9bd2e9-b1') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.objects.instance [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lazy-loading 'pci_devices' on Instance uuid 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:34:11 user nova-compute[74805]:   <uuid>01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af</uuid>
Nov 15 04:34:11 user nova-compute[74805]:   <name>instance-0000002a</name>
Nov 15 04:34:11 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:34:11 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:34:11 user nova-compute[74805]:   <metadata>
Nov 15 04:34:11 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:34:11 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:34:11 user nova-compute[74805]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-715241780</nova:name>
Nov 15 04:34:11 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:34:11</nova:creationTime>
Nov 15 04:34:11 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:34:11 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:34:11 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:34:11 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:34:11 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:34:11 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:34:11 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:34:11 user nova-compute[74805]:       <nova:owner>
Nov 15 04:34:11 user nova-compute[74805]:         <nova:user uuid="6da72213d3ae446088876b3a3c34f976">tempest-ServerRescueNegativeTestJSON-370335706-project-member</nova:user>
Nov 15 04:34:11 user nova-compute[74805]:         <nova:project uuid="66fc455c6c7049d79a5c64451c126d56">tempest-ServerRescueNegativeTestJSON-370335706</nova:project>
Nov 15 04:34:11 user nova-compute[74805]:       </nova:owner>
Nov 15 04:34:11 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:34:11 user nova-compute[74805]:       <nova:ports>
Nov 15 04:34:11 user nova-compute[74805]:         <nova:port uuid="4d9bd2e9-b1dc-4fc8-b045-6e5513061c22">
Nov 15 04:34:11 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 04:34:11 user nova-compute[74805]:         </nova:port>
Nov 15 04:34:11 user nova-compute[74805]:       </nova:ports>
Nov 15 04:34:11 user nova-compute[74805]:     </nova:instance>
Nov 15 04:34:11 user nova-compute[74805]:   </metadata>
Nov 15 04:34:11 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:34:11 user nova-compute[74805]:     <system>
Nov 15 04:34:11 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:34:11 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:34:11 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:34:11 user nova-compute[74805]:       <entry name="serial">01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af</entry>
Nov 15 04:34:11 user nova-compute[74805]:       <entry name="uuid">01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af</entry>
Nov 15 04:34:11 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:34:11 user nova-compute[74805]:     </system>
Nov 15 04:34:11 user nova-compute[74805]:   </sysinfo>
Nov 15 04:34:11 user nova-compute[74805]:   <os>
Nov 15 04:34:11 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:34:11 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:34:11 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:34:11 user nova-compute[74805]:   </os>
Nov 15 04:34:11 user nova-compute[74805]:   <features>
Nov 15 04:34:11 user nova-compute[74805]:     <acpi/>
Nov 15 04:34:11 user nova-compute[74805]:     <apic/>
Nov 15 04:34:11 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:34:11 user nova-compute[74805]:   </features>
Nov 15 04:34:11 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:34:11 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:34:11 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:34:11 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:34:11 user nova-compute[74805]:   </clock>
Nov 15 04:34:11 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:34:11 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:34:11 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:34:11 user nova-compute[74805]:   </cpu>
Nov 15 04:34:11 user nova-compute[74805]:   <devices>
Nov 15 04:34:11 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:34:11 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:34:11 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk"/>
Nov 15 04:34:11 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:34:11 user nova-compute[74805]:     </disk>
Nov 15 04:34:11 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:34:11 user nova-compute[74805]:       <mac address="fa:16:3e:c6:13:c6"/>
Nov 15 04:34:11 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:34:11 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:34:11 user nova-compute[74805]:       <target dev="tap4d9bd2e9-b1"/>
Nov 15 04:34:11 user nova-compute[74805]:     </interface>
Nov 15 04:34:11 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:34:11 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/console.log" append="off"/>
Nov 15 04:34:11 user nova-compute[74805]:     </serial>
Nov 15 04:34:11 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:34:11 user nova-compute[74805]:     <video>
Nov 15 04:34:11 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:34:11 user nova-compute[74805]:     </video>
Nov 15 04:34:11 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:34:11 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:34:11 user nova-compute[74805]:     </rng>
Nov 15 04:34:11 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:34:11 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:34:11 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:34:11 user nova-compute[74805]:     </memballoon>
Nov 15 04:34:11 user nova-compute[74805]:   </devices>
Nov 15 04:34:11 user nova-compute[74805]: </domain>
Nov 15 04:34:11 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:34:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-715241780',display_name='tempest-ServerRescueNegativeTestJSON-server-715241780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-715241780',id=42,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66fc455c6c7049d79a5c64451c126d56',ramdisk_id='',reservation_id='r-nfy5l0dx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-370335706',owner_user_name='tempest-ServerRescueNegativeTestJSON-370335706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:34:10Z,user_data=None,user_id='6da72213d3ae446088876b3a3c34f976',uuid=01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "address": "fa:16:3e:c6:13:c6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9bd2e9-b1", "ovs_interfaceid": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Converting VIF {"id": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "address": "fa:16:3e:c6:13:c6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9bd2e9-b1", "ovs_interfaceid": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:13:c6,bridge_name='br-int',has_traffic_filtering=True,id=4d9bd2e9-b1dc-4fc8-b045-6e5513061c22,network=Network(98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d9bd2e9-b1') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG os_vif [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:13:c6,bridge_name='br-int',has_traffic_filtering=True,id=4d9bd2e9-b1dc-4fc8-b045-6e5513061c22,network=Network(98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d9bd2e9-b1') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c177a562-658b-5603-8ddc-754eb225a724', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d9bd2e9-b1, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d9bd2e9-b1, col_values=(('qos', UUID('3f4104bb-eca2-4f93-b758-dcc41c1f2939')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d9bd2e9-b1, col_values=(('external_ids', {'iface-id': '4d9bd2e9-b1dc-4fc8-b045-6e5513061c22', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:13:c6', 'vm-uuid': '01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:11 user nova-compute[74805]: INFO os_vif [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:13:c6,bridge_name='br-int',has_traffic_filtering=True,id=4d9bd2e9-b1dc-4fc8-b045-6e5513061c22,network=Network(98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d9bd2e9-b1')
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] No VIF found with MAC fa:16:3e:c6:13:c6, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.network.neutron [req-dc447ed5-e908-4a37-8dea-bf1dbc96ed78 req-498c8455-c90f-497b-b6a0-4b0df6617a2f service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Updated VIF entry in instance network info cache for port 4d9bd2e9-b1dc-4fc8-b045-6e5513061c22. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG nova.network.neutron [req-dc447ed5-e908-4a37-8dea-bf1dbc96ed78 req-498c8455-c90f-497b-b6a0-4b0df6617a2f service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Updating instance_info_cache with network_info: [{"id": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "address": "fa:16:3e:c6:13:c6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9bd2e9-b1", "ovs_interfaceid": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:34:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-dc447ed5-e908-4a37-8dea-bf1dbc96ed78 req-498c8455-c90f-497b-b6a0-4b0df6617a2f service nova] Releasing lock "refresh_cache-01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:34:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:13 user nova-compute[74805]: DEBUG nova.compute.manager [req-9cfefdc9-6348-47d6-a002-a1bd9678854c req-7077d174-80f2-44bd-9ab2-b781aca43800 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received event network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:34:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9cfefdc9-6348-47d6-a002-a1bd9678854c req-7077d174-80f2-44bd-9ab2-b781aca43800 service nova] Acquiring lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:34:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9cfefdc9-6348-47d6-a002-a1bd9678854c req-7077d174-80f2-44bd-9ab2-b781aca43800 service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:34:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9cfefdc9-6348-47d6-a002-a1bd9678854c req-7077d174-80f2-44bd-9ab2-b781aca43800 service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:34:13 user nova-compute[74805]: DEBUG nova.compute.manager [req-9cfefdc9-6348-47d6-a002-a1bd9678854c req-7077d174-80f2-44bd-9ab2-b781aca43800 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] No waiting events found dispatching network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:34:13 user nova-compute[74805]: WARNING nova.compute.manager [req-9cfefdc9-6348-47d6-a002-a1bd9678854c req-7077d174-80f2-44bd-9ab2-b781aca43800 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received unexpected event network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a for instance with vm_state building and task_state spawning.
Nov 15 04:34:13 user nova-compute[74805]: DEBUG nova.compute.manager [req-9cfefdc9-6348-47d6-a002-a1bd9678854c req-7077d174-80f2-44bd-9ab2-b781aca43800 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received event network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:34:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9cfefdc9-6348-47d6-a002-a1bd9678854c req-7077d174-80f2-44bd-9ab2-b781aca43800 service nova] Acquiring lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:34:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9cfefdc9-6348-47d6-a002-a1bd9678854c req-7077d174-80f2-44bd-9ab2-b781aca43800 service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:34:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9cfefdc9-6348-47d6-a002-a1bd9678854c req-7077d174-80f2-44bd-9ab2-b781aca43800 service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:34:13 user nova-compute[74805]: DEBUG nova.compute.manager [req-9cfefdc9-6348-47d6-a002-a1bd9678854c req-7077d174-80f2-44bd-9ab2-b781aca43800 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] No waiting events found dispatching network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:34:13 user nova-compute[74805]: WARNING nova.compute.manager [req-9cfefdc9-6348-47d6-a002-a1bd9678854c req-7077d174-80f2-44bd-9ab2-b781aca43800 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received unexpected event network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a for instance with vm_state building and task_state spawning.
Nov 15 04:34:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:14 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:34:14 user nova-compute[74805]: DEBUG nova.compute.manager [req-a4fb63cc-65ed-4fd4-83d9-dfd88ba8a231 req-3819b377-5965-4680-b707-391641f111dd service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Received event network-vif-plugged-4d9bd2e9-b1dc-4fc8-b045-6e5513061c22 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:34:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-a4fb63cc-65ed-4fd4-83d9-dfd88ba8a231 req-3819b377-5965-4680-b707-391641f111dd service nova] Acquiring lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:34:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-a4fb63cc-65ed-4fd4-83d9-dfd88ba8a231 req-3819b377-5965-4680-b707-391641f111dd service nova] Lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:34:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-a4fb63cc-65ed-4fd4-83d9-dfd88ba8a231 req-3819b377-5965-4680-b707-391641f111dd service nova] Lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:34:14 user nova-compute[74805]: DEBUG nova.compute.manager [req-a4fb63cc-65ed-4fd4-83d9-dfd88ba8a231 req-3819b377-5965-4680-b707-391641f111dd service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] No waiting events found dispatching network-vif-plugged-4d9bd2e9-b1dc-4fc8-b045-6e5513061c22 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:34:14 user nova-compute[74805]: WARNING nova.compute.manager [req-a4fb63cc-65ed-4fd4-83d9-dfd88ba8a231 req-3819b377-5965-4680-b707-391641f111dd service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Received unexpected event network-vif-plugged-4d9bd2e9-b1dc-4fc8-b045-6e5513061c22 for instance with vm_state building and task_state spawning.
Nov 15 04:34:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:16 user nova-compute[74805]: DEBUG nova.compute.manager [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:34:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:34:16 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Instance spawned successfully.
Nov 15 04:34:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:34:16 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:34:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:34:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:34:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:34:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:34:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:34:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:34:16 user nova-compute[74805]: DEBUG nova.compute.manager [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:34:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:34:16 user nova-compute[74805]: INFO nova.compute.manager [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Took 7.15 seconds to spawn the instance on the hypervisor.
Nov 15 04:34:16 user nova-compute[74805]: DEBUG nova.compute.manager [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:34:16 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Instance spawned successfully.
Nov 15 04:34:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:34:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:34:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:34:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:34:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:34:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:34:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:34:16 user nova-compute[74805]: INFO nova.compute.manager [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Took 7.77 seconds to build instance.
Nov 15 04:34:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6de6a115-21bb-4e4f-983d-2b60b9b7e3ea tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.856s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:34:16 user nova-compute[74805]: INFO nova.compute.manager [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Took 6.32 seconds to spawn the instance on the hypervisor.
Nov 15 04:34:16 user nova-compute[74805]: DEBUG nova.compute.manager [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:34:16 user nova-compute[74805]: DEBUG nova.compute.manager [req-be3a64c1-58b8-4da9-a404-990409d0daa8 req-4aae1bdf-a9e9-4a7b-b641-631d4e7ee4db service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Received event network-vif-plugged-4d9bd2e9-b1dc-4fc8-b045-6e5513061c22 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:34:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-be3a64c1-58b8-4da9-a404-990409d0daa8 req-4aae1bdf-a9e9-4a7b-b641-631d4e7ee4db service nova] Acquiring lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:34:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-be3a64c1-58b8-4da9-a404-990409d0daa8 req-4aae1bdf-a9e9-4a7b-b641-631d4e7ee4db service nova] Lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:34:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-be3a64c1-58b8-4da9-a404-990409d0daa8 req-4aae1bdf-a9e9-4a7b-b641-631d4e7ee4db service nova] Lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:34:16 user nova-compute[74805]: DEBUG nova.compute.manager [req-be3a64c1-58b8-4da9-a404-990409d0daa8 req-4aae1bdf-a9e9-4a7b-b641-631d4e7ee4db service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] No waiting events found dispatching network-vif-plugged-4d9bd2e9-b1dc-4fc8-b045-6e5513061c22 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:34:16 user nova-compute[74805]: WARNING nova.compute.manager [req-be3a64c1-58b8-4da9-a404-990409d0daa8 req-4aae1bdf-a9e9-4a7b-b641-631d4e7ee4db service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Received unexpected event network-vif-plugged-4d9bd2e9-b1dc-4fc8-b045-6e5513061c22 for instance with vm_state building and task_state spawning.
Nov 15 04:34:16 user nova-compute[74805]: INFO nova.compute.manager [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Took 7.20 seconds to build instance.
Nov 15 04:34:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-08070db0-ccdb-4087-ae0e-b7fb39696cff tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.300s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:34:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "a2875e85-f7ff-445d-ac92-133ef145ec93" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:34:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "a2875e85-f7ff-445d-ac92-133ef145ec93" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:34:17 user nova-compute[74805]: DEBUG nova.objects.instance [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lazy-loading 'flavor' on Instance uuid a2875e85-f7ff-445d-ac92-133ef145ec93 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:34:17 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Ignoring supplied device name: /dev/vdb
Nov 15 04:34:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "a2875e85-f7ff-445d-ac92-133ef145ec93" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:34:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "a2875e85-f7ff-445d-ac92-133ef145ec93" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:34:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "a2875e85-f7ff-445d-ac92-133ef145ec93" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:34:17 user nova-compute[74805]: INFO nova.compute.manager [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Attaching volume 9cd3dab2-cc09-45cc-81e9-02f649c345a6 to /dev/vdb
Nov 15 04:34:17 user nova-compute[74805]: DEBUG os_brick.utils [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:34:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:17 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90bd199-cfc8-41a7-b56a-9eb1af1fd462]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:17 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd2e22e-7457-4ad2-bcf9-4cfe8ba7aed0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:17 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0431cd1f-3c5d-48b4-acc5-b0e8d840f3c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:17 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c742401d-b0a1-499d-8549-ab29b835ae26]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:34:17 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:34:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:34:17 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:34:17 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c4517a-eaac-488a-849e-03b8a758a34b]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:17 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:34:17 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:34:17 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:34:17 user nova-compute[74805]: DEBUG os_brick.utils [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:34:17 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Updating existing volume attachment record: 2158c117-36ce-4b7e-89f0-86293b7ea7a4 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:34:18 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:34:18 user nova-compute[74805]: DEBUG nova.compute.manager [req-d3a33798-0fef-44bc-be61-de9a2a56b59c req-a44fb4f8-0ff0-488c-9662-4eadf8bfbb6f service nova] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Received event network-changed-1ed6482a-faf3-4cd0-b4ea-eb4140350a0a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:34:18 user nova-compute[74805]: DEBUG nova.compute.manager [req-d3a33798-0fef-44bc-be61-de9a2a56b59c req-a44fb4f8-0ff0-488c-9662-4eadf8bfbb6f service nova] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Refreshing instance network info cache due to event network-changed-1ed6482a-faf3-4cd0-b4ea-eb4140350a0a. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:34:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d3a33798-0fef-44bc-be61-de9a2a56b59c req-a44fb4f8-0ff0-488c-9662-4eadf8bfbb6f service nova] Acquiring lock "refresh_cache-a2875e85-f7ff-445d-ac92-133ef145ec93" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:34:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d3a33798-0fef-44bc-be61-de9a2a56b59c req-a44fb4f8-0ff0-488c-9662-4eadf8bfbb6f service nova] Acquired lock "refresh_cache-a2875e85-f7ff-445d-ac92-133ef145ec93" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:34:18 user nova-compute[74805]: DEBUG nova.network.neutron [req-d3a33798-0fef-44bc-be61-de9a2a56b59c req-a44fb4f8-0ff0-488c-9662-4eadf8bfbb6f service nova] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Refreshing network info cache for port 1ed6482a-faf3-4cd0-b4ea-eb4140350a0a {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:34:18 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b31e3d6d-9f98-4538-a425-a697049166d0 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:34:18 user nova-compute[74805]: INFO nova.compute.manager [None req-b31e3d6d-9f98-4538-a425-a697049166d0 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] instance snapshotting
Nov 15 04:34:18 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-b31e3d6d-9f98-4538-a425-a697049166d0 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Beginning live snapshot process
Nov 15 04:34:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b31e3d6d-9f98-4538-a425-a697049166d0 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json -f qcow2 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b31e3d6d-9f98-4538-a425-a697049166d0 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b31e3d6d-9f98-4538-a425-a697049166d0 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json -f qcow2 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:19 user nova-compute[74805]: DEBUG nova.network.neutron [req-d3a33798-0fef-44bc-be61-de9a2a56b59c req-a44fb4f8-0ff0-488c-9662-4eadf8bfbb6f service nova] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Updated VIF entry in instance network info cache for port 1ed6482a-faf3-4cd0-b4ea-eb4140350a0a. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:34:19 user nova-compute[74805]: DEBUG nova.network.neutron [req-d3a33798-0fef-44bc-be61-de9a2a56b59c req-a44fb4f8-0ff0-488c-9662-4eadf8bfbb6f service nova] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Updating instance_info_cache with network_info: [{"id": "1ed6482a-faf3-4cd0-b4ea-eb4140350a0a", "address": "fa:16:3e:3d:7f:62", "network": {"id": "56e28167-fe83-43e1-9efc-81f625e2b727", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760042206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3b66fd3bcaa4720a38b00388797825a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ed6482a-fa", "ovs_interfaceid": "1ed6482a-faf3-4cd0-b4ea-eb4140350a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:34:19 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:34:19 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:34:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d3a33798-0fef-44bc-be61-de9a2a56b59c req-a44fb4f8-0ff0-488c-9662-4eadf8bfbb6f service nova] Releasing lock "refresh_cache-a2875e85-f7ff-445d-ac92-133ef145ec93" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:34:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b31e3d6d-9f98-4538-a425-a697049166d0 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json -f qcow2" returned: 0 in 0.214s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b31e3d6d-9f98-4538-a425-a697049166d0 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b31e3d6d-9f98-4538-a425-a697049166d0 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.185s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b31e3d6d-9f98-4538-a425-a697049166d0 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplw_1s19f/74230ce01dcb4843880ffc0920c96645.delta 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b31e3d6d-9f98-4538-a425-a697049166d0 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplw_1s19f/74230ce01dcb4843880ffc0920c96645.delta 1073741824" returned: 0 in 0.058s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:19 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-b31e3d6d-9f98-4538-a425-a697049166d0 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 04:34:20 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:34:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:34:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:34:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:34:20 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:34:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-b31e3d6d-9f98-4538-a425-a697049166d0 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] COPY block job progress, current cursor: 196608 final cursor: 75497472 {{(pid=74805) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 04:34:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-b31e3d6d-9f98-4538-a425-a697049166d0 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74805) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 04:34:20 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-b31e3d6d-9f98-4538-a425-a697049166d0 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 04:34:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:20 user nova-compute[74805]: DEBUG nova.privsep.utils [None req-b31e3d6d-9f98-4538-a425-a697049166d0 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74805) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 04:34:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b31e3d6d-9f98-4538-a425-a697049166d0 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplw_1s19f/74230ce01dcb4843880ffc0920c96645.delta /opt/stack/data/nova/instances/snapshots/tmplw_1s19f/74230ce01dcb4843880ffc0920c96645 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json" returned: 0 in 0.337s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:34:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b31e3d6d-9f98-4538-a425-a697049166d0 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplw_1s19f/74230ce01dcb4843880ffc0920c96645.delta /opt/stack/data/nova/instances/snapshots/tmplw_1s19f/74230ce01dcb4843880ffc0920c96645" returned: 0 in 1.133s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:22 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-b31e3d6d-9f98-4538-a425-a697049166d0 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Snapshot extracted, beginning image upload
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2875e85-f7ff-445d-ac92-133ef145ec93/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'okyWAQlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:34:22 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:34:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:34:22 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:34:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:34:22 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a15012e-c807-49d1-a160-f0b2982b14cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:34:22 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d3934a-8f10-41af-822c-59859d95eab1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6] added
Nov 15 04:34:22 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25c339c-590a-41d2-95c0-fa12273fbfbb]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2875e85-f7ff-445d-ac92-133ef145ec93/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2875e85-f7ff-445d-ac92-133ef145ec93/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[77df7a1b-3844-46d2-a5cb-dce34d2d7e27]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v okyWAQlG {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v okyWAQlG" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19ca8cb-f4d7-40e4-bb2e-effca7f896c3]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'okyWAQlG'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f8ce1b-901d-4fba-ba72-9682fe452498]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d899a3f-6f23-47b1-9b3a-bf8694a3cd3b]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:34:22 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:34:22 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:34:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:23 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf785c1-7cf2-45fa-8203-0d8f3583023c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6, portal: 172.16.0.220,3260]
Nov 15 04:34:23 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6, portal: 172.16.0.220,3260] successful.
Nov 15 04:34:23 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:34:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2875e85-f7ff-445d-ac92-133ef145ec93/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:23 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d6c173-6b72-4a85-bd1d-d6986631e74f]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:34:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:23 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9846d9-ccfc-489e-8241-1cb7953d8693]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:34:23 user nova-compute[74805]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 (non-flash)
Nov 15 04:34:23 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:34:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:34:23 user nova-compute[74805]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 (non-flash)
Nov 15 04:34:23 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:34:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:34:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:34:23 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:34:23 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:34:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:23 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c62dfac-e3e0-4e38-b023-7bfa0517f284]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:23 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:34:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:23 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:34:23 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:34:23 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=8310MB free_disk=24.991622924804688GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:34:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:34:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.005s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:34:24 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 9f267864-0b72-431d-9b0d-c63436002a4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:34:24 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 38196606-a9c9-4604-ad21-2ec7511a8b28 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:34:24 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance a2875e85-f7ff-445d-ac92-133ef145ec93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:34:24 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 288a5e5c-f8e9-4507-b29c-93e7595922ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:34:24 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance f99a9557-4951-49f0-931c-0dbab16478d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:34:24 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 2d9a5b2b-7196-4ec9-8afc-cac356fe1495 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:34:24 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 75731a3d-3c78-4014-a8dc-f38c3d7b3305 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:34:24 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:34:24 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:34:24 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:34:24 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:34:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'okyWAQlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:34:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:34:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23064303265326366', 'path': '/dev/sdb'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:34:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064303265326366', 'path': '/dev/sdb'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:34:24 user nova-compute[74805]: DEBUG nova.objects.instance [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lazy-loading 'flavor' on Instance uuid a2875e85-f7ff-445d-ac92-133ef145ec93 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:34:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:34:24 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:34:24 user nova-compute[74805]:   <source dev="/dev/sdb"/>
Nov 15 04:34:24 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:34:24 user nova-compute[74805]:   <serial>9cd3dab2-cc09-45cc-81e9-02f649c345a6</serial>
Nov 15 04:34:24 user nova-compute[74805]: </disk>
Nov 15 04:34:24 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:34:24 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:34:24 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:34:24 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:34:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.431s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:34:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:34:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:34:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] No VIF found with MAC fa:16:3e:3d:7f:62, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:34:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-e9dd7a9e-add7-48c0-b491-7782c24e0d6a tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "a2875e85-f7ff-445d-ac92-133ef145ec93" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.528s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:34:24 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-b31e3d6d-9f98-4538-a425-a697049166d0 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Snapshot image upload complete
Nov 15 04:34:24 user nova-compute[74805]: INFO nova.compute.manager [None req-b31e3d6d-9f98-4538-a425-a697049166d0 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Took 6.26 seconds to snapshot the instance on the hypervisor.
Nov 15 04:34:25 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:34:25 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:34:25 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:34:25 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Rebuilding the list of instances to heal {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 04:34:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-9f267864-0b72-431d-9b0d-c63436002a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:34:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-9f267864-0b72-431d-9b0d-c63436002a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:34:25 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:34:25 user nova-compute[74805]: DEBUG nova.objects.instance [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lazy-loading 'info_cache' on Instance uuid 9f267864-0b72-431d-9b0d-c63436002a4c {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:34:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:25 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Updating instance_info_cache with network_info: [{"id": "bd5458e6-03d9-4fab-bbfb-23989a82c193", "address": "fa:16:3e:86:87:bc", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5458e6-03", "ovs_interfaceid": "bd5458e6-03d9-4fab-bbfb-23989a82c193", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:34:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-9f267864-0b72-431d-9b0d-c63436002a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:34:25 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:34:25 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:34:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:27 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:34:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:34:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "a2875e85-f7ff-445d-ac92-133ef145ec93" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:34:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "a2875e85-f7ff-445d-ac92-133ef145ec93" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:34:34 user nova-compute[74805]: INFO nova.compute.manager [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Detaching volume 9cd3dab2-cc09-45cc-81e9-02f649c345a6
Nov 15 04:34:34 user nova-compute[74805]: INFO nova.virt.block_device [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Attempting to driver detach volume 9cd3dab2-cc09-45cc-81e9-02f649c345a6 from mountpoint /dev/vdb
Nov 15 04:34:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Attempting to detach device vdb from instance a2875e85-f7ff-445d-ac92-133ef145ec93 from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:34:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:34:34 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:34:34 user nova-compute[74805]:   <source dev="/dev/sdb"/>
Nov 15 04:34:34 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:34:34 user nova-compute[74805]:   <serial>9cd3dab2-cc09-45cc-81e9-02f649c345a6</serial>
Nov 15 04:34:34 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:34:34 user nova-compute[74805]: </disk>
Nov 15 04:34:34 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:34:34 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Successfully detached device vdb from instance a2875e85-f7ff-445d-ac92-133ef145ec93 from the persistent domain config.
Nov 15 04:34:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a2875e85-f7ff-445d-ac92-133ef145ec93 from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:34:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:34:34 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:34:34 user nova-compute[74805]:   <source dev="/dev/sdb"/>
Nov 15 04:34:34 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:34:34 user nova-compute[74805]:   <serial>9cd3dab2-cc09-45cc-81e9-02f649c345a6</serial>
Nov 15 04:34:34 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:34:34 user nova-compute[74805]: </disk>
Nov 15 04:34:34 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:34:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "a2875e85-f7ff-445d-ac92-133ef145ec93" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:34:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a2875e85-f7ff-445d-ac92-133ef145ec93 {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:34:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:43 user nova-compute[74805]: DEBUG nova.compute.manager [req-7942bcd9-577c-4304-b937-e5515f8c73b7 req-b7d502f9-312e-494d-b634-490f553c9723 service nova] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Received event network-changed-36f925e7-241b-453e-84bd-a6dc8c213650 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:34:43 user nova-compute[74805]: DEBUG nova.compute.manager [req-7942bcd9-577c-4304-b937-e5515f8c73b7 req-b7d502f9-312e-494d-b634-490f553c9723 service nova] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Refreshing instance network info cache due to event network-changed-36f925e7-241b-453e-84bd-a6dc8c213650. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:34:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7942bcd9-577c-4304-b937-e5515f8c73b7 req-b7d502f9-312e-494d-b634-490f553c9723 service nova] Acquiring lock "refresh_cache-f99a9557-4951-49f0-931c-0dbab16478d8" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:34:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7942bcd9-577c-4304-b937-e5515f8c73b7 req-b7d502f9-312e-494d-b634-490f553c9723 service nova] Acquired lock "refresh_cache-f99a9557-4951-49f0-931c-0dbab16478d8" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:34:43 user nova-compute[74805]: DEBUG nova.network.neutron [req-7942bcd9-577c-4304-b937-e5515f8c73b7 req-b7d502f9-312e-494d-b634-490f553c9723 service nova] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Refreshing network info cache for port 36f925e7-241b-453e-84bd-a6dc8c213650 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:34:44 user nova-compute[74805]: DEBUG nova.network.neutron [req-7942bcd9-577c-4304-b937-e5515f8c73b7 req-b7d502f9-312e-494d-b634-490f553c9723 service nova] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Updated VIF entry in instance network info cache for port 36f925e7-241b-453e-84bd-a6dc8c213650. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:34:44 user nova-compute[74805]: DEBUG nova.network.neutron [req-7942bcd9-577c-4304-b937-e5515f8c73b7 req-b7d502f9-312e-494d-b634-490f553c9723 service nova] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Updating instance_info_cache with network_info: [{"id": "36f925e7-241b-453e-84bd-a6dc8c213650", "address": "fa:16:3e:f6:5f:e4", "network": {"id": "c5d73469-8aa8-4d7b-bee8-ffcedcaae340", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1298527383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8464c1b545064c9f8e5f20d23417ed48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f925e7-24", "ovs_interfaceid": "36f925e7-241b-453e-84bd-a6dc8c213650", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:34:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7942bcd9-577c-4304-b937-e5515f8c73b7 req-b7d502f9-312e-494d-b634-490f553c9723 service nova] Releasing lock "refresh_cache-f99a9557-4951-49f0-931c-0dbab16478d8" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:34:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "f99a9557-4951-49f0-931c-0dbab16478d8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:34:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:34:46 user nova-compute[74805]: DEBUG nova.objects.instance [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lazy-loading 'flavor' on Instance uuid f99a9557-4951-49f0-931c-0dbab16478d8 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:34:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:34:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "f99a9557-4951-49f0-931c-0dbab16478d8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:34:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:34:46 user nova-compute[74805]: INFO nova.compute.manager [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Attaching volume 9ea699c2-2e0e-4ed1-8226-684db5e391f5 to /dev/vdb
Nov 15 04:34:46 user nova-compute[74805]: DEBUG os_brick.utils [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:34:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[675cd7e0-99eb-4e3e-bae0-4e091bdf0b47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdefd3a2-107e-45b9-9377-c78080f4fa90]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f1344a-db16-4b95-a2ad-fec4bbf22b1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04c0149-e14a-425d-960f-d26c903887fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:34:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:34:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:34:46 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:34:46 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b16ea0-a3c5-4dd9-afd9-3b2dbfc99c80]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:34:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:34:46 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:34:46 user nova-compute[74805]: DEBUG os_brick.utils [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:34:46 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Updating existing volume attachment record: 61bcf446-cc45-4136-9e0b-e8d0c7d96b01 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:34:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:34:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yeVFbikq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:34:50 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:34:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:34:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:34:50 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:34:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:34:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:34:50 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:34:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d0dee4-5ec2-4a00-8154-38982a7077a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:34:50 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:34:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4121158e-5117-4121-84e0-cf44177f4ee9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5] added
Nov 15 04:34:50 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:34:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9a6c9b-17fa-4dd8-ad51-d034f23e5131]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:34:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3152fcaa-6dfc-4220-a60f-90d336992ca6]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:34:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yeVFbikq {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yeVFbikq" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fb9726-64eb-4ff7-b758-feac6a32bbd6]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yeVFbikq'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:34:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8d064b-6d7a-4829-a5f1-163417af7120]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4aaa04-36ed-4d22-93c1-7f72f8cde78c]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:34:51 user nova-compute[74805]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 (non-flash)
Nov 15 04:34:51 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:34:51 user nova-compute[74805]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 (non-flash)
Nov 15 04:34:51 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbba4bf-8315-421a-9c36-0e2b06cf8ef6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5, portal: 172.16.0.220,3260]
Nov 15 04:34:51 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5, portal: 172.16.0.220,3260] successful.
Nov 15 04:34:51 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8086107-f857-40b4-be39-b3d46575945c]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd531f5-9464-4234-ac30-934144d7b5da]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:34:51 user nova-compute[74805]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 (non-flash)
Nov 15 04:34:51 user nova-compute[74805]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 (non-flash)
Nov 15 04:34:51 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:34:51 user nova-compute[74805]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 (non-flash)
Nov 15 04:34:51 user nova-compute[74805]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 (non-flash)
Nov 15 04:34:51 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[728bd69e-0ba0-416c-bad8-55800baa4ed7]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yeVFbikq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:34:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:34:52 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26638393032616535', 'path': '/dev/sdc'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:34:52 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638393032616535', 'path': '/dev/sdc'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:34:52 user nova-compute[74805]: DEBUG nova.objects.instance [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lazy-loading 'flavor' on Instance uuid f99a9557-4951-49f0-931c-0dbab16478d8 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:34:52 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:34:52 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:34:52 user nova-compute[74805]:   <source dev="/dev/sdc"/>
Nov 15 04:34:52 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:34:52 user nova-compute[74805]:   <serial>9ea699c2-2e0e-4ed1-8226-684db5e391f5</serial>
Nov 15 04:34:52 user nova-compute[74805]: </disk>
Nov 15 04:34:52 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:34:52 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:34:52 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:34:52 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] No VIF found with MAC fa:16:3e:f6:5f:e4, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:34:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-82cd787d-5658-46e7-9003-4cb81f608e49 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.425s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:34:55 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a2875e85-f7ff-445d-ac92-133ef145ec93 is timed out.
Nov 15 04:34:55 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Successfully detached device vdb from instance a2875e85-f7ff-445d-ac92-133ef145ec93 from the live domain config.
Nov 15 04:34:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'okyWAQlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:34:55 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:34:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e330f5-4a46-4602-aa85-dad43a78020f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:34:55 user nova-compute[74805]: No targets found.
Nov 15 04:34:55 user nova-compute[74805]: iSNS:
Nov 15 04:34:55 user nova-compute[74805]: No targets found.
Nov 15 04:34:55 user nova-compute[74805]: STATIC:
Nov 15 04:34:55 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6
Nov 15 04:34:55 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:34:55 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:34:55 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5
Nov 15 04:34:55 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:34:55 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:34:55 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f
Nov 15 04:34:55 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:34:55 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:34:55 user nova-compute[74805]: FIRMWARE:
Nov 15 04:34:55 user nova-compute[74805]: No targets found.
Nov 15 04:34:55 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:34:55 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:34:55 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[636dccdb-deb9-464a-8d4c-42b92bfee835]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[145fced2-b16d-4787-a856-0a3b8c89c5ca]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:34:55 user nova-compute[74805]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 (non-flash)
Nov 15 04:34:55 user nova-compute[74805]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 (non-flash)
Nov 15 04:34:55 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:34:55 user nova-compute[74805]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 (non-flash)
Nov 15 04:34:55 user nova-compute[74805]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 (non-flash)
Nov 15 04:34:55 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c130280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6'): ({'sdb'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Removing single pathed devices sdb {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4f826f-6d11-4503-bc2e-b3a81cfb8a60]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[da308568-06e8-4c5c-8159-9f70401af47e]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Flushing IO for device /dev/sdb {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[620b396d-36af-44f1-a36e-a026a0fa7d1e]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3425de-90ec-43c8-b5e1-be7151673322]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c153d3-9346-4e4b-ab7b-7daada02f0ba]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[db06de7b-c834-4397-ad93-0b3901788007]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6, portal: 172.16.0.220,3260]
Nov 15 04:34:55 user nova-compute[74805]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6, portal: 172.16.0.220,3260] successful.
Nov 15 04:34:55 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb225d4-25f3-4bcc-801a-f5b01f33d50a]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] <== disconnect_volume: return (320ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:34:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:56 user nova-compute[74805]: DEBUG nova.objects.instance [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lazy-loading 'flavor' on Instance uuid a2875e85-f7ff-445d-ac92-133ef145ec93 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:34:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-eea9fd18-9b6e-4849-97ef-eaeca5040326 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "a2875e85-f7ff-445d-ac92-133ef145ec93" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.682s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:34:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "a2875e85-f7ff-445d-ac92-133ef145ec93" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.563s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:34:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "a2875e85-f7ff-445d-ac92-133ef145ec93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:34:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "a2875e85-f7ff-445d-ac92-133ef145ec93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:34:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "a2875e85-f7ff-445d-ac92-133ef145ec93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:34:56 user nova-compute[74805]: INFO nova.compute.manager [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Terminating instance
Nov 15 04:34:56 user nova-compute[74805]: DEBUG nova.compute.manager [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:34:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:56 user nova-compute[74805]: DEBUG nova.compute.manager [req-7266ed7b-b37d-44cd-a7b1-d5f0d9551c2b req-59080cd0-0ef5-4bc1-87a7-377208b5d0b1 service nova] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Received event network-vif-unplugged-1ed6482a-faf3-4cd0-b4ea-eb4140350a0a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:34:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7266ed7b-b37d-44cd-a7b1-d5f0d9551c2b req-59080cd0-0ef5-4bc1-87a7-377208b5d0b1 service nova] Acquiring lock "a2875e85-f7ff-445d-ac92-133ef145ec93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:34:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7266ed7b-b37d-44cd-a7b1-d5f0d9551c2b req-59080cd0-0ef5-4bc1-87a7-377208b5d0b1 service nova] Lock "a2875e85-f7ff-445d-ac92-133ef145ec93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:34:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7266ed7b-b37d-44cd-a7b1-d5f0d9551c2b req-59080cd0-0ef5-4bc1-87a7-377208b5d0b1 service nova] Lock "a2875e85-f7ff-445d-ac92-133ef145ec93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:34:56 user nova-compute[74805]: DEBUG nova.compute.manager [req-7266ed7b-b37d-44cd-a7b1-d5f0d9551c2b req-59080cd0-0ef5-4bc1-87a7-377208b5d0b1 service nova] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] No waiting events found dispatching network-vif-unplugged-1ed6482a-faf3-4cd0-b4ea-eb4140350a0a {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:34:56 user nova-compute[74805]: DEBUG nova.compute.manager [req-7266ed7b-b37d-44cd-a7b1-d5f0d9551c2b req-59080cd0-0ef5-4bc1-87a7-377208b5d0b1 service nova] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Received event network-vif-unplugged-1ed6482a-faf3-4cd0-b4ea-eb4140350a0a for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:34:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:57 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Instance destroyed successfully.
Nov 15 04:34:57 user nova-compute[74805]: DEBUG nova.objects.instance [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lazy-loading 'resources' on Instance uuid a2875e85-f7ff-445d-ac92-133ef145ec93 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-201929926',display_name='tempest-VolumesSnapshotTestJSON-instance-201929926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-201929926',id=38,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/QnP41DmPnb3IERZmleKJU0QyP9KwVBrYIGUI6DpOsj6OkoaFi2xPZLIxvbxKSUO2y1nOVyodm5gI9x6UPTgPlSUjsgU+9woK74EgJ9TiFQ0RrkmOSKIiowjxlxSpggQ==',key_name='tempest-keypair-1065420475',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:32:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3b66fd3bcaa4720a38b00388797825a',ramdisk_id='',reservation_id='r-hc49xyu2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1020343559',owner_user_name='tempest-VolumesSnapshotTestJSON-1020343559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:32:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ef3764d29074d9ebb8f7c0b62b4cf4f',uuid=a2875e85-f7ff-445d-ac92-133ef145ec93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ed6482a-faf3-4cd0-b4ea-eb4140350a0a", "address": "fa:16:3e:3d:7f:62", "network": {"id": "56e28167-fe83-43e1-9efc-81f625e2b727", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760042206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3b66fd3bcaa4720a38b00388797825a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ed6482a-fa", "ovs_interfaceid": "1ed6482a-faf3-4cd0-b4ea-eb4140350a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Converting VIF {"id": "1ed6482a-faf3-4cd0-b4ea-eb4140350a0a", "address": "fa:16:3e:3d:7f:62", "network": {"id": "56e28167-fe83-43e1-9efc-81f625e2b727", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760042206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3b66fd3bcaa4720a38b00388797825a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ed6482a-fa", "ovs_interfaceid": "1ed6482a-faf3-4cd0-b4ea-eb4140350a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:7f:62,bridge_name='br-int',has_traffic_filtering=True,id=1ed6482a-faf3-4cd0-b4ea-eb4140350a0a,network=Network(56e28167-fe83-43e1-9efc-81f625e2b727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ed6482a-fa') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG os_vif [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:7f:62,bridge_name='br-int',has_traffic_filtering=True,id=1ed6482a-faf3-4cd0-b4ea-eb4140350a0a,network=Network(56e28167-fe83-43e1-9efc-81f625e2b727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ed6482a-fa') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ed6482a-fa, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3361ac17-04a4-4475-967b-1a446c57b1d4) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:34:57 user nova-compute[74805]: INFO os_vif [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:7f:62,bridge_name='br-int',has_traffic_filtering=True,id=1ed6482a-faf3-4cd0-b4ea-eb4140350a0a,network=Network(56e28167-fe83-43e1-9efc-81f625e2b727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ed6482a-fa')
Nov 15 04:34:57 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'okyWAQlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:34:57 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:34:57 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[946292f4-61a8-4298-9253-e4152d926f51]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:34:57 user nova-compute[74805]: No targets found.
Nov 15 04:34:57 user nova-compute[74805]: iSNS:
Nov 15 04:34:57 user nova-compute[74805]: No targets found.
Nov 15 04:34:57 user nova-compute[74805]: STATIC:
Nov 15 04:34:57 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5
Nov 15 04:34:57 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:34:57 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:34:57 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f
Nov 15 04:34:57 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:34:57 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:34:57 user nova-compute[74805]: FIRMWARE:
Nov 15 04:34:57 user nova-compute[74805]: No targets found.
Nov 15 04:34:57 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:34:57 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:34:57 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cd3dab2-cc09-45cc-81e9-02f649c345a6', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b737693-75e0-46e5-af73-d0797e55073e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0923af6c-7beb-4515-8c25-f1d1dde51578]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:34:57 user nova-compute[74805]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 (non-flash)
Nov 15 04:34:57 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:34:57 user nova-compute[74805]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 (non-flash)
Nov 15 04:34:57 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c38c0d0>, {}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Disconnecting from: [] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.068s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] <== disconnect_volume: return (69ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:34:57 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Deleting instance files /opt/stack/data/nova/instances/a2875e85-f7ff-445d-ac92-133ef145ec93_del
Nov 15 04:34:57 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Deletion of /opt/stack/data/nova/instances/a2875e85-f7ff-445d-ac92-133ef145ec93_del complete
Nov 15 04:34:57 user nova-compute[74805]: INFO nova.compute.manager [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 15 04:34:57 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:34:57 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:34:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:34:58 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:34:58 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Took 0.79 seconds to deallocate network for instance.
Nov 15 04:34:58 user nova-compute[74805]: WARNING nova.volume.cinder [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Attachment 2158c117-36ce-4b7e-89f0-86293b7ea7a4 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 2158c117-36ce-4b7e-89f0-86293b7ea7a4. (HTTP 404) (Request-ID: req-9d837699-436c-4282-b3e8-638e85804bfe)
Nov 15 04:34:58 user nova-compute[74805]: INFO nova.compute.manager [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Took 0.03 seconds to detach 1 volumes for instance.
Nov 15 04:34:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:34:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:34:58 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:34:58 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:34:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:34:58 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Deleted allocations for instance a2875e85-f7ff-445d-ac92-133ef145ec93
Nov 15 04:34:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-719ec122-6be6-403a-9b71-77f2d23d6aaa tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "a2875e85-f7ff-445d-ac92-133ef145ec93" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.254s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:34:58 user nova-compute[74805]: DEBUG nova.compute.manager [req-c70dd493-745b-4201-9fcb-445cb896acb5 req-42b2d790-7e8b-4651-8d1a-535e65292954 service nova] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Received event network-vif-plugged-1ed6482a-faf3-4cd0-b4ea-eb4140350a0a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:34:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c70dd493-745b-4201-9fcb-445cb896acb5 req-42b2d790-7e8b-4651-8d1a-535e65292954 service nova] Acquiring lock "a2875e85-f7ff-445d-ac92-133ef145ec93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:34:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c70dd493-745b-4201-9fcb-445cb896acb5 req-42b2d790-7e8b-4651-8d1a-535e65292954 service nova] Lock "a2875e85-f7ff-445d-ac92-133ef145ec93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:34:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c70dd493-745b-4201-9fcb-445cb896acb5 req-42b2d790-7e8b-4651-8d1a-535e65292954 service nova] Lock "a2875e85-f7ff-445d-ac92-133ef145ec93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:34:58 user nova-compute[74805]: DEBUG nova.compute.manager [req-c70dd493-745b-4201-9fcb-445cb896acb5 req-42b2d790-7e8b-4651-8d1a-535e65292954 service nova] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] No waiting events found dispatching network-vif-plugged-1ed6482a-faf3-4cd0-b4ea-eb4140350a0a {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:34:58 user nova-compute[74805]: WARNING nova.compute.manager [req-c70dd493-745b-4201-9fcb-445cb896acb5 req-42b2d790-7e8b-4651-8d1a-535e65292954 service nova] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Received unexpected event network-vif-plugged-1ed6482a-faf3-4cd0-b4ea-eb4140350a0a for instance with vm_state deleted and task_state None.
Nov 15 04:34:58 user nova-compute[74805]: DEBUG nova.compute.manager [req-c70dd493-745b-4201-9fcb-445cb896acb5 req-42b2d790-7e8b-4651-8d1a-535e65292954 service nova] [instance: a2875e85-f7ff-445d-ac92-133ef145ec93] Received event network-vif-deleted-1ed6482a-faf3-4cd0-b4ea-eb4140350a0a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:35:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "f99a9557-4951-49f0-931c-0dbab16478d8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:35:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:35:01 user nova-compute[74805]: INFO nova.compute.manager [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Detaching volume 9ea699c2-2e0e-4ed1-8226-684db5e391f5
Nov 15 04:35:01 user nova-compute[74805]: INFO nova.virt.block_device [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Attempting to driver detach volume 9ea699c2-2e0e-4ed1-8226-684db5e391f5 from mountpoint /dev/vdb
Nov 15 04:35:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Attempting to detach device vdb from instance f99a9557-4951-49f0-931c-0dbab16478d8 from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:35:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:35:01 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:35:01 user nova-compute[74805]:   <source dev="/dev/sdc"/>
Nov 15 04:35:01 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:35:01 user nova-compute[74805]:   <serial>9ea699c2-2e0e-4ed1-8226-684db5e391f5</serial>
Nov 15 04:35:01 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:35:01 user nova-compute[74805]: </disk>
Nov 15 04:35:01 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:35:01 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Successfully detached device vdb from instance f99a9557-4951-49f0-931c-0dbab16478d8 from the persistent domain config.
Nov 15 04:35:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f99a9557-4951-49f0-931c-0dbab16478d8 from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:35:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:35:01 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:35:01 user nova-compute[74805]:   <source dev="/dev/sdc"/>
Nov 15 04:35:01 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:35:01 user nova-compute[74805]:   <serial>9ea699c2-2e0e-4ed1-8226-684db5e391f5</serial>
Nov 15 04:35:01 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:35:01 user nova-compute[74805]: </disk>
Nov 15 04:35:01 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:35:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:02 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f99a9557-4951-49f0-931c-0dbab16478d8 {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:35:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:35:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:35:14 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:35:14 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74805) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 04:35:15 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:35:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:18 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:35:18 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:35:20 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:35:20 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:35:20 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:35:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:35:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:35:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:35:20 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:35:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:35:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:22 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f99a9557-4951-49f0-931c-0dbab16478d8 is timed out.
Nov 15 04:35:22 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Successfully detached device vdb from instance f99a9557-4951-49f0-931c-0dbab16478d8 from the live domain config.
Nov 15 04:35:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yeVFbikq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:35:22 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:35:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a6c93b-fac7-4eb0-87fe-4e213d30022a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:35:22 user nova-compute[74805]: No targets found.
Nov 15 04:35:22 user nova-compute[74805]: iSNS:
Nov 15 04:35:22 user nova-compute[74805]: No targets found.
Nov 15 04:35:22 user nova-compute[74805]: STATIC:
Nov 15 04:35:22 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5
Nov 15 04:35:22 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:35:22 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:35:22 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f
Nov 15 04:35:22 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:35:22 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:35:22 user nova-compute[74805]: FIRMWARE:
Nov 15 04:35:22 user nova-compute[74805]: No targets found.
Nov 15 04:35:22 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:35:22 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:35:22 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee36a8a2-77c4-4c3a-81a7-7be6f57c25f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:22 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:35:22 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:35:22 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=8188MB free_disk=24.913135528564453GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[12af7b17-4b44-47c4-b58c-918df013c7cd]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:35:22 user nova-compute[74805]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 (non-flash)
Nov 15 04:35:22 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:35:22 user nova-compute[74805]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 (non-flash)
Nov 15 04:35:22 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2fac21ecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5'): ({'sdc'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Removing single pathed devices sdc {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cba67c-9a16-473c-a4b5-a3eeecb4e5df]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f399a673-12f5-47d2-9d96-1217a8217de8]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Flushing IO for device /dev/sdc {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[725acf35-ebc6-472c-9891-bfcd3aaeb122]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 9f267864-0b72-431d-9b0d-c63436002a4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 38196606-a9c9-4604-ad21-2ec7511a8b28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 288a5e5c-f8e9-4507-b29c-93e7595922ac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance f99a9557-4951-49f0-931c-0dbab16478d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 2d9a5b2b-7196-4ec9-8afc-cac356fe1495 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 75731a3d-3c78-4014-a8dc-f38c3d7b3305 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4312293e-ff1e-4272-88bd-f7373fcb5679]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f78d6f-93ed-4367-8d34-1a31d2d4f83a]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:35:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:23 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb7ed32-3e54-4631-ad64-f70c41f52b4a]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:35:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5, portal: 172.16.0.220,3260]
Nov 15 04:35:23 user nova-compute[74805]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5, portal: 172.16.0.220,3260] successful.
Nov 15 04:35:23 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:35:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea699c2-2e0e-4ed1-8226-684db5e391f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:23 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce1fd2f-2595-4186-b34a-09a4ee180a5c]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:35:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:35:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.655s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:35:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] <== disconnect_volume: return (656ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:35:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:35:23 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:35:23 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:35:23 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:35:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.390s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:35:23 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:35:23 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Cleaning up deleted instances {{(pid=74805) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 04:35:23 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] There are 0 instances to clean {{(pid=74805) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 04:35:23 user nova-compute[74805]: DEBUG nova.objects.instance [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lazy-loading 'flavor' on Instance uuid f99a9557-4951-49f0-931c-0dbab16478d8 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:35:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d2a804f2-8203-48d8-92f0-3a941d51436f tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.935s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:35:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-de31ed7c-ea62-40b2-9eb7-bb17257456a8 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:35:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-de31ed7c-ea62-40b2-9eb7-bb17257456a8 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:35:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-de31ed7c-ea62-40b2-9eb7-bb17257456a8 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:35:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-de31ed7c-ea62-40b2-9eb7-bb17257456a8 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:35:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-de31ed7c-ea62-40b2-9eb7-bb17257456a8 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:35:26 user nova-compute[74805]: INFO nova.compute.manager [None req-de31ed7c-ea62-40b2-9eb7-bb17257456a8 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Terminating instance
Nov 15 04:35:26 user nova-compute[74805]: DEBUG nova.compute.manager [None req-de31ed7c-ea62-40b2-9eb7-bb17257456a8 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:35:26 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:35:26 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:35:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-38196606-a9c9-4604-ad21-2ec7511a8b28" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:35:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-38196606-a9c9-4604-ad21-2ec7511a8b28" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:35:26 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:35:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-8ccf84ae-d567-4ae9-8df5-33dbeb13c52a req-064aadb2-7401-4b0e-8950-4356bcc098ee service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Received event network-vif-unplugged-64bc8d35-4c9d-40db-ac46-46d6a3476698 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:35:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8ccf84ae-d567-4ae9-8df5-33dbeb13c52a req-064aadb2-7401-4b0e-8950-4356bcc098ee service nova] Acquiring lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:35:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8ccf84ae-d567-4ae9-8df5-33dbeb13c52a req-064aadb2-7401-4b0e-8950-4356bcc098ee service nova] Lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:35:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8ccf84ae-d567-4ae9-8df5-33dbeb13c52a req-064aadb2-7401-4b0e-8950-4356bcc098ee service nova] Lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:35:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-8ccf84ae-d567-4ae9-8df5-33dbeb13c52a req-064aadb2-7401-4b0e-8950-4356bcc098ee service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] No waiting events found dispatching network-vif-unplugged-64bc8d35-4c9d-40db-ac46-46d6a3476698 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:35:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-8ccf84ae-d567-4ae9-8df5-33dbeb13c52a req-064aadb2-7401-4b0e-8950-4356bcc098ee service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Received event network-vif-unplugged-64bc8d35-4c9d-40db-ac46-46d6a3476698 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:35:26 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Updating instance_info_cache with network_info: [{"id": "23517101-97ec-4772-ab6b-6f626a6547bc", "address": "fa:16:3e:da:ef:08", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23517101-97", "ovs_interfaceid": "23517101-97ec-4772-ab6b-6f626a6547bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:35:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-38196606-a9c9-4604-ad21-2ec7511a8b28" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:35:26 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:35:26 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:35:27 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Instance destroyed successfully.
Nov 15 04:35:27 user nova-compute[74805]: DEBUG nova.objects.instance [None req-de31ed7c-ea62-40b2-9eb7-bb17257456a8 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lazy-loading 'resources' on Instance uuid 2d9a5b2b-7196-4ec9-8afc-cac356fe1495 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:35:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-de31ed7c-ea62-40b2-9eb7-bb17257456a8 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T04:29:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-404241420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-404241420',id=37,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKBur/RpyELDGs8OS+fGtmcJkicDq1Ji9wOx9nR/Hhap23qoGdzn+AKk78C/EboXmcHvLGWAUzOVtcD86a/Pmez/PS1wixMd9BxHxz0S3w0qb3gYKb+8AZmYpR6qLmaow==',key_name='tempest-keypair-498211884',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:33:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e01874e82ed4ae08813343751506eeb',ramdisk_id='',reservation_id='r-d0v3uxp3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2114494734',owner_user_name='tempest-AttachVolumeShelveTestJSON-2114494734-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:33:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2876983d30794d8db191857d2f420f7d',uuid=2d9a5b2b-7196-4ec9-8afc-cac356fe1495,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "address": "fa:16:3e:22:73:22", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bc8d35-4c", "ovs_interfaceid": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:35:27 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-de31ed7c-ea62-40b2-9eb7-bb17257456a8 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Converting VIF {"id": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "address": "fa:16:3e:22:73:22", "network": {"id": "5febf498-f447-4e3b-a484-320124bd0158", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1788952017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e01874e82ed4ae08813343751506eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bc8d35-4c", "ovs_interfaceid": "64bc8d35-4c9d-40db-ac46-46d6a3476698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:35:27 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-de31ed7c-ea62-40b2-9eb7-bb17257456a8 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:73:22,bridge_name='br-int',has_traffic_filtering=True,id=64bc8d35-4c9d-40db-ac46-46d6a3476698,network=Network(5febf498-f447-4e3b-a484-320124bd0158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bc8d35-4c') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:35:27 user nova-compute[74805]: DEBUG os_vif [None req-de31ed7c-ea62-40b2-9eb7-bb17257456a8 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:73:22,bridge_name='br-int',has_traffic_filtering=True,id=64bc8d35-4c9d-40db-ac46-46d6a3476698,network=Network(5febf498-f447-4e3b-a484-320124bd0158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bc8d35-4c') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:35:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64bc8d35-4c, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:35:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:35:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=581bcd6d-ee82-45d3-be5a-f9a6a31cdea5) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:35:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:27 user nova-compute[74805]: INFO os_vif [None req-de31ed7c-ea62-40b2-9eb7-bb17257456a8 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:73:22,bridge_name='br-int',has_traffic_filtering=True,id=64bc8d35-4c9d-40db-ac46-46d6a3476698,network=Network(5febf498-f447-4e3b-a484-320124bd0158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bc8d35-4c')
Nov 15 04:35:27 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-de31ed7c-ea62-40b2-9eb7-bb17257456a8 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Deleting instance files /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495_del
Nov 15 04:35:27 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-de31ed7c-ea62-40b2-9eb7-bb17257456a8 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Deletion of /opt/stack/data/nova/instances/2d9a5b2b-7196-4ec9-8afc-cac356fe1495_del complete
Nov 15 04:35:27 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:35:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:35:27 user nova-compute[74805]: INFO nova.compute.manager [None req-de31ed7c-ea62-40b2-9eb7-bb17257456a8 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 15 04:35:27 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-de31ed7c-ea62-40b2-9eb7-bb17257456a8 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:35:27 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:35:27 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:35:27 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:35:27 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Took 0.68 seconds to deallocate network for instance.
Nov 15 04:35:27 user nova-compute[74805]: DEBUG nova.compute.manager [req-38076fd6-6108-4bcb-bf08-4fe6c524a487 req-9ee503b2-2d59-4fab-97fc-cda7ee0ced20 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Received event network-vif-deleted-64bc8d35-4c9d-40db-ac46-46d6a3476698 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:35:27 user nova-compute[74805]: INFO nova.compute.manager [req-38076fd6-6108-4bcb-bf08-4fe6c524a487 req-9ee503b2-2d59-4fab-97fc-cda7ee0ced20 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Neutron deleted interface 64bc8d35-4c9d-40db-ac46-46d6a3476698; detaching it from the instance and deleting it from the info cache
Nov 15 04:35:27 user nova-compute[74805]: DEBUG nova.network.neutron [req-38076fd6-6108-4bcb-bf08-4fe6c524a487 req-9ee503b2-2d59-4fab-97fc-cda7ee0ced20 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:35:27 user nova-compute[74805]: DEBUG nova.compute.manager [req-38076fd6-6108-4bcb-bf08-4fe6c524a487 req-9ee503b2-2d59-4fab-97fc-cda7ee0ced20 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Detach interface failed, port_id=64bc8d35-4c9d-40db-ac46-46d6a3476698, reason: Instance 2d9a5b2b-7196-4ec9-8afc-cac356fe1495 could not be found. {{(pid=74805) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 04:35:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-de31ed7c-ea62-40b2-9eb7-bb17257456a8 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:35:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-de31ed7c-ea62-40b2-9eb7-bb17257456a8 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:35:28 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-de31ed7c-ea62-40b2-9eb7-bb17257456a8 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:35:28 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-de31ed7c-ea62-40b2-9eb7-bb17257456a8 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:35:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-de31ed7c-ea62-40b2-9eb7-bb17257456a8 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:35:28 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-de31ed7c-ea62-40b2-9eb7-bb17257456a8 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Deleted allocations for instance 2d9a5b2b-7196-4ec9-8afc-cac356fe1495
Nov 15 04:35:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-de31ed7c-ea62-40b2-9eb7-bb17257456a8 tempest-AttachVolumeShelveTestJSON-2114494734 tempest-AttachVolumeShelveTestJSON-2114494734-project-member] Lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.192s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:35:28 user nova-compute[74805]: DEBUG nova.compute.manager [req-ca98d00d-6401-4db4-8422-fa32057a2cce req-3843fb61-2370-4feb-b204-a9dc1dd6f705 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Received event network-vif-plugged-64bc8d35-4c9d-40db-ac46-46d6a3476698 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:35:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ca98d00d-6401-4db4-8422-fa32057a2cce req-3843fb61-2370-4feb-b204-a9dc1dd6f705 service nova] Acquiring lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:35:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ca98d00d-6401-4db4-8422-fa32057a2cce req-3843fb61-2370-4feb-b204-a9dc1dd6f705 service nova] Lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:35:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ca98d00d-6401-4db4-8422-fa32057a2cce req-3843fb61-2370-4feb-b204-a9dc1dd6f705 service nova] Lock "2d9a5b2b-7196-4ec9-8afc-cac356fe1495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:35:28 user nova-compute[74805]: DEBUG nova.compute.manager [req-ca98d00d-6401-4db4-8422-fa32057a2cce req-3843fb61-2370-4feb-b204-a9dc1dd6f705 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] No waiting events found dispatching network-vif-plugged-64bc8d35-4c9d-40db-ac46-46d6a3476698 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:35:28 user nova-compute[74805]: WARNING nova.compute.manager [req-ca98d00d-6401-4db4-8422-fa32057a2cce req-3843fb61-2370-4feb-b204-a9dc1dd6f705 service nova] [instance: 2d9a5b2b-7196-4ec9-8afc-cac356fe1495] Received unexpected event network-vif-plugged-64bc8d35-4c9d-40db-ac46-46d6a3476698 for instance with vm_state deleted and task_state None.
Nov 15 04:35:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:35:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:35:34 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:35:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:35:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:35:34 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:35:34 user nova-compute[74805]: INFO nova.compute.claims [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Claim successful on node user
Nov 15 04:35:34 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:35:34 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:35:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:35:34 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:35:34 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:35:34 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:35:34 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:35:34 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:35:34 user nova-compute[74805]: DEBUG nova.policy [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ef3764d29074d9ebb8f7c0b62b4cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b66fd3bcaa4720a38b00388797825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:35:34 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:35:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:35:34 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Creating image(s)
Nov 15 04:35:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "/opt/stack/data/nova/instances/7fd20382-1fed-46d8-8968-92d7fee9c3e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:35:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "/opt/stack/data/nova/instances/7fd20382-1fed-46d8-8968-92d7fee9c3e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:35:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "/opt/stack/data/nova/instances/7fd20382-1fed-46d8-8968-92d7fee9c3e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:35:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:35 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.174s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:35:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:35:35 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:35 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.169s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:35 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/7fd20382-1fed-46d8-8968-92d7fee9c3e0/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:35 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/7fd20382-1fed-46d8-8968-92d7fee9c3e0/disk 1073741824" returned: 0 in 0.051s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:35:35 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:35 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Successfully created port: 04f57de7-3ac1-4d29-96c6-c9b7ec2149f1 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:35:35 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.166s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:35 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7fd20382-1fed-46d8-8968-92d7fee9c3e0/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:35:35 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fd20382-1fed-46d8-8968-92d7fee9c3e0/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:35 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fd20382-1fed-46d8-8968-92d7fee9c3e0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:35 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Cannot resize image /opt/stack/data/nova/instances/7fd20382-1fed-46d8-8968-92d7fee9c3e0/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:35:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:35:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Ensure instance console log exists: /opt/stack/data/nova/instances/7fd20382-1fed-46d8-8968-92d7fee9c3e0/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:35:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:35:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:35:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Successfully updated port: 04f57de7-3ac1-4d29-96c6-c9b7ec2149f1 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.compute.manager [req-4a3c97f4-bcf2-4d3c-88d0-a0cd86141c12 req-26761539-61f0-4ead-9a69-9f59a6672cf2 service nova] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Received event network-changed-04f57de7-3ac1-4d29-96c6-c9b7ec2149f1 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.compute.manager [req-4a3c97f4-bcf2-4d3c-88d0-a0cd86141c12 req-26761539-61f0-4ead-9a69-9f59a6672cf2 service nova] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Refreshing instance network info cache due to event network-changed-04f57de7-3ac1-4d29-96c6-c9b7ec2149f1. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-4a3c97f4-bcf2-4d3c-88d0-a0cd86141c12 req-26761539-61f0-4ead-9a69-9f59a6672cf2 service nova] Acquiring lock "refresh_cache-7fd20382-1fed-46d8-8968-92d7fee9c3e0" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-4a3c97f4-bcf2-4d3c-88d0-a0cd86141c12 req-26761539-61f0-4ead-9a69-9f59a6672cf2 service nova] Acquired lock "refresh_cache-7fd20382-1fed-46d8-8968-92d7fee9c3e0" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.network.neutron [req-4a3c97f4-bcf2-4d3c-88d0-a0cd86141c12 req-26761539-61f0-4ead-9a69-9f59a6672cf2 service nova] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Refreshing network info cache for port 04f57de7-3ac1-4d29-96c6-c9b7ec2149f1 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "refresh_cache-7fd20382-1fed-46d8-8968-92d7fee9c3e0" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.network.neutron [req-4a3c97f4-bcf2-4d3c-88d0-a0cd86141c12 req-26761539-61f0-4ead-9a69-9f59a6672cf2 service nova] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.network.neutron [req-4a3c97f4-bcf2-4d3c-88d0-a0cd86141c12 req-26761539-61f0-4ead-9a69-9f59a6672cf2 service nova] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-4a3c97f4-bcf2-4d3c-88d0-a0cd86141c12 req-26761539-61f0-4ead-9a69-9f59a6672cf2 service nova] Releasing lock "refresh_cache-7fd20382-1fed-46d8-8968-92d7fee9c3e0" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquired lock "refresh_cache-7fd20382-1fed-46d8-8968-92d7fee9c3e0" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Updating instance_info_cache with network_info: [{"id": "04f57de7-3ac1-4d29-96c6-c9b7ec2149f1", "address": "fa:16:3e:87:54:19", "network": {"id": "56e28167-fe83-43e1-9efc-81f625e2b727", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760042206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3b66fd3bcaa4720a38b00388797825a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f57de7-3a", "ovs_interfaceid": "04f57de7-3ac1-4d29-96c6-c9b7ec2149f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Releasing lock "refresh_cache-7fd20382-1fed-46d8-8968-92d7fee9c3e0" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Instance network_info: |[{"id": "04f57de7-3ac1-4d29-96c6-c9b7ec2149f1", "address": "fa:16:3e:87:54:19", "network": {"id": "56e28167-fe83-43e1-9efc-81f625e2b727", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760042206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3b66fd3bcaa4720a38b00388797825a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f57de7-3a", "ovs_interfaceid": "04f57de7-3ac1-4d29-96c6-c9b7ec2149f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Start _get_guest_xml network_info=[{"id": "04f57de7-3ac1-4d29-96c6-c9b7ec2149f1", "address": "fa:16:3e:87:54:19", "network": {"id": "56e28167-fe83-43e1-9efc-81f625e2b727", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760042206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3b66fd3bcaa4720a38b00388797825a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f57de7-3a", "ovs_interfaceid": "04f57de7-3ac1-4d29-96c6-c9b7ec2149f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:35:36 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:35:36 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:35:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-922041030',display_name='tempest-VolumesSnapshotTestJSON-instance-922041030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-922041030',id=43,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqI/xrVtmava9yLtAvNDUudX83mjSN+9vgJaXreYHICcJFe1qz/q+a4y37YAUwDYdomIl1BM/mE/L6J2cxvFILRU+WRowObPSDLH31L0Kl3EI4jhF9k0cJoCk0z+LuTUA==',key_name='tempest-keypair-2004984909',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3b66fd3bcaa4720a38b00388797825a',ramdisk_id='',reservation_id='r-h1iedgd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1020343559',owner_user_name='tempest-VolumesSnapshotTestJSON-1020343559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:35:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ef3764d29074d9ebb8f7c0b62b4cf4f',uuid=7fd20382-1fed-46d8-8968-92d7fee9c3e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04f57de7-3ac1-4d29-96c6-c9b7ec2149f1", "address": "fa:16:3e:87:54:19", "network": {"id": "56e28167-fe83-43e1-9efc-81f625e2b727", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760042206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3b66fd3bcaa4720a38b00388797825a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f57de7-3a", "ovs_interfaceid": "04f57de7-3ac1-4d29-96c6-c9b7ec2149f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Converting VIF {"id": "04f57de7-3ac1-4d29-96c6-c9b7ec2149f1", "address": "fa:16:3e:87:54:19", "network": {"id": "56e28167-fe83-43e1-9efc-81f625e2b727", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760042206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3b66fd3bcaa4720a38b00388797825a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f57de7-3a", "ovs_interfaceid": "04f57de7-3ac1-4d29-96c6-c9b7ec2149f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:54:19,bridge_name='br-int',has_traffic_filtering=True,id=04f57de7-3ac1-4d29-96c6-c9b7ec2149f1,network=Network(56e28167-fe83-43e1-9efc-81f625e2b727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04f57de7-3a') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.objects.instance [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lazy-loading 'pci_devices' on Instance uuid 7fd20382-1fed-46d8-8968-92d7fee9c3e0 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:35:36 user nova-compute[74805]:   <uuid>7fd20382-1fed-46d8-8968-92d7fee9c3e0</uuid>
Nov 15 04:35:36 user nova-compute[74805]:   <name>instance-0000002b</name>
Nov 15 04:35:36 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:35:36 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:35:36 user nova-compute[74805]:   <metadata>
Nov 15 04:35:36 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:35:36 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:35:36 user nova-compute[74805]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-922041030</nova:name>
Nov 15 04:35:36 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:35:36</nova:creationTime>
Nov 15 04:35:36 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:35:36 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:35:36 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:35:36 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:35:36 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:35:36 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:35:36 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:35:36 user nova-compute[74805]:       <nova:owner>
Nov 15 04:35:36 user nova-compute[74805]:         <nova:user uuid="9ef3764d29074d9ebb8f7c0b62b4cf4f">tempest-VolumesSnapshotTestJSON-1020343559-project-member</nova:user>
Nov 15 04:35:36 user nova-compute[74805]:         <nova:project uuid="e3b66fd3bcaa4720a38b00388797825a">tempest-VolumesSnapshotTestJSON-1020343559</nova:project>
Nov 15 04:35:36 user nova-compute[74805]:       </nova:owner>
Nov 15 04:35:36 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:35:36 user nova-compute[74805]:       <nova:ports>
Nov 15 04:35:36 user nova-compute[74805]:         <nova:port uuid="04f57de7-3ac1-4d29-96c6-c9b7ec2149f1">
Nov 15 04:35:36 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 04:35:36 user nova-compute[74805]:         </nova:port>
Nov 15 04:35:36 user nova-compute[74805]:       </nova:ports>
Nov 15 04:35:36 user nova-compute[74805]:     </nova:instance>
Nov 15 04:35:36 user nova-compute[74805]:   </metadata>
Nov 15 04:35:36 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:35:36 user nova-compute[74805]:     <system>
Nov 15 04:35:36 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:35:36 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:35:36 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:35:36 user nova-compute[74805]:       <entry name="serial">7fd20382-1fed-46d8-8968-92d7fee9c3e0</entry>
Nov 15 04:35:36 user nova-compute[74805]:       <entry name="uuid">7fd20382-1fed-46d8-8968-92d7fee9c3e0</entry>
Nov 15 04:35:36 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:35:36 user nova-compute[74805]:     </system>
Nov 15 04:35:36 user nova-compute[74805]:   </sysinfo>
Nov 15 04:35:36 user nova-compute[74805]:   <os>
Nov 15 04:35:36 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:35:36 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:35:36 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:35:36 user nova-compute[74805]:   </os>
Nov 15 04:35:36 user nova-compute[74805]:   <features>
Nov 15 04:35:36 user nova-compute[74805]:     <acpi/>
Nov 15 04:35:36 user nova-compute[74805]:     <apic/>
Nov 15 04:35:36 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:35:36 user nova-compute[74805]:   </features>
Nov 15 04:35:36 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:35:36 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:35:36 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:35:36 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:35:36 user nova-compute[74805]:   </clock>
Nov 15 04:35:36 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:35:36 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:35:36 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:35:36 user nova-compute[74805]:   </cpu>
Nov 15 04:35:36 user nova-compute[74805]:   <devices>
Nov 15 04:35:36 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:35:36 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:35:36 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/7fd20382-1fed-46d8-8968-92d7fee9c3e0/disk"/>
Nov 15 04:35:36 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:35:36 user nova-compute[74805]:     </disk>
Nov 15 04:35:36 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:35:36 user nova-compute[74805]:       <mac address="fa:16:3e:87:54:19"/>
Nov 15 04:35:36 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:35:36 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:35:36 user nova-compute[74805]:       <target dev="tap04f57de7-3a"/>
Nov 15 04:35:36 user nova-compute[74805]:     </interface>
Nov 15 04:35:36 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:35:36 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/7fd20382-1fed-46d8-8968-92d7fee9c3e0/console.log" append="off"/>
Nov 15 04:35:36 user nova-compute[74805]:     </serial>
Nov 15 04:35:36 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:35:36 user nova-compute[74805]:     <video>
Nov 15 04:35:36 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:35:36 user nova-compute[74805]:     </video>
Nov 15 04:35:36 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:35:36 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:35:36 user nova-compute[74805]:     </rng>
Nov 15 04:35:36 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:35:36 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:35:36 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:35:36 user nova-compute[74805]:     </memballoon>
Nov 15 04:35:36 user nova-compute[74805]:   </devices>
Nov 15 04:35:36 user nova-compute[74805]: </domain>
Nov 15 04:35:36 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:35:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-922041030',display_name='tempest-VolumesSnapshotTestJSON-instance-922041030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-922041030',id=43,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqI/xrVtmava9yLtAvNDUudX83mjSN+9vgJaXreYHICcJFe1qz/q+a4y37YAUwDYdomIl1BM/mE/L6J2cxvFILRU+WRowObPSDLH31L0Kl3EI4jhF9k0cJoCk0z+LuTUA==',key_name='tempest-keypair-2004984909',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3b66fd3bcaa4720a38b00388797825a',ramdisk_id='',reservation_id='r-h1iedgd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1020343559',owner_user_name='tempest-VolumesSnapshotTestJSON-1020343559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:35:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ef3764d29074d9ebb8f7c0b62b4cf4f',uuid=7fd20382-1fed-46d8-8968-92d7fee9c3e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04f57de7-3ac1-4d29-96c6-c9b7ec2149f1", "address": "fa:16:3e:87:54:19", "network": {"id": "56e28167-fe83-43e1-9efc-81f625e2b727", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760042206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3b66fd3bcaa4720a38b00388797825a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f57de7-3a", "ovs_interfaceid": "04f57de7-3ac1-4d29-96c6-c9b7ec2149f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Converting VIF {"id": "04f57de7-3ac1-4d29-96c6-c9b7ec2149f1", "address": "fa:16:3e:87:54:19", "network": {"id": "56e28167-fe83-43e1-9efc-81f625e2b727", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760042206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3b66fd3bcaa4720a38b00388797825a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f57de7-3a", "ovs_interfaceid": "04f57de7-3ac1-4d29-96c6-c9b7ec2149f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:54:19,bridge_name='br-int',has_traffic_filtering=True,id=04f57de7-3ac1-4d29-96c6-c9b7ec2149f1,network=Network(56e28167-fe83-43e1-9efc-81f625e2b727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04f57de7-3a') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG os_vif [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:54:19,bridge_name='br-int',has_traffic_filtering=True,id=04f57de7-3ac1-4d29-96c6-c9b7ec2149f1,network=Network(56e28167-fe83-43e1-9efc-81f625e2b727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04f57de7-3a') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'be181316-d903-556f-b96a-15ffbaa99001', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04f57de7-3a, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04f57de7-3a, col_values=(('qos', UUID('ea6fd9c7-0130-4321-b485-8bd2babcebf5')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04f57de7-3a, col_values=(('external_ids', {'iface-id': '04f57de7-3ac1-4d29-96c6-c9b7ec2149f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:54:19', 'vm-uuid': '7fd20382-1fed-46d8-8968-92d7fee9c3e0'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:35:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:36 user nova-compute[74805]: INFO os_vif [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:54:19,bridge_name='br-int',has_traffic_filtering=True,id=04f57de7-3ac1-4d29-96c6-c9b7ec2149f1,network=Network(56e28167-fe83-43e1-9efc-81f625e2b727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04f57de7-3a')
Nov 15 04:35:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:35:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] No VIF found with MAC fa:16:3e:87:54:19, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:35:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:38 user nova-compute[74805]: DEBUG nova.compute.manager [req-12592bcf-179d-419d-9578-4b50e4ea3a0f req-26476ad2-4669-45af-8a39-6b9611699461 service nova] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Received event network-vif-plugged-04f57de7-3ac1-4d29-96c6-c9b7ec2149f1 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:35:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-12592bcf-179d-419d-9578-4b50e4ea3a0f req-26476ad2-4669-45af-8a39-6b9611699461 service nova] Acquiring lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:35:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-12592bcf-179d-419d-9578-4b50e4ea3a0f req-26476ad2-4669-45af-8a39-6b9611699461 service nova] Lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:35:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-12592bcf-179d-419d-9578-4b50e4ea3a0f req-26476ad2-4669-45af-8a39-6b9611699461 service nova] Lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:35:38 user nova-compute[74805]: DEBUG nova.compute.manager [req-12592bcf-179d-419d-9578-4b50e4ea3a0f req-26476ad2-4669-45af-8a39-6b9611699461 service nova] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] No waiting events found dispatching network-vif-plugged-04f57de7-3ac1-4d29-96c6-c9b7ec2149f1 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:35:38 user nova-compute[74805]: WARNING nova.compute.manager [req-12592bcf-179d-419d-9578-4b50e4ea3a0f req-26476ad2-4669-45af-8a39-6b9611699461 service nova] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Received unexpected event network-vif-plugged-04f57de7-3ac1-4d29-96c6-c9b7ec2149f1 for instance with vm_state building and task_state spawning.
Nov 15 04:35:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:40 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:35:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:35:40 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Instance spawned successfully.
Nov 15 04:35:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:35:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:35:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:35:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:35:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:35:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:35:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:35:40 user nova-compute[74805]: DEBUG nova.compute.manager [req-b4e01851-ceaa-4bd1-ba9c-887fd3ad7d4c req-35cde25a-adae-465f-bf45-8e1301e71772 service nova] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Received event network-vif-plugged-04f57de7-3ac1-4d29-96c6-c9b7ec2149f1 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:35:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b4e01851-ceaa-4bd1-ba9c-887fd3ad7d4c req-35cde25a-adae-465f-bf45-8e1301e71772 service nova] Acquiring lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:35:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b4e01851-ceaa-4bd1-ba9c-887fd3ad7d4c req-35cde25a-adae-465f-bf45-8e1301e71772 service nova] Lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:35:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b4e01851-ceaa-4bd1-ba9c-887fd3ad7d4c req-35cde25a-adae-465f-bf45-8e1301e71772 service nova] Lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:35:40 user nova-compute[74805]: DEBUG nova.compute.manager [req-b4e01851-ceaa-4bd1-ba9c-887fd3ad7d4c req-35cde25a-adae-465f-bf45-8e1301e71772 service nova] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] No waiting events found dispatching network-vif-plugged-04f57de7-3ac1-4d29-96c6-c9b7ec2149f1 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:35:40 user nova-compute[74805]: WARNING nova.compute.manager [req-b4e01851-ceaa-4bd1-ba9c-887fd3ad7d4c req-35cde25a-adae-465f-bf45-8e1301e71772 service nova] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Received unexpected event network-vif-plugged-04f57de7-3ac1-4d29-96c6-c9b7ec2149f1 for instance with vm_state building and task_state spawning.
Nov 15 04:35:40 user nova-compute[74805]: INFO nova.compute.manager [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Took 5.68 seconds to spawn the instance on the hypervisor.
Nov 15 04:35:40 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:35:40 user nova-compute[74805]: INFO nova.compute.manager [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Took 6.34 seconds to build instance.
Nov 15 04:35:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d72e6f4d-0644-4327-8ce8-f8ea5760cde5 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.464s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:35:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:46 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:35:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:35:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:35:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:35:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:35:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:35:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "f99a9557-4951-49f0-931c-0dbab16478d8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:35:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:35:53 user nova-compute[74805]: DEBUG nova.objects.instance [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lazy-loading 'flavor' on Instance uuid f99a9557-4951-49f0-931c-0dbab16478d8 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:35:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:35:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "f99a9557-4951-49f0-931c-0dbab16478d8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:35:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:35:54 user nova-compute[74805]: INFO nova.compute.manager [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Attaching volume 1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 to /dev/vdb
Nov 15 04:35:54 user nova-compute[74805]: DEBUG os_brick.utils [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:35:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[22988d4b-0219-4841-a594-22cb12cbac6f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:35:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e77d83-9e22-4346-8c58-a43cc712db0e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:35:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a6b11e-be26-45ed-b082-09f7315eddc3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:35:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[355d3ade-b6cd-403e-a7a5-c97722fb7d8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:35:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:35:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:35:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:35:54 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:35:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c8658c-ed37-44a2-934b-97c5c1bb7f48]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:35:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:35:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:35:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:35:54 user nova-compute[74805]: DEBUG os_brick.utils [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:35:54 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Updating existing volume attachment record: 968395e0-358f-4216-b59f-ab7292b72ae0 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:35:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsDwJILU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:35:58 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:35:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:35:58 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:35:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:35:58 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:35:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d166e03d-ac13-4b52-9f1b-105497f73cdd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:35:58 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9dd4cbc-ac67-4ca4-95e6-a1292dfe8f89]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5] added
Nov 15 04:35:58 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1396c5-1625-4df2-bf8e-e501b43e2bc9]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5313280d-48c7-4840-9bd5-6f4004d9e290]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BsDwJILU {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BsDwJILU" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e89f8f-bb1b-4001-82d9-9150cc88eda0]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BsDwJILU'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a2c13f-fd8d-446a-8e69-355af220617c]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ca3b4e-59c8-40f2-897b-5b616d7990e3]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:35:58 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:35:58 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:35:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bbc0cb-fb69-4583-9b82-4fd475e3cbc3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:35:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5, portal: 172.16.0.220,3260]
Nov 15 04:35:59 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5, portal: 172.16.0.220,3260] successful.
Nov 15 04:35:59 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:35:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[39db7ee5-898c-4291-ae4c-57197944bfa2]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:35:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:35:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a014a0-269a-4d33-a1a9-a8b34fe54065]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:35:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:35:59 user nova-compute[74805]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 (non-flash)
Nov 15 04:35:59 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:35:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:35:59 user nova-compute[74805]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 (non-flash)
Nov 15 04:35:59 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:35:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:35:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:35:59 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:35:59 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:35:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:35:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:35:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bdc511-12e2-4713-b7bb-17660c7d0efc]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:35:59 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:35:59 user nova-compute[74805]: INFO nova.compute.manager [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Rescuing
Nov 15 04:35:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "refresh_cache-01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:35:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquired lock "refresh_cache-01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:35:59 user nova-compute[74805]: DEBUG nova.network.neutron [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:35:59 user nova-compute[74805]: DEBUG nova.network.neutron [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Updating instance_info_cache with network_info: [{"id": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "address": "fa:16:3e:c6:13:c6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9bd2e9-b1", "ovs_interfaceid": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:35:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Releasing lock "refresh_cache-01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:35:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:35:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsDwJILU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26237666632376439', 'path': '/dev/sdb'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237666632376439', 'path': '/dev/sdb'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.objects.instance [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lazy-loading 'flavor' on Instance uuid f99a9557-4951-49f0-931c-0dbab16478d8 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-70f78e34-1a52-4aa3-bc6b-7e0cef95aeb1 req-a458d077-8c1d-4c88-b151-228332b7f0bb service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Received event network-vif-unplugged-4d9bd2e9-b1dc-4fc8-b045-6e5513061c22 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-70f78e34-1a52-4aa3-bc6b-7e0cef95aeb1 req-a458d077-8c1d-4c88-b151-228332b7f0bb service nova] Acquiring lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-70f78e34-1a52-4aa3-bc6b-7e0cef95aeb1 req-a458d077-8c1d-4c88-b151-228332b7f0bb service nova] Lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-70f78e34-1a52-4aa3-bc6b-7e0cef95aeb1 req-a458d077-8c1d-4c88-b151-228332b7f0bb service nova] Lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-70f78e34-1a52-4aa3-bc6b-7e0cef95aeb1 req-a458d077-8c1d-4c88-b151-228332b7f0bb service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] No waiting events found dispatching network-vif-unplugged-4d9bd2e9-b1dc-4fc8-b045-6e5513061c22 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:36:00 user nova-compute[74805]: WARNING nova.compute.manager [req-70f78e34-1a52-4aa3-bc6b-7e0cef95aeb1 req-a458d077-8c1d-4c88-b151-228332b7f0bb service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Received unexpected event network-vif-unplugged-4d9bd2e9-b1dc-4fc8-b045-6e5513061c22 for instance with vm_state active and task_state rescuing.
Nov 15 04:36:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:36:00 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:36:00 user nova-compute[74805]:   <source dev="/dev/sdb"/>
Nov 15 04:36:00 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:36:00 user nova-compute[74805]:   <serial>1eedeb1c-bf1b-4e71-95f8-56be3f450ef5</serial>
Nov 15 04:36:00 user nova-compute[74805]: </disk>
Nov 15 04:36:00 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:00 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Instance destroyed successfully.
Nov 15 04:36:00 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Attempting rescue
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74805) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Instance directory exists: not creating {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 04:36:00 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Creating image(s)
Nov 15 04:36:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "/opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "/opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "/opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.objects.instance [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lazy-loading 'trusted_certs' on Instance uuid 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] No VIF found with MAC fa:16:3e:f6:5f:e4, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.177s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue" returned: 0 in 0.048s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.objects.instance [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lazy-loading 'migration_context' on Instance uuid 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.objects.base [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Object Instance<01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Start _get_guest_xml network_info=[{"id": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "address": "fa:16:3e:c6:13:c6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "vif_mac": "fa:16:3e:c6:13:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9bd2e9-b1", "ovs_interfaceid": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.objects.instance [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lazy-loading 'resources' on Instance uuid 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b38b5a1f-67fc-4299-becd-85772c87cf9b tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.886s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.objects.base [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Object Instance<01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.objects.instance [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lazy-loading 'numa_topology' on Instance uuid 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.objects.base [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Object Instance<01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:36:00 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:36:00 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.objects.instance [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lazy-loading 'vcpu_model' on Instance uuid 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:36:00 user nova-compute[74805]: DEBUG nova.objects.base [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Object Instance<01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:36:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:34:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-715241780',display_name='tempest-ServerRescueNegativeTestJSON-server-715241780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-715241780',id=42,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:34:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66fc455c6c7049d79a5c64451c126d56',ramdisk_id='',reservation_id='r-nfy5l0dx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-370335706',owner_user_name='tempest-ServerRescueNegativeTestJSON-370335706-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:34:16Z,user_data=None,user_id='6da72213d3ae446088876b3a3c34f976',uuid=01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "address": "fa:16:3e:c6:13:c6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "vif_mac": "fa:16:3e:c6:13:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9bd2e9-b1", "ovs_interfaceid": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:36:01 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Converting VIF {"id": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "address": "fa:16:3e:c6:13:c6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "vif_mac": "fa:16:3e:c6:13:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9bd2e9-b1", "ovs_interfaceid": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:36:01 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:13:c6,bridge_name='br-int',has_traffic_filtering=True,id=4d9bd2e9-b1dc-4fc8-b045-6e5513061c22,network=Network(98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d9bd2e9-b1') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:36:01 user nova-compute[74805]: DEBUG nova.objects.instance [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lazy-loading 'pci_devices' on Instance uuid 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:36:01 user nova-compute[74805]: DEBUG nova.objects.base [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Object Instance<01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:36:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:36:01 user nova-compute[74805]:   <uuid>01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af</uuid>
Nov 15 04:36:01 user nova-compute[74805]:   <name>instance-0000002a</name>
Nov 15 04:36:01 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:36:01 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:36:01 user nova-compute[74805]:   <metadata>
Nov 15 04:36:01 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:36:01 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:36:01 user nova-compute[74805]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-715241780</nova:name>
Nov 15 04:36:01 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:36:00</nova:creationTime>
Nov 15 04:36:01 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:36:01 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:36:01 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:36:01 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:36:01 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:36:01 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:36:01 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:36:01 user nova-compute[74805]:       <nova:owner>
Nov 15 04:36:01 user nova-compute[74805]:         <nova:user uuid="6da72213d3ae446088876b3a3c34f976">tempest-ServerRescueNegativeTestJSON-370335706-project-member</nova:user>
Nov 15 04:36:01 user nova-compute[74805]:         <nova:project uuid="66fc455c6c7049d79a5c64451c126d56">tempest-ServerRescueNegativeTestJSON-370335706</nova:project>
Nov 15 04:36:01 user nova-compute[74805]:       </nova:owner>
Nov 15 04:36:01 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:36:01 user nova-compute[74805]:       <nova:ports>
Nov 15 04:36:01 user nova-compute[74805]:         <nova:port uuid="4d9bd2e9-b1dc-4fc8-b045-6e5513061c22">
Nov 15 04:36:01 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 04:36:01 user nova-compute[74805]:         </nova:port>
Nov 15 04:36:01 user nova-compute[74805]:       </nova:ports>
Nov 15 04:36:01 user nova-compute[74805]:     </nova:instance>
Nov 15 04:36:01 user nova-compute[74805]:   </metadata>
Nov 15 04:36:01 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:36:01 user nova-compute[74805]:     <system>
Nov 15 04:36:01 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:36:01 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:36:01 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:36:01 user nova-compute[74805]:       <entry name="serial">01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af</entry>
Nov 15 04:36:01 user nova-compute[74805]:       <entry name="uuid">01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af</entry>
Nov 15 04:36:01 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:36:01 user nova-compute[74805]:     </system>
Nov 15 04:36:01 user nova-compute[74805]:   </sysinfo>
Nov 15 04:36:01 user nova-compute[74805]:   <os>
Nov 15 04:36:01 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:36:01 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:36:01 user nova-compute[74805]:   </os>
Nov 15 04:36:01 user nova-compute[74805]:   <features>
Nov 15 04:36:01 user nova-compute[74805]:     <acpi/>
Nov 15 04:36:01 user nova-compute[74805]:     <apic/>
Nov 15 04:36:01 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:36:01 user nova-compute[74805]:   </features>
Nov 15 04:36:01 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:36:01 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:36:01 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:36:01 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:36:01 user nova-compute[74805]:   </clock>
Nov 15 04:36:01 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:36:01 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:36:01 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:36:01 user nova-compute[74805]:   </cpu>
Nov 15 04:36:01 user nova-compute[74805]:   <devices>
Nov 15 04:36:01 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:36:01 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:36:01 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue"/>
Nov 15 04:36:01 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:36:01 user nova-compute[74805]:     </disk>
Nov 15 04:36:01 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:36:01 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:36:01 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk"/>
Nov 15 04:36:01 user nova-compute[74805]:       <target dev="vdb" bus="virtio"/>
Nov 15 04:36:01 user nova-compute[74805]:     </disk>
Nov 15 04:36:01 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:36:01 user nova-compute[74805]:       <mac address="fa:16:3e:c6:13:c6"/>
Nov 15 04:36:01 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:36:01 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:36:01 user nova-compute[74805]:       <target dev="tap4d9bd2e9-b1"/>
Nov 15 04:36:01 user nova-compute[74805]:     </interface>
Nov 15 04:36:01 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:36:01 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/console.log" append="off"/>
Nov 15 04:36:01 user nova-compute[74805]:     </serial>
Nov 15 04:36:01 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:36:01 user nova-compute[74805]:     <video>
Nov 15 04:36:01 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:36:01 user nova-compute[74805]:     </video>
Nov 15 04:36:01 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:36:01 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:36:01 user nova-compute[74805]:     </rng>
Nov 15 04:36:01 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:36:01 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:36:01 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:36:01 user nova-compute[74805]:     </memballoon>
Nov 15 04:36:01 user nova-compute[74805]:   </devices>
Nov 15 04:36:01 user nova-compute[74805]: </domain>
Nov 15 04:36:01 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:36:01 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Instance destroyed successfully.
Nov 15 04:36:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:36:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:36:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] No VIF found with MAC fa:16:3e:c6:13:c6, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:36:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:02 user nova-compute[74805]: DEBUG nova.compute.manager [req-bbf49891-c565-4a9a-81c0-1f6775ad29dc req-c87378a6-c1dc-4e68-8d51-e82a9daaf67d service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Received event network-vif-plugged-4d9bd2e9-b1dc-4fc8-b045-6e5513061c22 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:36:02 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bbf49891-c565-4a9a-81c0-1f6775ad29dc req-c87378a6-c1dc-4e68-8d51-e82a9daaf67d service nova] Acquiring lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:36:02 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bbf49891-c565-4a9a-81c0-1f6775ad29dc req-c87378a6-c1dc-4e68-8d51-e82a9daaf67d service nova] Lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:36:02 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bbf49891-c565-4a9a-81c0-1f6775ad29dc req-c87378a6-c1dc-4e68-8d51-e82a9daaf67d service nova] Lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:36:02 user nova-compute[74805]: DEBUG nova.compute.manager [req-bbf49891-c565-4a9a-81c0-1f6775ad29dc req-c87378a6-c1dc-4e68-8d51-e82a9daaf67d service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] No waiting events found dispatching network-vif-plugged-4d9bd2e9-b1dc-4fc8-b045-6e5513061c22 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:36:02 user nova-compute[74805]: WARNING nova.compute.manager [req-bbf49891-c565-4a9a-81c0-1f6775ad29dc req-c87378a6-c1dc-4e68-8d51-e82a9daaf67d service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Received unexpected event network-vif-plugged-4d9bd2e9-b1dc-4fc8-b045-6e5513061c22 for instance with vm_state active and task_state rescuing.
Nov 15 04:36:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "f99a9557-4951-49f0-931c-0dbab16478d8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:36:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:36:03 user nova-compute[74805]: INFO nova.compute.manager [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Detaching volume 1eedeb1c-bf1b-4e71-95f8-56be3f450ef5
Nov 15 04:36:03 user nova-compute[74805]: INFO nova.virt.block_device [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Attempting to driver detach volume 1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 from mountpoint /dev/vdb
Nov 15 04:36:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Attempting to detach device vdb from instance f99a9557-4951-49f0-931c-0dbab16478d8 from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:36:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:36:03 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:36:03 user nova-compute[74805]:   <source dev="/dev/sdb"/>
Nov 15 04:36:03 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:36:03 user nova-compute[74805]:   <serial>1eedeb1c-bf1b-4e71-95f8-56be3f450ef5</serial>
Nov 15 04:36:03 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:36:03 user nova-compute[74805]: </disk>
Nov 15 04:36:03 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:36:03 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Successfully detached device vdb from instance f99a9557-4951-49f0-931c-0dbab16478d8 from the persistent domain config.
Nov 15 04:36:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f99a9557-4951-49f0-931c-0dbab16478d8 from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:36:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:36:03 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:36:03 user nova-compute[74805]:   <source dev="/dev/sdb"/>
Nov 15 04:36:03 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:36:03 user nova-compute[74805]:   <serial>1eedeb1c-bf1b-4e71-95f8-56be3f450ef5</serial>
Nov 15 04:36:03 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:36:03 user nova-compute[74805]: </disk>
Nov 15 04:36:03 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:36:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f99a9557-4951-49f0-931c-0dbab16478d8 {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:36:04 user nova-compute[74805]: DEBUG nova.compute.manager [req-cbcfc876-2451-4827-bd85-0f4a3ce23c30 req-1b7be5a3-eb34-4566-bd2a-4b8a5c162fb4 service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Received event network-vif-plugged-4d9bd2e9-b1dc-4fc8-b045-6e5513061c22 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:36:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-cbcfc876-2451-4827-bd85-0f4a3ce23c30 req-1b7be5a3-eb34-4566-bd2a-4b8a5c162fb4 service nova] Acquiring lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:36:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-cbcfc876-2451-4827-bd85-0f4a3ce23c30 req-1b7be5a3-eb34-4566-bd2a-4b8a5c162fb4 service nova] Lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:36:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-cbcfc876-2451-4827-bd85-0f4a3ce23c30 req-1b7be5a3-eb34-4566-bd2a-4b8a5c162fb4 service nova] Lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:36:04 user nova-compute[74805]: DEBUG nova.compute.manager [req-cbcfc876-2451-4827-bd85-0f4a3ce23c30 req-1b7be5a3-eb34-4566-bd2a-4b8a5c162fb4 service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] No waiting events found dispatching network-vif-plugged-4d9bd2e9-b1dc-4fc8-b045-6e5513061c22 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:36:04 user nova-compute[74805]: WARNING nova.compute.manager [req-cbcfc876-2451-4827-bd85-0f4a3ce23c30 req-1b7be5a3-eb34-4566-bd2a-4b8a5c162fb4 service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Received unexpected event network-vif-plugged-4d9bd2e9-b1dc-4fc8-b045-6e5513061c22 for instance with vm_state active and task_state rescuing.
Nov 15 04:36:04 user nova-compute[74805]: DEBUG nova.compute.manager [req-cbcfc876-2451-4827-bd85-0f4a3ce23c30 req-1b7be5a3-eb34-4566-bd2a-4b8a5c162fb4 service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Received event network-vif-plugged-4d9bd2e9-b1dc-4fc8-b045-6e5513061c22 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:36:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-cbcfc876-2451-4827-bd85-0f4a3ce23c30 req-1b7be5a3-eb34-4566-bd2a-4b8a5c162fb4 service nova] Acquiring lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:36:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-cbcfc876-2451-4827-bd85-0f4a3ce23c30 req-1b7be5a3-eb34-4566-bd2a-4b8a5c162fb4 service nova] Lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:36:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-cbcfc876-2451-4827-bd85-0f4a3ce23c30 req-1b7be5a3-eb34-4566-bd2a-4b8a5c162fb4 service nova] Lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:36:04 user nova-compute[74805]: DEBUG nova.compute.manager [req-cbcfc876-2451-4827-bd85-0f4a3ce23c30 req-1b7be5a3-eb34-4566-bd2a-4b8a5c162fb4 service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] No waiting events found dispatching network-vif-plugged-4d9bd2e9-b1dc-4fc8-b045-6e5513061c22 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:36:04 user nova-compute[74805]: WARNING nova.compute.manager [req-cbcfc876-2451-4827-bd85-0f4a3ce23c30 req-1b7be5a3-eb34-4566-bd2a-4b8a5c162fb4 service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Received unexpected event network-vif-plugged-4d9bd2e9-b1dc-4fc8-b045-6e5513061c22 for instance with vm_state active and task_state rescuing.
Nov 15 04:36:04 user nova-compute[74805]: DEBUG nova.compute.manager [None req-46f45fc5-a858-4301-8676-dc10d072a4ad tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:36:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "6ece3a65-78ba-4648-877a-861ffb4ce523" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:36:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:36:16 user nova-compute[74805]: DEBUG nova.compute.manager [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:36:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:36:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:36:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:16 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:36:16 user nova-compute[74805]: INFO nova.compute.claims [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Claim successful on node user
Nov 15 04:36:17 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:36:17 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:36:17 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:36:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:36:17 user nova-compute[74805]: DEBUG nova.compute.manager [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:36:17 user nova-compute[74805]: DEBUG nova.compute.manager [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:36:17 user nova-compute[74805]: DEBUG nova.network.neutron [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:36:17 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:36:17 user nova-compute[74805]: DEBUG nova.compute.manager [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:36:17 user nova-compute[74805]: DEBUG nova.policy [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8cba9273daa1478fa6cc8274443b4f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11645073d58476491d101b9f3ee4052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:36:17 user nova-compute[74805]: INFO nova.virt.block_device [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Booting with volume-backed-image f5f2780a-c8f6-40c5-9044-7e9b73af604f at /dev/vda
Nov 15 04:36:18 user nova-compute[74805]: DEBUG nova.network.neutron [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Successfully created port: b4c47025-7d95-4d09-9371-614d2b198868 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:36:18 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:36:18 user nova-compute[74805]: DEBUG nova.network.neutron [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Successfully updated port: b4c47025-7d95-4d09-9371-614d2b198868 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:36:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "refresh_cache-6ece3a65-78ba-4648-877a-861ffb4ce523" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:36:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquired lock "refresh_cache-6ece3a65-78ba-4648-877a-861ffb4ce523" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:36:18 user nova-compute[74805]: DEBUG nova.network.neutron [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:36:18 user nova-compute[74805]: DEBUG nova.compute.manager [req-7f417d27-874f-47df-9720-6d74251fa255 req-5bde9c17-8fe4-4fb3-8233-b62de8317e88 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Received event network-changed-b4c47025-7d95-4d09-9371-614d2b198868 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:36:18 user nova-compute[74805]: DEBUG nova.compute.manager [req-7f417d27-874f-47df-9720-6d74251fa255 req-5bde9c17-8fe4-4fb3-8233-b62de8317e88 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Refreshing instance network info cache due to event network-changed-b4c47025-7d95-4d09-9371-614d2b198868. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:36:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7f417d27-874f-47df-9720-6d74251fa255 req-5bde9c17-8fe4-4fb3-8233-b62de8317e88 service nova] Acquiring lock "refresh_cache-6ece3a65-78ba-4648-877a-861ffb4ce523" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:36:18 user nova-compute[74805]: DEBUG nova.network.neutron [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:36:19 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:36:19 user nova-compute[74805]: DEBUG nova.network.neutron [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Updating instance_info_cache with network_info: [{"id": "b4c47025-7d95-4d09-9371-614d2b198868", "address": "fa:16:3e:fb:ec:0a", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c47025-7d", "ovs_interfaceid": "b4c47025-7d95-4d09-9371-614d2b198868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:36:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Releasing lock "refresh_cache-6ece3a65-78ba-4648-877a-861ffb4ce523" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:36:19 user nova-compute[74805]: DEBUG nova.compute.manager [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Instance network_info: |[{"id": "b4c47025-7d95-4d09-9371-614d2b198868", "address": "fa:16:3e:fb:ec:0a", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c47025-7d", "ovs_interfaceid": "b4c47025-7d95-4d09-9371-614d2b198868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:36:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7f417d27-874f-47df-9720-6d74251fa255 req-5bde9c17-8fe4-4fb3-8233-b62de8317e88 service nova] Acquired lock "refresh_cache-6ece3a65-78ba-4648-877a-861ffb4ce523" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:36:19 user nova-compute[74805]: DEBUG nova.network.neutron [req-7f417d27-874f-47df-9720-6d74251fa255 req-5bde9c17-8fe4-4fb3-8233-b62de8317e88 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Refreshing network info cache for port b4c47025-7d95-4d09-9371-614d2b198868 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:36:19 user nova-compute[74805]: DEBUG nova.network.neutron [req-7f417d27-874f-47df-9720-6d74251fa255 req-5bde9c17-8fe4-4fb3-8233-b62de8317e88 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Updated VIF entry in instance network info cache for port b4c47025-7d95-4d09-9371-614d2b198868. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:36:19 user nova-compute[74805]: DEBUG nova.network.neutron [req-7f417d27-874f-47df-9720-6d74251fa255 req-5bde9c17-8fe4-4fb3-8233-b62de8317e88 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Updating instance_info_cache with network_info: [{"id": "b4c47025-7d95-4d09-9371-614d2b198868", "address": "fa:16:3e:fb:ec:0a", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c47025-7d", "ovs_interfaceid": "b4c47025-7d95-4d09-9371-614d2b198868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:36:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7f417d27-874f-47df-9720-6d74251fa255 req-5bde9c17-8fe4-4fb3-8233-b62de8317e88 service nova] Releasing lock "refresh_cache-6ece3a65-78ba-4648-877a-861ffb4ce523" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:36:20 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:36:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:21 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:36:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:22 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:36:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:36:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:36:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:36:22 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:36:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:22 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG os_brick.utils [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfa43c9-5ec3-406f-8db7-b5893119cd2e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd011bdc-e24b-4755-901c-b6ee3d8c0fc4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36f624c-2bc4-4b1f-be8b-954ce9c7b8f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c671d55-fd16-4e5e-a867-d4c60e824d47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:36:23 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ab067b-0bae-4330-a1a6-e7e30fd8fb0f]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG os_brick.utils [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Updating existing volume attachment record: c275f878-5c05-43e9-8108-0cd743751883 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:23 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f99a9557-4951-49f0-931c-0dbab16478d8 is timed out.
Nov 15 04:36:23 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Successfully detached device vdb from instance f99a9557-4951-49f0-931c-0dbab16478d8 from the live domain config.
Nov 15 04:36:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsDwJILU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:36:23 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:36:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ea4e08-946d-426a-b5f7-6c27d1b23175]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:36:23 user nova-compute[74805]: No targets found.
Nov 15 04:36:23 user nova-compute[74805]: iSNS:
Nov 15 04:36:23 user nova-compute[74805]: No targets found.
Nov 15 04:36:23 user nova-compute[74805]: STATIC:
Nov 15 04:36:23 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5
Nov 15 04:36:23 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:36:23 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:36:23 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f
Nov 15 04:36:23 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:36:23 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:36:23 user nova-compute[74805]: FIRMWARE:
Nov 15 04:36:23 user nova-compute[74805]: No targets found.
Nov 15 04:36:23 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:36:23 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:36:23 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fd20382-1fed-46d8-8968-92d7fee9c3e0/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dfc7c7-5051-4f54-be96-110e3d6d1910]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f400f12-3afb-4326-85db-91686663983d]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:36:23 user nova-compute[74805]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 (non-flash)
Nov 15 04:36:23 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:36:23 user nova-compute[74805]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 (non-flash)
Nov 15 04:36:23 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2fb42372e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5'): ({'sdb'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Removing single pathed devices sdb {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[37128984-00de-4868-a287-0f4330093ebc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[428d7307-7fef-4426-a94e-bd68094d5c19]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Flushing IO for device /dev/sdb {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4784b322-d436-43f5-80c1-531c3b0025d8]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95c2116-91b6-4d25-b6dc-c1f1792a0ad3]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fd20382-1fed-46d8-8968-92d7fee9c3e0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fd20382-1fed-46d8-8968-92d7fee9c3e0/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a0bd86-5ae0-4c1c-b429-9128bb736a0f]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:36:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[20637c97-3173-4554-928e-9eabd021e492]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5, portal: 172.16.0.220,3260]
Nov 15 04:36:24 user nova-compute[74805]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5, portal: 172.16.0.220,3260] successful.
Nov 15 04:36:24 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:36:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eedeb1c-bf1b-4e71-95f8-56be3f450ef5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bb5a59-0676-42db-bae3-78d662a51990]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:36:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:36:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] <== disconnect_volume: return (362ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:36:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:36:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fd20382-1fed-46d8-8968-92d7fee9c3e0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:36:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:24 user nova-compute[74805]: DEBUG nova.objects.instance [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lazy-loading 'flavor' on Instance uuid f99a9557-4951-49f0-931c-0dbab16478d8 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:36:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-043f9fdf-dc65-482d-bee0-71438617cfe0 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.778s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:36:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:25 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:36:25 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:36:25 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=8240MB free_disk=24.90912628173828GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:36:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:36:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:36:25 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 9f267864-0b72-431d-9b0d-c63436002a4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:36:25 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 38196606-a9c9-4604-ad21-2ec7511a8b28 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:36:25 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 288a5e5c-f8e9-4507-b29c-93e7595922ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:36:25 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance f99a9557-4951-49f0-931c-0dbab16478d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:36:25 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 75731a3d-3c78-4014-a8dc-f38c3d7b3305 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:36:25 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:36:25 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 7fd20382-1fed-46d8-8968-92d7fee9c3e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:36:25 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 6ece3a65-78ba-4648-877a-861ffb4ce523 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:36:25 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:36:25 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:36:25 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Refreshing inventories for resource provider ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 04:36:25 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Updating ProviderTree inventory for provider ada87504-5552-4a33-b754-f9a54c67fe39 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 04:36:25 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Updating inventory in ProviderTree for provider ada87504-5552-4a33-b754-f9a54c67fe39 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 04:36:25 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Refreshing aggregate associations for resource provider ada87504-5552-4a33-b754-f9a54c67fe39, aggregates: None {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 04:36:25 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Refreshing trait associations for resource provider ada87504-5552-4a33-b754-f9a54c67fe39, traits: COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 04:36:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:25 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:36:25 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:36:26 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:36:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.631s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:36:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:27 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:36:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:36:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-288a5e5c-f8e9-4507-b29c-93e7595922ac" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:36:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-288a5e5c-f8e9-4507-b29c-93e7595922ac" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:36:27 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:36:27 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Updating instance_info_cache with network_info: [{"id": "e0bce47a-8a77-465f-806c-8d4e9b38ca63", "address": "fa:16:3e:23:45:c9", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bce47a-8a", "ovs_interfaceid": "e0bce47a-8a77-465f-806c-8d4e9b38ca63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:36:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-288a5e5c-f8e9-4507-b29c-93e7595922ac" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:36:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:36:27 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:36:27 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:36:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:36:27 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG nova.compute.manager [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:36:28 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Creating image(s)
Nov 15 04:36:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Did not create local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Ensure instance console log exists: /opt/stack/data/nova/instances/6ece3a65-78ba-4648-877a-861ffb4ce523/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Start _get_guest_xml network_info=[{"id": "b4c47025-7d95-4d09-9371-614d2b198868", "address": "fa:16:3e:fb:ec:0a", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c47025-7d", "ovs_interfaceid": "b4c47025-7d95-4d09-9371-614d2b198868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eUclRvSm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6ece3a65-78ba-4648-877a-861ffb4ce523', 'attached_at': '', 'detached_at': '', 'volume_id': 'cf37200c-a534-4aae-8d56-966f0f260ada', 'serial': 'cf37200c-a534-4aae-8d56-966f0f260ada'}, 'delete_on_termination': False, 'attachment_id': 'c275f878-5c05-43e9-8108-0cd743751883', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:36:28 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:36:28 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:36:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eUclRvSm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:36:28 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:36:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:36:28 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:36:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:36:28 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[421ea9f4-2dc6-4726-b67c-386c99835734]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:36:28 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46cda49-7af2-4210-8441-73735b362556]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada] added
Nov 15 04:36:28 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7a3308-2bb2-49e7-a84c-7794aa2bb9bb]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[56048996-93ae-4186-9413-2bd073ea3f28]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eUclRvSm {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eUclRvSm" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b1073f-bf5a-43a4-883e-7a061dd61ae8]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eUclRvSm'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[46176f63-e7cc-4c71-93c3-6418995f206b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[601ba354-26f9-4830-b407-eebb38b693c7]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:36:28 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:36:28 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bb669f-096f-4d9d-9dd7-1866ab1f348f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada, portal: 172.16.0.220,3260]
Nov 15 04:36:28 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada, portal: 172.16.0.220,3260] successful.
Nov 15 04:36:28 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ddb37e-8545-49be-bc99-fd06931a3aca]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[85548de1-8e0f-4006-aa44-82fa0a1fa45f]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:36:28 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:36:28 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:36:28 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:36:28 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21dc7d8-6ba7-4adf-8aa9-da0155f2130f]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:28 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:36:29 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:36:29 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eUclRvSm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:36:29 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:36:29 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26464343761633262', 'path': '/dev/sdb'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:36:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464343761633262', 'path': '/dev/sdb'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:36:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:36:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1272061911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1272061911',id=44,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d11645073d58476491d101b9f3ee4052',ramdisk_id='',reservation_id='r-b2efqm1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1297861260',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:36:18Z,user_data=None,user_id='8cba9273daa1478fa6cc8274443b4f40',uuid=6ece3a65-78ba-4648-877a-861ffb4ce523,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4c47025-7d95-4d09-9371-614d2b198868", "address": "fa:16:3e:fb:ec:0a", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c47025-7d", "ovs_interfaceid": "b4c47025-7d95-4d09-9371-614d2b198868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:36:29 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Converting VIF {"id": "b4c47025-7d95-4d09-9371-614d2b198868", "address": "fa:16:3e:fb:ec:0a", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c47025-7d", "ovs_interfaceid": "b4c47025-7d95-4d09-9371-614d2b198868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:36:29 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:ec:0a,bridge_name='br-int',has_traffic_filtering=True,id=b4c47025-7d95-4d09-9371-614d2b198868,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4c47025-7d') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:36:29 user nova-compute[74805]: DEBUG nova.objects.instance [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ece3a65-78ba-4648-877a-861ffb4ce523 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:36:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:36:29 user nova-compute[74805]:   <uuid>6ece3a65-78ba-4648-877a-861ffb4ce523</uuid>
Nov 15 04:36:29 user nova-compute[74805]:   <name>instance-0000002c</name>
Nov 15 04:36:29 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:36:29 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:36:29 user nova-compute[74805]:   <metadata>
Nov 15 04:36:29 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:36:29 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:36:29 user nova-compute[74805]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1272061911</nova:name>
Nov 15 04:36:29 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:36:28</nova:creationTime>
Nov 15 04:36:29 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:36:29 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:36:29 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:36:29 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:36:29 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:36:29 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:36:29 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:36:29 user nova-compute[74805]:       <nova:owner>
Nov 15 04:36:29 user nova-compute[74805]:         <nova:user uuid="8cba9273daa1478fa6cc8274443b4f40">tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member</nova:user>
Nov 15 04:36:29 user nova-compute[74805]:         <nova:project uuid="d11645073d58476491d101b9f3ee4052">tempest-ServerBootFromVolumeStableRescueTest-1297861260</nova:project>
Nov 15 04:36:29 user nova-compute[74805]:       </nova:owner>
Nov 15 04:36:29 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:36:29 user nova-compute[74805]:       <nova:ports>
Nov 15 04:36:29 user nova-compute[74805]:         <nova:port uuid="b4c47025-7d95-4d09-9371-614d2b198868">
Nov 15 04:36:29 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 04:36:29 user nova-compute[74805]:         </nova:port>
Nov 15 04:36:29 user nova-compute[74805]:       </nova:ports>
Nov 15 04:36:29 user nova-compute[74805]:     </nova:instance>
Nov 15 04:36:29 user nova-compute[74805]:   </metadata>
Nov 15 04:36:29 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:36:29 user nova-compute[74805]:     <system>
Nov 15 04:36:29 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:36:29 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:36:29 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:36:29 user nova-compute[74805]:       <entry name="serial">6ece3a65-78ba-4648-877a-861ffb4ce523</entry>
Nov 15 04:36:29 user nova-compute[74805]:       <entry name="uuid">6ece3a65-78ba-4648-877a-861ffb4ce523</entry>
Nov 15 04:36:29 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:36:29 user nova-compute[74805]:     </system>
Nov 15 04:36:29 user nova-compute[74805]:   </sysinfo>
Nov 15 04:36:29 user nova-compute[74805]:   <os>
Nov 15 04:36:29 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:36:29 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:36:29 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:36:29 user nova-compute[74805]:   </os>
Nov 15 04:36:29 user nova-compute[74805]:   <features>
Nov 15 04:36:29 user nova-compute[74805]:     <acpi/>
Nov 15 04:36:29 user nova-compute[74805]:     <apic/>
Nov 15 04:36:29 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:36:29 user nova-compute[74805]:   </features>
Nov 15 04:36:29 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:36:29 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:36:29 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:36:29 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:36:29 user nova-compute[74805]:   </clock>
Nov 15 04:36:29 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:36:29 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:36:29 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:36:29 user nova-compute[74805]:   </cpu>
Nov 15 04:36:29 user nova-compute[74805]:   <devices>
Nov 15 04:36:29 user nova-compute[74805]:     <disk type="block" device="disk">
Nov 15 04:36:29 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:36:29 user nova-compute[74805]:       <source dev="/dev/sdb"/>
Nov 15 04:36:29 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:36:29 user nova-compute[74805]:       <serial>cf37200c-a534-4aae-8d56-966f0f260ada</serial>
Nov 15 04:36:29 user nova-compute[74805]:     </disk>
Nov 15 04:36:29 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:36:29 user nova-compute[74805]:       <mac address="fa:16:3e:fb:ec:0a"/>
Nov 15 04:36:29 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:36:29 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:36:29 user nova-compute[74805]:       <target dev="tapb4c47025-7d"/>
Nov 15 04:36:29 user nova-compute[74805]:     </interface>
Nov 15 04:36:29 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:36:29 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/6ece3a65-78ba-4648-877a-861ffb4ce523/console.log" append="off"/>
Nov 15 04:36:29 user nova-compute[74805]:     </serial>
Nov 15 04:36:29 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:36:29 user nova-compute[74805]:     <video>
Nov 15 04:36:29 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:36:29 user nova-compute[74805]:     </video>
Nov 15 04:36:29 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:36:29 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:36:29 user nova-compute[74805]:     </rng>
Nov 15 04:36:29 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:36:29 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:36:29 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:36:29 user nova-compute[74805]:     </memballoon>
Nov 15 04:36:29 user nova-compute[74805]:   </devices>
Nov 15 04:36:29 user nova-compute[74805]: </domain>
Nov 15 04:36:29 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:36:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:36:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1272061911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1272061911',id=44,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d11645073d58476491d101b9f3ee4052',ramdisk_id='',reservation_id='r-b2efqm1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1297861260',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:36:18Z,user_data=None,user_id='8cba9273daa1478fa6cc8274443b4f40',uuid=6ece3a65-78ba-4648-877a-861ffb4ce523,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4c47025-7d95-4d09-9371-614d2b198868", "address": "fa:16:3e:fb:ec:0a", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c47025-7d", "ovs_interfaceid": "b4c47025-7d95-4d09-9371-614d2b198868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:36:29 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Converting VIF {"id": "b4c47025-7d95-4d09-9371-614d2b198868", "address": "fa:16:3e:fb:ec:0a", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c47025-7d", "ovs_interfaceid": "b4c47025-7d95-4d09-9371-614d2b198868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:36:29 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:ec:0a,bridge_name='br-int',has_traffic_filtering=True,id=b4c47025-7d95-4d09-9371-614d2b198868,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4c47025-7d') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:36:29 user nova-compute[74805]: DEBUG os_vif [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:ec:0a,bridge_name='br-int',has_traffic_filtering=True,id=b4c47025-7d95-4d09-9371-614d2b198868,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4c47025-7d') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:36:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:36:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:36:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dacfbecb-e30e-54ef-ace1-a7913f0120a0', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:36:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:36:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4c47025-7d, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:36:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4c47025-7d, col_values=(('qos', UUID('ec819942-d25e-4b74-a354-666d0809dd6a')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:36:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4c47025-7d, col_values=(('external_ids', {'iface-id': 'b4c47025-7d95-4d09-9371-614d2b198868', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:ec:0a', 'vm-uuid': '6ece3a65-78ba-4648-877a-861ffb4ce523'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:36:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:36:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:29 user nova-compute[74805]: INFO os_vif [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:ec:0a,bridge_name='br-int',has_traffic_filtering=True,id=b4c47025-7d95-4d09-9371-614d2b198868,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4c47025-7d')
Nov 15 04:36:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:36:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] No VIF found with MAC fa:16:3e:fb:ec:0a, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:36:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:31 user nova-compute[74805]: DEBUG nova.compute.manager [req-59becbe9-bb15-43de-bb98-0c6ece2e946a req-7b5f584e-bbc7-4292-a444-daaace87fa40 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Received event network-vif-plugged-b4c47025-7d95-4d09-9371-614d2b198868 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:36:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-59becbe9-bb15-43de-bb98-0c6ece2e946a req-7b5f584e-bbc7-4292-a444-daaace87fa40 service nova] Acquiring lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:36:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-59becbe9-bb15-43de-bb98-0c6ece2e946a req-7b5f584e-bbc7-4292-a444-daaace87fa40 service nova] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:36:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-59becbe9-bb15-43de-bb98-0c6ece2e946a req-7b5f584e-bbc7-4292-a444-daaace87fa40 service nova] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:36:31 user nova-compute[74805]: DEBUG nova.compute.manager [req-59becbe9-bb15-43de-bb98-0c6ece2e946a req-7b5f584e-bbc7-4292-a444-daaace87fa40 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] No waiting events found dispatching network-vif-plugged-b4c47025-7d95-4d09-9371-614d2b198868 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:36:31 user nova-compute[74805]: WARNING nova.compute.manager [req-59becbe9-bb15-43de-bb98-0c6ece2e946a req-7b5f584e-bbc7-4292-a444-daaace87fa40 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Received unexpected event network-vif-plugged-b4c47025-7d95-4d09-9371-614d2b198868 for instance with vm_state building and task_state spawning.
Nov 15 04:36:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:33 user nova-compute[74805]: DEBUG nova.compute.manager [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:36:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:36:33 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Instance spawned successfully.
Nov 15 04:36:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:36:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:36:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:36:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:36:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:36:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:36:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:36:33 user nova-compute[74805]: DEBUG nova.compute.manager [req-d17b6ecd-5a53-4f3f-8038-a4c63b97e32f req-3ba66e92-03d8-4ad0-8fed-87f2cde4babe service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Received event network-vif-plugged-b4c47025-7d95-4d09-9371-614d2b198868 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:36:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d17b6ecd-5a53-4f3f-8038-a4c63b97e32f req-3ba66e92-03d8-4ad0-8fed-87f2cde4babe service nova] Acquiring lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:36:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d17b6ecd-5a53-4f3f-8038-a4c63b97e32f req-3ba66e92-03d8-4ad0-8fed-87f2cde4babe service nova] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:36:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d17b6ecd-5a53-4f3f-8038-a4c63b97e32f req-3ba66e92-03d8-4ad0-8fed-87f2cde4babe service nova] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:36:33 user nova-compute[74805]: DEBUG nova.compute.manager [req-d17b6ecd-5a53-4f3f-8038-a4c63b97e32f req-3ba66e92-03d8-4ad0-8fed-87f2cde4babe service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] No waiting events found dispatching network-vif-plugged-b4c47025-7d95-4d09-9371-614d2b198868 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:36:33 user nova-compute[74805]: WARNING nova.compute.manager [req-d17b6ecd-5a53-4f3f-8038-a4c63b97e32f req-3ba66e92-03d8-4ad0-8fed-87f2cde4babe service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Received unexpected event network-vif-plugged-b4c47025-7d95-4d09-9371-614d2b198868 for instance with vm_state building and task_state spawning.
Nov 15 04:36:33 user nova-compute[74805]: INFO nova.compute.manager [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Took 4.98 seconds to spawn the instance on the hypervisor.
Nov 15 04:36:33 user nova-compute[74805]: DEBUG nova.compute.manager [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:36:33 user nova-compute[74805]: INFO nova.compute.manager [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Took 16.60 seconds to build instance.
Nov 15 04:36:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6f10c8c0-35c6-433d-8409-e30fe80ebd8c tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.696s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:36:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:36:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:36:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:54 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "f99a9557-4951-49f0-931c-0dbab16478d8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:36:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:36:55 user nova-compute[74805]: DEBUG nova.objects.instance [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lazy-loading 'flavor' on Instance uuid f99a9557-4951-49f0-931c-0dbab16478d8 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:36:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:36:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "f99a9557-4951-49f0-931c-0dbab16478d8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:36:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:36:55 user nova-compute[74805]: INFO nova.compute.manager [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Attaching volume 931ae7f8-d5df-4d53-a371-534e53085ce7 to /dev/vdb
Nov 15 04:36:55 user nova-compute[74805]: DEBUG os_brick.utils [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:36:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9fe218-1487-4a36-a447-533e70ac70ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[82729288-ada1-4d0f-b359-a9395a68364f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:36:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[74814577-e6bb-45b7-aba0-11714674e02a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc985bce-09c8-45fc-916b-3a6f9335f353]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:36:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:36:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:36:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:36:55 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:36:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fb4ccf-f432-4353-99d8-22d7287afeca]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:36:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:36:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:36:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:36:55 user nova-compute[74805]: DEBUG os_brick.utils [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:36:55 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Updating existing volume attachment record: 94fa3543-899e-46cd-a41d-cee826f2119a {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:36:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:36:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QxWNuFZl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:37:00 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:37:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:37:00 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:37:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:37:00 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb9cc6d-7184-4554-8d0e-da31a3f4a92f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:37:00 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[baffaf2d-d91d-4efe-a9d2-a88e3f65f720]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7] added
Nov 15 04:37:00 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f636a33-e96b-4813-8ba9-1c6c21222153]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5599322b-17a8-467d-a14c-134a1268fa51]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QxWNuFZl {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QxWNuFZl" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b64967-0c30-4421-ac09-0a8b3cacc61e]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QxWNuFZl'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ed0189-8c1d-44be-8daa-914179062d95]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2026beed-2cc4-4013-b885-b668b4e7004d]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:37:00 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:37:00 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:37:00 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:37:00 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a280a284-7670-48b7-ab44-b93dfc4800f5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7, portal: 172.16.0.220,3260]
Nov 15 04:37:00 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7, portal: 172.16.0.220,3260] successful.
Nov 15 04:37:00 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b68946-db37-447c-a5d4-6cf395c5dc62]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ac8c4f-5f54-44ab-bd61-70896f3dd171]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:37:00 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:37:00 user nova-compute[74805]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7 (non-flash)
Nov 15 04:37:00 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:37:00 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:37:00 user nova-compute[74805]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7 (non-flash)
Nov 15 04:37:00 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8172c93e-d278-44c4-a2d2-88126ba241a4]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QxWNuFZl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:37:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:37:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23463646238663661', 'path': '/dev/sdc'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:37:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463646238663661', 'path': '/dev/sdc'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:37:01 user nova-compute[74805]: DEBUG nova.objects.instance [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lazy-loading 'flavor' on Instance uuid f99a9557-4951-49f0-931c-0dbab16478d8 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:37:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:37:01 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:37:01 user nova-compute[74805]:   <source dev="/dev/sdc"/>
Nov 15 04:37:01 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:37:01 user nova-compute[74805]:   <serial>931ae7f8-d5df-4d53-a371-534e53085ce7</serial>
Nov 15 04:37:01 user nova-compute[74805]: </disk>
Nov 15 04:37:01 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:37:02 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:37:02 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:37:02 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] No VIF found with MAC fa:16:3e:f6:5f:e4, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:37:02 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8650cb69-fb95-4cfd-8a05-4cd4cf9c0058 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.904s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:37:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "f99a9557-4951-49f0-931c-0dbab16478d8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:37:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:37:04 user nova-compute[74805]: INFO nova.compute.manager [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Detaching volume 931ae7f8-d5df-4d53-a371-534e53085ce7
Nov 15 04:37:04 user nova-compute[74805]: INFO nova.virt.block_device [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Attempting to driver detach volume 931ae7f8-d5df-4d53-a371-534e53085ce7 from mountpoint /dev/vdb
Nov 15 04:37:04 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Attempting to detach device vdb from instance f99a9557-4951-49f0-931c-0dbab16478d8 from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:37:04 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:37:04 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:37:04 user nova-compute[74805]:   <source dev="/dev/sdc"/>
Nov 15 04:37:04 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:37:04 user nova-compute[74805]:   <serial>931ae7f8-d5df-4d53-a371-534e53085ce7</serial>
Nov 15 04:37:04 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:37:04 user nova-compute[74805]: </disk>
Nov 15 04:37:04 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:37:04 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Successfully detached device vdb from instance f99a9557-4951-49f0-931c-0dbab16478d8 from the persistent domain config.
Nov 15 04:37:04 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f99a9557-4951-49f0-931c-0dbab16478d8 from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:37:04 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:37:04 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:37:04 user nova-compute[74805]:   <source dev="/dev/sdc"/>
Nov 15 04:37:04 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:37:04 user nova-compute[74805]:   <serial>931ae7f8-d5df-4d53-a371-534e53085ce7</serial>
Nov 15 04:37:04 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:37:04 user nova-compute[74805]: </disk>
Nov 15 04:37:04 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:37:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:04 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f99a9557-4951-49f0-931c-0dbab16478d8 {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:37:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:09 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:18 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:37:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:19 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:37:19 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:37:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:21 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:37:21 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:37:23 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:37:23 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:37:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-f99a9557-4951-49f0-931c-0dbab16478d8" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:37:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-f99a9557-4951-49f0-931c-0dbab16478d8" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:37:23 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:37:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:23 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Updating instance_info_cache with network_info: [{"id": "36f925e7-241b-453e-84bd-a6dc8c213650", "address": "fa:16:3e:f6:5f:e4", "network": {"id": "c5d73469-8aa8-4d7b-bee8-ffcedcaae340", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1298527383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8464c1b545064c9f8e5f20d23417ed48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f925e7-24", "ovs_interfaceid": "36f925e7-241b-453e-84bd-a6dc8c213650", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:37:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-f99a9557-4951-49f0-931c-0dbab16478d8" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:37:23 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:37:24 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:37:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:37:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:37:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:37:24 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:37:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:24 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f99a9557-4951-49f0-931c-0dbab16478d8 is timed out.
Nov 15 04:37:24 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Successfully detached device vdb from instance f99a9557-4951-49f0-931c-0dbab16478d8 from the live domain config.
Nov 15 04:37:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:37:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QxWNuFZl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:37:24 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:37:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:37:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:37:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f989f8b-d26d-4c04-a95d-b3514abae24b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:37:24 user nova-compute[74805]: No targets found.
Nov 15 04:37:24 user nova-compute[74805]: iSNS:
Nov 15 04:37:24 user nova-compute[74805]: No targets found.
Nov 15 04:37:24 user nova-compute[74805]: STATIC:
Nov 15 04:37:24 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f
Nov 15 04:37:24 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:37:24 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:37:24 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7
Nov 15 04:37:24 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:37:24 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:37:24 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada
Nov 15 04:37:24 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:37:24 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:37:24 user nova-compute[74805]: FIRMWARE:
Nov 15 04:37:24 user nova-compute[74805]: No targets found.
Nov 15 04:37:24 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:37:25 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:37:25 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff859a1-9fdc-4b0e-bc6c-1419bd2a5afe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a4fa52-2961-4371-972b-6a764b0f18d0]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:37:25 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:37:25 user nova-compute[74805]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7 (non-flash)
Nov 15 04:37:25 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:37:25 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:37:25 user nova-compute[74805]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7 (non-flash)
Nov 15 04:37:25 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f787ca290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7'): ({'sdc'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Removing single pathed devices sdc {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[065331c3-47e6-49d1-95ac-80e70c90f934]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a68699-44f3-497f-ab03-1a272bfe3aab]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Flushing IO for device /dev/sdc {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1314d5b-e7f4-4d06-9f49-20f4990e1dbc]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50efc18-6609-4d05-a3f3-92151946c411]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8116dfc5-7161-461f-871b-6bfbba2f69e1]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e06306-6a91-4874-a4e9-246ead1b7cf6]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7, portal: 172.16.0.220,3260]
Nov 15 04:37:25 user nova-compute[74805]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7, portal: 172.16.0.220,3260] successful.
Nov 15 04:37:25 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:931ae7f8-d5df-4d53-a371-534e53085ce7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4c7afd-12aa-40b8-b976-99755ecd0c1b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.415s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] <== disconnect_volume: return (417ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fd20382-1fed-46d8-8968-92d7fee9c3e0/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fd20382-1fed-46d8-8968-92d7fee9c3e0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fd20382-1fed-46d8-8968-92d7fee9c3e0/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-26c3d53d-4e77-42b4-981d-5081c172669d req-67222fe9-9048-457d-961e-f6ad2d6a7532 service nova] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Received event network-changed-04f57de7-3ac1-4d29-96c6-c9b7ec2149f1 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-26c3d53d-4e77-42b4-981d-5081c172669d req-67222fe9-9048-457d-961e-f6ad2d6a7532 service nova] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Refreshing instance network info cache due to event network-changed-04f57de7-3ac1-4d29-96c6-c9b7ec2149f1. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-26c3d53d-4e77-42b4-981d-5081c172669d req-67222fe9-9048-457d-961e-f6ad2d6a7532 service nova] Acquiring lock "refresh_cache-7fd20382-1fed-46d8-8968-92d7fee9c3e0" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-26c3d53d-4e77-42b4-981d-5081c172669d req-67222fe9-9048-457d-961e-f6ad2d6a7532 service nova] Acquired lock "refresh_cache-7fd20382-1fed-46d8-8968-92d7fee9c3e0" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG nova.network.neutron [req-26c3d53d-4e77-42b4-981d-5081c172669d req-67222fe9-9048-457d-961e-f6ad2d6a7532 service nova] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Refreshing network info cache for port 04f57de7-3ac1-4d29-96c6-c9b7ec2149f1 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG nova.objects.instance [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lazy-loading 'flavor' on Instance uuid f99a9557-4951-49f0-931c-0dbab16478d8 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fd20382-1fed-46d8-8968-92d7fee9c3e0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9d580059-3769-413e-a90c-7b7e164b02f5 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.920s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG nova.objects.instance [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lazy-loading 'flavor' on Instance uuid 7fd20382-1fed-46d8-8968-92d7fee9c3e0 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:37:26 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Ignoring supplied device name: /dev/vdb
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:37:26 user nova-compute[74805]: INFO nova.compute.manager [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Attaching volume 711aa9c5-29da-49b6-b034-9a41b3e19bc6 to /dev/vdb
Nov 15 04:37:26 user nova-compute[74805]: DEBUG os_brick.utils [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG nova.network.neutron [req-26c3d53d-4e77-42b4-981d-5081c172669d req-67222fe9-9048-457d-961e-f6ad2d6a7532 service nova] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Updated VIF entry in instance network info cache for port 04f57de7-3ac1-4d29-96c6-c9b7ec2149f1. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG nova.network.neutron [req-26c3d53d-4e77-42b4-981d-5081c172669d req-67222fe9-9048-457d-961e-f6ad2d6a7532 service nova] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Updating instance_info_cache with network_info: [{"id": "04f57de7-3ac1-4d29-96c6-c9b7ec2149f1", "address": "fa:16:3e:87:54:19", "network": {"id": "56e28167-fe83-43e1-9efc-81f625e2b727", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760042206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3b66fd3bcaa4720a38b00388797825a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f57de7-3a", "ovs_interfaceid": "04f57de7-3ac1-4d29-96c6-c9b7ec2149f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa77400-850e-4a7c-9166-6ecc84ec55ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb14f116-7281-487e-9dd1-991d21be038a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-26c3d53d-4e77-42b4-981d-5081c172669d req-67222fe9-9048-457d-961e-f6ad2d6a7532 service nova] Releasing lock "refresh_cache-7fd20382-1fed-46d8-8968-92d7fee9c3e0" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b83fcc5-77c0-42e4-ab4d-a9ef160a5299]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c6f91c-aaa1-4b0e-817f-548f9c8cf55b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:37:26 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6549815-d151-48cc-b914-bcb36bbf93c3]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG os_brick.utils [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] <== get_connector_properties: return (184ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Updating existing volume attachment record: 57fc23db-9ade-4d9a-bb81-833912b683ef {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:27 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:37:27 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:37:27 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=8083MB free_disk=24.89620590209961GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:37:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:37:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:37:28 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 9f267864-0b72-431d-9b0d-c63436002a4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:37:28 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 38196606-a9c9-4604-ad21-2ec7511a8b28 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:37:28 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 288a5e5c-f8e9-4507-b29c-93e7595922ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:37:28 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance f99a9557-4951-49f0-931c-0dbab16478d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:37:28 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 75731a3d-3c78-4014-a8dc-f38c3d7b3305 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:37:28 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:37:28 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 7fd20382-1fed-46d8-8968-92d7fee9c3e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:37:28 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 6ece3a65-78ba-4648-877a-861ffb4ce523 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:37:28 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:37:28 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:37:28 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:37:28 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:37:28 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:37:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.657s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:37:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:30 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:37:30 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:37:30 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:37:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pynHTFkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:37:31 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:37:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:37:31 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:37:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:37:31 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[394d4309-b0a5-48b3-bd23-ca6ff4a51ae1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:37:31 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[195331b3-de1f-45d8-bcc2-121440abba2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6] added
Nov 15 04:37:31 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[92120d5d-31a3-443d-91b0-25d22350081b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[121c06cf-61d6-4d7a-8be9-fdc8df6ba937]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pynHTFkr {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pynHTFkr" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[268be743-891c-460c-b835-c005348f708e]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pynHTFkr'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1359cd-8b3a-4553-9496-4892f44a246e]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[835cab49-129c-4e01-97a9-074f47a0070d]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:37:31 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:37:31 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:37:31 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:37:31 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a032f0e3-64fd-49b1-a38e-7e8833c08146]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6, portal: 172.16.0.220,3260]
Nov 15 04:37:31 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6, portal: 172.16.0.220,3260] successful.
Nov 15 04:37:31 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71e97bb-20d9-4a09-b24d-1dc63142fc6b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9024a569-2bfd-43af-9f32-fb3af0dce5aa]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:37:31 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:37:31 user nova-compute[74805]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 (non-flash)
Nov 15 04:37:31 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:37:31 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:37:31 user nova-compute[74805]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 (non-flash)
Nov 15 04:37:31 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9a1b61-a992-47a3-9596-3b0df24916e2]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:37:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pynHTFkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:37:32 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:37:32 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23931646631376364', 'path': '/dev/sdc'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:37:32 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931646631376364', 'path': '/dev/sdc'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:37:32 user nova-compute[74805]: DEBUG nova.objects.instance [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lazy-loading 'flavor' on Instance uuid 7fd20382-1fed-46d8-8968-92d7fee9c3e0 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:37:32 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:37:32 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:37:32 user nova-compute[74805]:   <source dev="/dev/sdc"/>
Nov 15 04:37:32 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:37:32 user nova-compute[74805]:   <serial>711aa9c5-29da-49b6-b034-9a41b3e19bc6</serial>
Nov 15 04:37:32 user nova-compute[74805]: </disk>
Nov 15 04:37:32 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:37:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:37:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:37:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] No VIF found with MAC fa:16:3e:87:54:19, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:37:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-97a543da-0f24-4296-9eb7-e6f649d93bd7 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.910s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:37:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "4612bf54-bb3c-47e8-a6ff-bd5470687844" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:37:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "4612bf54-bb3c-47e8-a6ff-bd5470687844" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:37:36 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:37:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:37:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:37:36 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:37:36 user nova-compute[74805]: INFO nova.compute.claims [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Claim successful on node user
Nov 15 04:37:37 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:37:37 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:37:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:37:37 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:37:37 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:37:37 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:37:37 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:37:37 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:37:37 user nova-compute[74805]: INFO nova.virt.block_device [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Booting with volume snapshot bfce66da-1a5f-4022-a4ce-106167e94d97 at /dev/vda
Nov 15 04:37:37 user nova-compute[74805]: DEBUG nova.policy [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bd96ecd9d404779ad64456c6517591f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2744859f249a4326ab6d268319a34b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:37:37 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Successfully created port: aad08482-050c-4d99-babd-5c9d8b0a11d6 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:37:38 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Successfully updated port: aad08482-050c-4d99-babd-5c9d8b0a11d6 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:37:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "refresh_cache-4612bf54-bb3c-47e8-a6ff-bd5470687844" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:37:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquired lock "refresh_cache-4612bf54-bb3c-47e8-a6ff-bd5470687844" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:37:38 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:37:38 user nova-compute[74805]: DEBUG nova.compute.manager [req-900e52fe-749e-4f8d-94db-76ddb4026abb req-3f898fd5-913d-47cb-9598-60d5bf7a39aa service nova] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Received event network-changed-aad08482-050c-4d99-babd-5c9d8b0a11d6 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:37:38 user nova-compute[74805]: DEBUG nova.compute.manager [req-900e52fe-749e-4f8d-94db-76ddb4026abb req-3f898fd5-913d-47cb-9598-60d5bf7a39aa service nova] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Refreshing instance network info cache due to event network-changed-aad08482-050c-4d99-babd-5c9d8b0a11d6. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:37:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-900e52fe-749e-4f8d-94db-76ddb4026abb req-3f898fd5-913d-47cb-9598-60d5bf7a39aa service nova] Acquiring lock "refresh_cache-4612bf54-bb3c-47e8-a6ff-bd5470687844" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:37:38 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:37:38 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Updating instance_info_cache with network_info: [{"id": "aad08482-050c-4d99-babd-5c9d8b0a11d6", "address": "fa:16:3e:6e:e9:e6", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad08482-05", "ovs_interfaceid": "aad08482-050c-4d99-babd-5c9d8b0a11d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:37:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Releasing lock "refresh_cache-4612bf54-bb3c-47e8-a6ff-bd5470687844" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:37:38 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Instance network_info: |[{"id": "aad08482-050c-4d99-babd-5c9d8b0a11d6", "address": "fa:16:3e:6e:e9:e6", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad08482-05", "ovs_interfaceid": "aad08482-050c-4d99-babd-5c9d8b0a11d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:37:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-900e52fe-749e-4f8d-94db-76ddb4026abb req-3f898fd5-913d-47cb-9598-60d5bf7a39aa service nova] Acquired lock "refresh_cache-4612bf54-bb3c-47e8-a6ff-bd5470687844" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:37:38 user nova-compute[74805]: DEBUG nova.network.neutron [req-900e52fe-749e-4f8d-94db-76ddb4026abb req-3f898fd5-913d-47cb-9598-60d5bf7a39aa service nova] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Refreshing network info cache for port aad08482-050c-4d99-babd-5c9d8b0a11d6 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:37:39 user nova-compute[74805]: DEBUG nova.network.neutron [req-900e52fe-749e-4f8d-94db-76ddb4026abb req-3f898fd5-913d-47cb-9598-60d5bf7a39aa service nova] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Updated VIF entry in instance network info cache for port aad08482-050c-4d99-babd-5c9d8b0a11d6. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:37:39 user nova-compute[74805]: DEBUG nova.network.neutron [req-900e52fe-749e-4f8d-94db-76ddb4026abb req-3f898fd5-913d-47cb-9598-60d5bf7a39aa service nova] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Updating instance_info_cache with network_info: [{"id": "aad08482-050c-4d99-babd-5c9d8b0a11d6", "address": "fa:16:3e:6e:e9:e6", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad08482-05", "ovs_interfaceid": "aad08482-050c-4d99-babd-5c9d8b0a11d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:37:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-900e52fe-749e-4f8d-94db-76ddb4026abb req-3f898fd5-913d-47cb-9598-60d5bf7a39aa service nova] Releasing lock "refresh_cache-4612bf54-bb3c-47e8-a6ff-bd5470687844" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:37:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:37:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:37:41 user nova-compute[74805]: INFO nova.compute.manager [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Detaching volume 711aa9c5-29da-49b6-b034-9a41b3e19bc6
Nov 15 04:37:41 user nova-compute[74805]: INFO nova.virt.block_device [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Attempting to driver detach volume 711aa9c5-29da-49b6-b034-9a41b3e19bc6 from mountpoint /dev/vdb
Nov 15 04:37:41 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Attempting to detach device vdb from instance 7fd20382-1fed-46d8-8968-92d7fee9c3e0 from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:37:41 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:37:41 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:37:41 user nova-compute[74805]:   <source dev="/dev/sdc"/>
Nov 15 04:37:41 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:37:41 user nova-compute[74805]:   <serial>711aa9c5-29da-49b6-b034-9a41b3e19bc6</serial>
Nov 15 04:37:41 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:37:41 user nova-compute[74805]: </disk>
Nov 15 04:37:41 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:37:41 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Successfully detached device vdb from instance 7fd20382-1fed-46d8-8968-92d7fee9c3e0 from the persistent domain config.
Nov 15 04:37:41 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7fd20382-1fed-46d8-8968-92d7fee9c3e0 from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:37:41 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:37:41 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:37:41 user nova-compute[74805]:   <source dev="/dev/sdc"/>
Nov 15 04:37:41 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:37:41 user nova-compute[74805]:   <serial>711aa9c5-29da-49b6-b034-9a41b3e19bc6</serial>
Nov 15 04:37:41 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:37:41 user nova-compute[74805]: </disk>
Nov 15 04:37:41 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:37:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:37:41 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7fd20382-1fed-46d8-8968-92d7fee9c3e0 {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:37:43 user nova-compute[74805]: DEBUG os_brick.utils [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:37:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:43 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a0fc0c-bf69-498b-b560-c539d570f645]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:43 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2090c1-0081-40e0-9b8b-a8f4659fd3a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:43 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3987c53a-c60a-4a84-bd56-65f1fad8273d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:43 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda487db-55f5-4b3d-badf-e0b736280971]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:37:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:37:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:37:43 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:37:43 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ff7622-f01c-442e-9311-0893d110235c]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:37:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:37:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:37:43 user nova-compute[74805]: DEBUG os_brick.utils [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:37:43 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Updating existing volume attachment record: 24f8f2d3-e875-498a-9b03-bf322a733085 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:37:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:37:47 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Creating image(s)
Nov 15 04:37:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Did not create local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Ensure instance console log exists: /opt/stack/data/nova/instances/4612bf54-bb3c-47e8-a6ff-bd5470687844/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Start _get_guest_xml network_info=[{"id": "aad08482-050c-4d99-babd-5c9d8b0a11d6", "address": "fa:16:3e:6e:e9:e6", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad08482-05", "ovs_interfaceid": "aad08482-050c-4d99-babd-5c9d8b0a11d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eANbBDKn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4612bf54-bb3c-47e8-a6ff-bd5470687844', 'attached_at': '', 'detached_at': '', 'volume_id': '9edb5d45-686c-413e-8821-3409bb3ada0c', 'serial': '9edb5d45-686c-413e-8821-3409bb3ada0c'}, 'delete_on_termination': True, 'attachment_id': '24f8f2d3-e875-498a-9b03-bf322a733085', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:37:47 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:37:47 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:37:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eANbBDKn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:37:47 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:37:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:37:47 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:37:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:37:47 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:37:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5b1ce8-60ee-49ff-9a55-3832a3cd288e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:37:47 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba7398c-0e97-4c5b-b3a3-3ecb7beb514a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c] added
Nov 15 04:37:47 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c38756-52f0-4854-8f62-6245dfdcbf47]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45162b2-8336-4b66-9b75-aa44c5298d48]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:37:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eANbBDKn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eANbBDKn" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8923f00-c80b-4667-ba15-7514a5b82656]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eANbBDKn'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d2637f-1deb-40cc-aaa8-40a6bbc6e58c]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[89427bef-ad3e-4bd9-a0f7-c08c68dc4d4b]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:37:48 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:37:48 user nova-compute[74805]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 (non-flash)
Nov 15 04:37:48 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:37:48 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:37:48 user nova-compute[74805]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 (non-flash)
Nov 15 04:37:48 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c016b3-458d-4efc-a615-41492f2caf21]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c, portal: 172.16.0.220,3260]
Nov 15 04:37:48 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c, portal: 172.16.0.220,3260] successful.
Nov 15 04:37:48 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7693eb8c-3e60-4fa6-abc0-64f9710c7035]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16f4225-3d29-4894-b183-fdb2738137d3]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:37:48 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:37:48 user nova-compute[74805]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 (non-flash)
Nov 15 04:37:48 user nova-compute[74805]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c (non-flash)
Nov 15 04:37:48 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:37:48 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:37:48 user nova-compute[74805]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 (non-flash)
Nov 15 04:37:48 user nova-compute[74805]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c (non-flash)
Nov 15 04:37:48 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] HCTL ('35', '-', '-', 0) found on session 54 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4a5f35-4e71-4937-b2c6-30b7249a5374]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:48 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: None {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:37:49 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:37:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eANbBDKn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:37:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:37:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23738663237393936', 'path': '/dev/sdd'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:37:49 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738663237393936', 'path': '/dev/sdd'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:37:49 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:37:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-440899373',display_name='tempest-TestVolumeBootPattern-server-440899373',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-440899373',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2744859f249a4326ab6d268319a34b7f',ramdisk_id='',reservation_id='r-utfal2ua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2043506637',owner_user_name='tempest-TestVolumeBootPattern-2043506637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:37:37Z,user_data=None,user_id='0bd96ecd9d404779ad64456c6517591f',uuid=4612bf54-bb3c-47e8-a6ff-bd5470687844,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aad08482-050c-4d99-babd-5c9d8b0a11d6", "address": "fa:16:3e:6e:e9:e6", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad08482-05", "ovs_interfaceid": "aad08482-050c-4d99-babd-5c9d8b0a11d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:37:49 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converting VIF {"id": "aad08482-050c-4d99-babd-5c9d8b0a11d6", "address": "fa:16:3e:6e:e9:e6", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad08482-05", "ovs_interfaceid": "aad08482-050c-4d99-babd-5c9d8b0a11d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:37:49 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:e9:e6,bridge_name='br-int',has_traffic_filtering=True,id=aad08482-050c-4d99-babd-5c9d8b0a11d6,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaad08482-05') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:37:49 user nova-compute[74805]: DEBUG nova.objects.instance [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lazy-loading 'pci_devices' on Instance uuid 4612bf54-bb3c-47e8-a6ff-bd5470687844 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:37:49 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:37:49 user nova-compute[74805]:   <uuid>4612bf54-bb3c-47e8-a6ff-bd5470687844</uuid>
Nov 15 04:37:49 user nova-compute[74805]:   <name>instance-0000002d</name>
Nov 15 04:37:49 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:37:49 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:37:49 user nova-compute[74805]:   <metadata>
Nov 15 04:37:49 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:37:49 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:37:49 user nova-compute[74805]:       <nova:name>tempest-TestVolumeBootPattern-server-440899373</nova:name>
Nov 15 04:37:49 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:37:47</nova:creationTime>
Nov 15 04:37:49 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:37:49 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:37:49 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:37:49 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:37:49 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:37:49 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:37:49 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:37:49 user nova-compute[74805]:       <nova:owner>
Nov 15 04:37:49 user nova-compute[74805]:         <nova:user uuid="0bd96ecd9d404779ad64456c6517591f">tempest-TestVolumeBootPattern-2043506637-project-member</nova:user>
Nov 15 04:37:49 user nova-compute[74805]:         <nova:project uuid="2744859f249a4326ab6d268319a34b7f">tempest-TestVolumeBootPattern-2043506637</nova:project>
Nov 15 04:37:49 user nova-compute[74805]:       </nova:owner>
Nov 15 04:37:49 user nova-compute[74805]:       <nova:ports>
Nov 15 04:37:49 user nova-compute[74805]:         <nova:port uuid="aad08482-050c-4d99-babd-5c9d8b0a11d6">
Nov 15 04:37:49 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 04:37:49 user nova-compute[74805]:         </nova:port>
Nov 15 04:37:49 user nova-compute[74805]:       </nova:ports>
Nov 15 04:37:49 user nova-compute[74805]:     </nova:instance>
Nov 15 04:37:49 user nova-compute[74805]:   </metadata>
Nov 15 04:37:49 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:37:49 user nova-compute[74805]:     <system>
Nov 15 04:37:49 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:37:49 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:37:49 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:37:49 user nova-compute[74805]:       <entry name="serial">4612bf54-bb3c-47e8-a6ff-bd5470687844</entry>
Nov 15 04:37:49 user nova-compute[74805]:       <entry name="uuid">4612bf54-bb3c-47e8-a6ff-bd5470687844</entry>
Nov 15 04:37:49 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:37:49 user nova-compute[74805]:     </system>
Nov 15 04:37:49 user nova-compute[74805]:   </sysinfo>
Nov 15 04:37:49 user nova-compute[74805]:   <os>
Nov 15 04:37:49 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:37:49 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:37:49 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:37:49 user nova-compute[74805]:   </os>
Nov 15 04:37:49 user nova-compute[74805]:   <features>
Nov 15 04:37:49 user nova-compute[74805]:     <acpi/>
Nov 15 04:37:49 user nova-compute[74805]:     <apic/>
Nov 15 04:37:49 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:37:49 user nova-compute[74805]:   </features>
Nov 15 04:37:49 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:37:49 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:37:49 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:37:49 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:37:49 user nova-compute[74805]:   </clock>
Nov 15 04:37:49 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:37:49 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:37:49 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:37:49 user nova-compute[74805]:   </cpu>
Nov 15 04:37:49 user nova-compute[74805]:   <devices>
Nov 15 04:37:49 user nova-compute[74805]:     <disk type="block" device="disk">
Nov 15 04:37:49 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:37:49 user nova-compute[74805]:       <source dev="/dev/sdd"/>
Nov 15 04:37:49 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:37:49 user nova-compute[74805]:       <serial>9edb5d45-686c-413e-8821-3409bb3ada0c</serial>
Nov 15 04:37:49 user nova-compute[74805]:     </disk>
Nov 15 04:37:49 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:37:49 user nova-compute[74805]:       <mac address="fa:16:3e:6e:e9:e6"/>
Nov 15 04:37:49 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:37:49 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:37:49 user nova-compute[74805]:       <target dev="tapaad08482-05"/>
Nov 15 04:37:49 user nova-compute[74805]:     </interface>
Nov 15 04:37:49 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:37:49 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/4612bf54-bb3c-47e8-a6ff-bd5470687844/console.log" append="off"/>
Nov 15 04:37:49 user nova-compute[74805]:     </serial>
Nov 15 04:37:49 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:37:49 user nova-compute[74805]:     <video>
Nov 15 04:37:49 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:37:49 user nova-compute[74805]:     </video>
Nov 15 04:37:49 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:37:49 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:37:49 user nova-compute[74805]:     </rng>
Nov 15 04:37:49 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:37:49 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:37:49 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:37:49 user nova-compute[74805]:     </memballoon>
Nov 15 04:37:49 user nova-compute[74805]:   </devices>
Nov 15 04:37:49 user nova-compute[74805]: </domain>
Nov 15 04:37:49 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:37:49 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:37:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-440899373',display_name='tempest-TestVolumeBootPattern-server-440899373',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-440899373',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2744859f249a4326ab6d268319a34b7f',ramdisk_id='',reservation_id='r-utfal2ua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2043506637',owner_user_name='tempest-TestVolumeBootPattern-2043506637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:37:37Z,user_data=None,user_id='0bd96ecd9d404779ad64456c6517591f',uuid=4612bf54-bb3c-47e8-a6ff-bd5470687844,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aad08482-050c-4d99-babd-5c9d8b0a11d6", "address": "fa:16:3e:6e:e9:e6", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad08482-05", "ovs_interfaceid": "aad08482-050c-4d99-babd-5c9d8b0a11d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:37:49 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converting VIF {"id": "aad08482-050c-4d99-babd-5c9d8b0a11d6", "address": "fa:16:3e:6e:e9:e6", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad08482-05", "ovs_interfaceid": "aad08482-050c-4d99-babd-5c9d8b0a11d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:37:49 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:e9:e6,bridge_name='br-int',has_traffic_filtering=True,id=aad08482-050c-4d99-babd-5c9d8b0a11d6,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaad08482-05') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:37:49 user nova-compute[74805]: DEBUG os_vif [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:e9:e6,bridge_name='br-int',has_traffic_filtering=True,id=aad08482-050c-4d99-babd-5c9d8b0a11d6,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaad08482-05') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:37:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:37:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:37:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b8f385fa-6505-58ad-b838-429135e5d619', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:37:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaad08482-05, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:37:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaad08482-05, col_values=(('qos', UUID('f7ff898a-c578-4f92-9b46-ba9fe058d060')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:37:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaad08482-05, col_values=(('external_ids', {'iface-id': 'aad08482-050c-4d99-babd-5c9d8b0a11d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:e9:e6', 'vm-uuid': '4612bf54-bb3c-47e8-a6ff-bd5470687844'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:37:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:37:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:49 user nova-compute[74805]: INFO os_vif [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:e9:e6,bridge_name='br-int',has_traffic_filtering=True,id=aad08482-050c-4d99-babd-5c9d8b0a11d6,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaad08482-05')
Nov 15 04:37:49 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:37:49 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] No VIF found with MAC fa:16:3e:6e:e9:e6, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:37:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:50 user nova-compute[74805]: DEBUG nova.compute.manager [req-05fb7552-d62f-47fc-97be-a5f9ebf2e2a1 req-32369e98-a4de-450e-8161-c6b7bc8c901b service nova] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Received event network-vif-plugged-aad08482-050c-4d99-babd-5c9d8b0a11d6 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:37:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-05fb7552-d62f-47fc-97be-a5f9ebf2e2a1 req-32369e98-a4de-450e-8161-c6b7bc8c901b service nova] Acquiring lock "4612bf54-bb3c-47e8-a6ff-bd5470687844-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:37:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-05fb7552-d62f-47fc-97be-a5f9ebf2e2a1 req-32369e98-a4de-450e-8161-c6b7bc8c901b service nova] Lock "4612bf54-bb3c-47e8-a6ff-bd5470687844-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:37:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-05fb7552-d62f-47fc-97be-a5f9ebf2e2a1 req-32369e98-a4de-450e-8161-c6b7bc8c901b service nova] Lock "4612bf54-bb3c-47e8-a6ff-bd5470687844-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:37:50 user nova-compute[74805]: DEBUG nova.compute.manager [req-05fb7552-d62f-47fc-97be-a5f9ebf2e2a1 req-32369e98-a4de-450e-8161-c6b7bc8c901b service nova] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] No waiting events found dispatching network-vif-plugged-aad08482-050c-4d99-babd-5c9d8b0a11d6 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:37:50 user nova-compute[74805]: WARNING nova.compute.manager [req-05fb7552-d62f-47fc-97be-a5f9ebf2e2a1 req-32369e98-a4de-450e-8161-c6b7bc8c901b service nova] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Received unexpected event network-vif-plugged-aad08482-050c-4d99-babd-5c9d8b0a11d6 for instance with vm_state building and task_state spawning.
Nov 15 04:37:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:52 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:37:52 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:37:52 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Instance spawned successfully.
Nov 15 04:37:52 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:37:52 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:37:52 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:37:52 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:37:52 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:37:52 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:37:52 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:37:52 user nova-compute[74805]: INFO nova.compute.manager [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Took 4.97 seconds to spawn the instance on the hypervisor.
Nov 15 04:37:52 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:37:52 user nova-compute[74805]: DEBUG nova.compute.manager [req-10549ac9-9b87-44a6-9401-9b42957b3733 req-521dd755-784a-4804-8322-2ade0fa583ac service nova] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Received event network-vif-plugged-aad08482-050c-4d99-babd-5c9d8b0a11d6 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:37:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-10549ac9-9b87-44a6-9401-9b42957b3733 req-521dd755-784a-4804-8322-2ade0fa583ac service nova] Acquiring lock "4612bf54-bb3c-47e8-a6ff-bd5470687844-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:37:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-10549ac9-9b87-44a6-9401-9b42957b3733 req-521dd755-784a-4804-8322-2ade0fa583ac service nova] Lock "4612bf54-bb3c-47e8-a6ff-bd5470687844-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:37:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-10549ac9-9b87-44a6-9401-9b42957b3733 req-521dd755-784a-4804-8322-2ade0fa583ac service nova] Lock "4612bf54-bb3c-47e8-a6ff-bd5470687844-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:37:52 user nova-compute[74805]: DEBUG nova.compute.manager [req-10549ac9-9b87-44a6-9401-9b42957b3733 req-521dd755-784a-4804-8322-2ade0fa583ac service nova] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] No waiting events found dispatching network-vif-plugged-aad08482-050c-4d99-babd-5c9d8b0a11d6 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:37:52 user nova-compute[74805]: WARNING nova.compute.manager [req-10549ac9-9b87-44a6-9401-9b42957b3733 req-521dd755-784a-4804-8322-2ade0fa583ac service nova] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Received unexpected event network-vif-plugged-aad08482-050c-4d99-babd-5c9d8b0a11d6 for instance with vm_state building and task_state spawning.
Nov 15 04:37:52 user nova-compute[74805]: INFO nova.compute.manager [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Took 16.10 seconds to build instance.
Nov 15 04:37:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d3702c29-26b1-4d03-99a3-e84ad8d4c6ae tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "4612bf54-bb3c-47e8-a6ff-bd5470687844" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.212s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:37:54 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:37:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "f99a9557-4951-49f0-931c-0dbab16478d8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:37:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:37:56 user nova-compute[74805]: DEBUG nova.objects.instance [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lazy-loading 'flavor' on Instance uuid f99a9557-4951-49f0-931c-0dbab16478d8 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:37:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:37:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "f99a9557-4951-49f0-931c-0dbab16478d8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:37:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:37:56 user nova-compute[74805]: INFO nova.compute.manager [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Attaching volume 31299136-a0b0-4366-b865-e2616b1a245d to /dev/vdb
Nov 15 04:37:56 user nova-compute[74805]: DEBUG os_brick.utils [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:37:56 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:56 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:56 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc09df3-2853-4e2d-9d58-4098c1e9a5a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:56 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:56 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:56 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4fbaf3-afe7-4ae3-82e4-d0ee671d4751]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:56 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:56 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:37:56 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1cf1d9-f87b-442f-8673-5c2c43a0d6cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:56 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfda5da4-9834-455f-8ffe-69e14fcfa538]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:56 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:56 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:37:56 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:37:56 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:37:56 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:37:56 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:37:56 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86a74b1-3550-413e-a619-6cc69c5bda6e]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:37:56 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:37:56 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:37:56 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:37:56 user nova-compute[74805]: DEBUG os_brick.utils [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:37:56 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Updating existing volume attachment record: 4aa3e01f-9a80-4ebe-bbf1-ebebd280a44c {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:37:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eVJBhDgN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:38:01 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:38:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:38:01 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:38:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:38:01 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ef1cd8-34f3-448e-becf-4d1f128d1aa8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:38:01 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34be804-b1c5-4bbe-b489-da684a426f8a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d] added
Nov 15 04:38:01 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0657f4c2-819e-40c9-b0f8-4747d6f6fd7f]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed9b962-3dcd-40cf-9e4a-5664dc0640f5]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eVJBhDgN {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eVJBhDgN" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[478a7701-9127-482f-9709-1dcbb5980f9b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eVJBhDgN'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:01 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7fd20382-1fed-46d8-8968-92d7fee9c3e0 is timed out.
Nov 15 04:38:01 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Successfully detached device vdb from instance 7fd20382-1fed-46d8-8968-92d7fee9c3e0 from the live domain config.
Nov 15 04:38:01 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pynHTFkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:38:01 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:38:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0f591a-d6b2-460a-a9cc-3c3c744dfb56]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a391aef8-065f-4c11-9378-d6eb6d117ead]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:38:01 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:38:01 user nova-compute[74805]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 (non-flash)
Nov 15 04:38:01 user nova-compute[74805]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c (non-flash)
Nov 15 04:38:01 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:38:01 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:38:01 user nova-compute[74805]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 (non-flash)
Nov 15 04:38:01 user nova-compute[74805]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c (non-flash)
Nov 15 04:38:01 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[108a6a9b-69dd-4294-96ce-596fb4a9efc4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d, portal: 172.16.0.220,3260]
Nov 15 04:38:01 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d, portal: 172.16.0.220,3260] successful.
Nov 15 04:38:01 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc7e170-29ac-45b7-87c3-1ac11f87407b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39f174d-471d-4b45-ac9d-89dbaf755e09]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:38:01 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:38:01 user nova-compute[74805]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 (non-flash)
Nov 15 04:38:01 user nova-compute[74805]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c (non-flash)
Nov 15 04:38:01 user nova-compute[74805]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d (non-flash)
Nov 15 04:38:01 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:38:01 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:38:01 user nova-compute[74805]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 (non-flash)
Nov 15 04:38:01 user nova-compute[74805]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c (non-flash)
Nov 15 04:38:01 user nova-compute[74805]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d (non-flash)
Nov 15 04:38:01 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] HCTL ('36', '-', '-', 0) found on session 55 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2429c1-ee14-4127-8a5d-936f79b666d5]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Searching for a device in session 55 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:38:01 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eVJBhDgN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26537356232343261', 'path': '/dev/sde'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537356232343261', 'path': '/dev/sde'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.179s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG nova.objects.instance [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lazy-loading 'flavor' on Instance uuid f99a9557-4951-49f0-931c-0dbab16478d8 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cb5873-67e1-4ad4-bacf-544ee6332e19]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:38:02 user nova-compute[74805]: No targets found.
Nov 15 04:38:02 user nova-compute[74805]: iSNS:
Nov 15 04:38:02 user nova-compute[74805]: No targets found.
Nov 15 04:38:02 user nova-compute[74805]: STATIC:
Nov 15 04:38:02 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c
Nov 15 04:38:02 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:38:02 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:38:02 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f
Nov 15 04:38:02 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:38:02 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:38:02 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6
Nov 15 04:38:02 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:38:02 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:38:02 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d
Nov 15 04:38:02 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:38:02 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:38:02 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada
Nov 15 04:38:02 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:38:02 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:38:02 user nova-compute[74805]: FIRMWARE:
Nov 15 04:38:02 user nova-compute[74805]: No targets found.
Nov 15 04:38:02 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:38:02 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:38:02 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:38:02 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:38:02 user nova-compute[74805]:   <source dev="/dev/sde"/>
Nov 15 04:38:02 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:38:02 user nova-compute[74805]:   <serial>31299136-a0b0-4366-b865-e2616b1a245d</serial>
Nov 15 04:38:02 user nova-compute[74805]: </disk>
Nov 15 04:38:02 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f960bdd5-1203-42fc-ab6f-7dea222f6847]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5610f875-b7fa-4f56-a139-395e936fd5af]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:38:02 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:38:02 user nova-compute[74805]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 (non-flash)
Nov 15 04:38:02 user nova-compute[74805]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c (non-flash)
Nov 15 04:38:02 user nova-compute[74805]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d (non-flash)
Nov 15 04:38:02 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:38:02 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:38:02 user nova-compute[74805]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 (non-flash)
Nov 15 04:38:02 user nova-compute[74805]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c (non-flash)
Nov 15 04:38:02 user nova-compute[74805]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d (non-flash)
Nov 15 04:38:02 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f787e8ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6'): ({'sdc'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Removing single pathed devices sdc {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a476b3c8-1e27-4dcd-b549-931bb381f07b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[db91195c-fff8-4794-8134-12c83093a248]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Flushing IO for device /dev/sdc {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e1abc0-5468-4167-9439-10fb7d0f27a4]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:38:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[35079391-bd5b-4f13-a7ac-22b9a2787b8c]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[be301d94-cb9d-4f1a-ba52-48025faacf01]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbaa109-1880-420e-b2a7-5f365374f64f]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6, portal: 172.16.0.220,3260]
Nov 15 04:38:03 user nova-compute[74805]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6, portal: 172.16.0.220,3260] successful.
Nov 15 04:38:03 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf75fcbe-6efb-48d8-999c-eefa636c1e43]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] <== disconnect_volume: return (1494ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] No VIF found with MAC fa:16:3e:f6:5f:e4, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9eb26592-26b0-4f4c-8c6c-0a0ffd157c9a tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.728s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG nova.objects.instance [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lazy-loading 'flavor' on Instance uuid 7fd20382-1fed-46d8-8968-92d7fee9c3e0 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cef8a2c2-da9d-46d5-9193-b8d895f56a4c tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.786s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.656s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:38:03 user nova-compute[74805]: INFO nova.compute.manager [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Terminating instance
Nov 15 04:38:03 user nova-compute[74805]: DEBUG nova.compute.manager [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:38:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG nova.compute.manager [req-ab26a9f0-9e2a-471a-a5c4-0c674cfed3eb req-9b1e74c5-17af-46eb-97c8-11b51a04adad service nova] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Received event network-vif-unplugged-04f57de7-3ac1-4d29-96c6-c9b7ec2149f1 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ab26a9f0-9e2a-471a-a5c4-0c674cfed3eb req-9b1e74c5-17af-46eb-97c8-11b51a04adad service nova] Acquiring lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ab26a9f0-9e2a-471a-a5c4-0c674cfed3eb req-9b1e74c5-17af-46eb-97c8-11b51a04adad service nova] Lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ab26a9f0-9e2a-471a-a5c4-0c674cfed3eb req-9b1e74c5-17af-46eb-97c8-11b51a04adad service nova] Lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG nova.compute.manager [req-ab26a9f0-9e2a-471a-a5c4-0c674cfed3eb req-9b1e74c5-17af-46eb-97c8-11b51a04adad service nova] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] No waiting events found dispatching network-vif-unplugged-04f57de7-3ac1-4d29-96c6-c9b7ec2149f1 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG nova.compute.manager [req-ab26a9f0-9e2a-471a-a5c4-0c674cfed3eb req-9b1e74c5-17af-46eb-97c8-11b51a04adad service nova] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Received event network-vif-unplugged-04f57de7-3ac1-4d29-96c6-c9b7ec2149f1 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:04 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Instance destroyed successfully.
Nov 15 04:38:04 user nova-compute[74805]: DEBUG nova.objects.instance [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lazy-loading 'resources' on Instance uuid 7fd20382-1fed-46d8-8968-92d7fee9c3e0 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:35:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-922041030',display_name='tempest-VolumesSnapshotTestJSON-instance-922041030',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-922041030',id=43,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqI/xrVtmava9yLtAvNDUudX83mjSN+9vgJaXreYHICcJFe1qz/q+a4y37YAUwDYdomIl1BM/mE/L6J2cxvFILRU+WRowObPSDLH31L0Kl3EI4jhF9k0cJoCk0z+LuTUA==',key_name='tempest-keypair-2004984909',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:35:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3b66fd3bcaa4720a38b00388797825a',ramdisk_id='',reservation_id='r-h1iedgd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1020343559',owner_user_name='tempest-VolumesSnapshotTestJSON-1020343559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:35:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ef3764d29074d9ebb8f7c0b62b4cf4f',uuid=7fd20382-1fed-46d8-8968-92d7fee9c3e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04f57de7-3ac1-4d29-96c6-c9b7ec2149f1", "address": "fa:16:3e:87:54:19", "network": {"id": "56e28167-fe83-43e1-9efc-81f625e2b727", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760042206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3b66fd3bcaa4720a38b00388797825a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f57de7-3a", "ovs_interfaceid": "04f57de7-3ac1-4d29-96c6-c9b7ec2149f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Converting VIF {"id": "04f57de7-3ac1-4d29-96c6-c9b7ec2149f1", "address": "fa:16:3e:87:54:19", "network": {"id": "56e28167-fe83-43e1-9efc-81f625e2b727", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760042206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3b66fd3bcaa4720a38b00388797825a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04f57de7-3a", "ovs_interfaceid": "04f57de7-3ac1-4d29-96c6-c9b7ec2149f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:54:19,bridge_name='br-int',has_traffic_filtering=True,id=04f57de7-3ac1-4d29-96c6-c9b7ec2149f1,network=Network(56e28167-fe83-43e1-9efc-81f625e2b727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04f57de7-3a') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG os_vif [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:54:19,bridge_name='br-int',has_traffic_filtering=True,id=04f57de7-3ac1-4d29-96c6-c9b7ec2149f1,network=Network(56e28167-fe83-43e1-9efc-81f625e2b727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04f57de7-3a') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04f57de7-3a, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea6fd9c7-0130-4321-b485-8bd2babcebf5) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:04 user nova-compute[74805]: INFO os_vif [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:54:19,bridge_name='br-int',has_traffic_filtering=True,id=04f57de7-3ac1-4d29-96c6-c9b7ec2149f1,network=Network(56e28167-fe83-43e1-9efc-81f625e2b727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04f57de7-3a')
Nov 15 04:38:04 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pynHTFkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:38:04 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:38:04 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52c9675-6c9a-4f28-9b7d-03812a97e6b3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:38:04 user nova-compute[74805]: No targets found.
Nov 15 04:38:04 user nova-compute[74805]: iSNS:
Nov 15 04:38:04 user nova-compute[74805]: No targets found.
Nov 15 04:38:04 user nova-compute[74805]: STATIC:
Nov 15 04:38:04 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c
Nov 15 04:38:04 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:38:04 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:38:04 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f
Nov 15 04:38:04 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:38:04 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:38:04 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d
Nov 15 04:38:04 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:38:04 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:38:04 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada
Nov 15 04:38:04 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:38:04 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:38:04 user nova-compute[74805]: FIRMWARE:
Nov 15 04:38:04 user nova-compute[74805]: No targets found.
Nov 15 04:38:04 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:38:04 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:38:04 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:711aa9c5-29da-49b6-b034-9a41b3e19bc6', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8411c706-f88e-4070-a94f-c0d7ca8da503]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d419ec7-c4ab-4376-a091-788e6fdc9b39]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:38:04 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:38:04 user nova-compute[74805]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c (non-flash)
Nov 15 04:38:04 user nova-compute[74805]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d (non-flash)
Nov 15 04:38:04 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:38:04 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:38:04 user nova-compute[74805]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c (non-flash)
Nov 15 04:38:04 user nova-compute[74805]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d (non-flash)
Nov 15 04:38:04 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2fb728fd00>, {}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Disconnecting from: [] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] <== disconnect_volume: return (74ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:38:04 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:38:04 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Deleting instance files /opt/stack/data/nova/instances/7fd20382-1fed-46d8-8968-92d7fee9c3e0_del
Nov 15 04:38:04 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Deletion of /opt/stack/data/nova/instances/7fd20382-1fed-46d8-8968-92d7fee9c3e0_del complete
Nov 15 04:38:05 user nova-compute[74805]: INFO nova.compute.manager [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 15 04:38:05 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:38:05 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:38:05 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:38:05 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:38:05 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Took 0.71 seconds to deallocate network for instance.
Nov 15 04:38:05 user nova-compute[74805]: WARNING nova.volume.cinder [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Attachment 57fc23db-9ade-4d9a-bb81-833912b683ef does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 57fc23db-9ade-4d9a-bb81-833912b683ef. (HTTP 404) (Request-ID: req-f68b6851-5a97-4a8e-9b5f-09a998fc10c3)
Nov 15 04:38:05 user nova-compute[74805]: INFO nova.compute.manager [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Took 0.02 seconds to detach 1 volumes for instance.
Nov 15 04:38:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:38:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:38:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "f99a9557-4951-49f0-931c-0dbab16478d8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:38:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:38:06 user nova-compute[74805]: INFO nova.compute.manager [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Detaching volume 31299136-a0b0-4366-b865-e2616b1a245d
Nov 15 04:38:06 user nova-compute[74805]: INFO nova.virt.block_device [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Attempting to driver detach volume 31299136-a0b0-4366-b865-e2616b1a245d from mountpoint /dev/vdb
Nov 15 04:38:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Attempting to detach device vdb from instance f99a9557-4951-49f0-931c-0dbab16478d8 from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:38:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:38:06 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:38:06 user nova-compute[74805]:   <source dev="/dev/sde"/>
Nov 15 04:38:06 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:38:06 user nova-compute[74805]:   <serial>31299136-a0b0-4366-b865-e2616b1a245d</serial>
Nov 15 04:38:06 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:38:06 user nova-compute[74805]: </disk>
Nov 15 04:38:06 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:38:06 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:38:06 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Successfully detached device vdb from instance f99a9557-4951-49f0-931c-0dbab16478d8 from the persistent domain config.
Nov 15 04:38:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f99a9557-4951-49f0-931c-0dbab16478d8 from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:38:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:38:06 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:38:06 user nova-compute[74805]:   <source dev="/dev/sde"/>
Nov 15 04:38:06 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:38:06 user nova-compute[74805]:   <serial>31299136-a0b0-4366-b865-e2616b1a245d</serial>
Nov 15 04:38:06 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:38:06 user nova-compute[74805]: </disk>
Nov 15 04:38:06 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:38:06 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:38:06 user nova-compute[74805]: DEBUG nova.compute.manager [req-c8d1e1be-94a9-4d79-bd62-9470759a8704 req-221d1432-cd91-4bdd-aca4-e3b0a3592814 service nova] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Received event network-vif-plugged-04f57de7-3ac1-4d29-96c6-c9b7ec2149f1 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:38:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c8d1e1be-94a9-4d79-bd62-9470759a8704 req-221d1432-cd91-4bdd-aca4-e3b0a3592814 service nova] Acquiring lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:38:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c8d1e1be-94a9-4d79-bd62-9470759a8704 req-221d1432-cd91-4bdd-aca4-e3b0a3592814 service nova] Lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:38:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c8d1e1be-94a9-4d79-bd62-9470759a8704 req-221d1432-cd91-4bdd-aca4-e3b0a3592814 service nova] Lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:38:06 user nova-compute[74805]: DEBUG nova.compute.manager [req-c8d1e1be-94a9-4d79-bd62-9470759a8704 req-221d1432-cd91-4bdd-aca4-e3b0a3592814 service nova] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] No waiting events found dispatching network-vif-plugged-04f57de7-3ac1-4d29-96c6-c9b7ec2149f1 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:38:06 user nova-compute[74805]: WARNING nova.compute.manager [req-c8d1e1be-94a9-4d79-bd62-9470759a8704 req-221d1432-cd91-4bdd-aca4-e3b0a3592814 service nova] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Received unexpected event network-vif-plugged-04f57de7-3ac1-4d29-96c6-c9b7ec2149f1 for instance with vm_state deleted and task_state None.
Nov 15 04:38:06 user nova-compute[74805]: DEBUG nova.compute.manager [req-c8d1e1be-94a9-4d79-bd62-9470759a8704 req-221d1432-cd91-4bdd-aca4-e3b0a3592814 service nova] [instance: 7fd20382-1fed-46d8-8968-92d7fee9c3e0] Received event network-vif-deleted-04f57de7-3ac1-4d29-96c6-c9b7ec2149f1 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:38:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:38:06 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Deleted allocations for instance 7fd20382-1fed-46d8-8968-92d7fee9c3e0
Nov 15 04:38:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f99a9557-4951-49f0-931c-0dbab16478d8 {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:38:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a9ce49ab-dab2-422b-ace2-8048f1052794 tempest-VolumesSnapshotTestJSON-1020343559 tempest-VolumesSnapshotTestJSON-1020343559-project-member] Lock "7fd20382-1fed-46d8-8968-92d7fee9c3e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.949s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:38:07 user nova-compute[74805]: INFO nova.compute.manager [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Rescuing
Nov 15 04:38:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "refresh_cache-6ece3a65-78ba-4648-877a-861ffb4ce523" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:38:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquired lock "refresh_cache-6ece3a65-78ba-4648-877a-861ffb4ce523" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:38:07 user nova-compute[74805]: DEBUG nova.network.neutron [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:38:08 user nova-compute[74805]: DEBUG nova.network.neutron [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Updating instance_info_cache with network_info: [{"id": "b4c47025-7d95-4d09-9371-614d2b198868", "address": "fa:16:3e:fb:ec:0a", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c47025-7d", "ovs_interfaceid": "b4c47025-7d95-4d09-9371-614d2b198868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:38:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Releasing lock "refresh_cache-6ece3a65-78ba-4648-877a-861ffb4ce523" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:38:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:08 user nova-compute[74805]: DEBUG nova.compute.manager [req-e012ed89-a1c3-4d62-b924-b66606ca6f7c req-0e949397-145a-4557-8d65-44a26fa3fa11 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Received event network-vif-unplugged-b4c47025-7d95-4d09-9371-614d2b198868 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:38:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e012ed89-a1c3-4d62-b924-b66606ca6f7c req-0e949397-145a-4557-8d65-44a26fa3fa11 service nova] Acquiring lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:38:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e012ed89-a1c3-4d62-b924-b66606ca6f7c req-0e949397-145a-4557-8d65-44a26fa3fa11 service nova] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:38:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e012ed89-a1c3-4d62-b924-b66606ca6f7c req-0e949397-145a-4557-8d65-44a26fa3fa11 service nova] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:38:08 user nova-compute[74805]: DEBUG nova.compute.manager [req-e012ed89-a1c3-4d62-b924-b66606ca6f7c req-0e949397-145a-4557-8d65-44a26fa3fa11 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] No waiting events found dispatching network-vif-unplugged-b4c47025-7d95-4d09-9371-614d2b198868 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:38:08 user nova-compute[74805]: WARNING nova.compute.manager [req-e012ed89-a1c3-4d62-b924-b66606ca6f7c req-0e949397-145a-4557-8d65-44a26fa3fa11 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Received unexpected event network-vif-unplugged-b4c47025-7d95-4d09-9371-614d2b198868 for instance with vm_state active and task_state rescuing.
Nov 15 04:38:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:09 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Instance destroyed successfully.
Nov 15 04:38:09 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Attempting a stable device rescue
Nov 15 04:38:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74805) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 04:38:09 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Instance directory exists: not creating {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 04:38:09 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Creating image(s)
Nov 15 04:38:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ece3a65-78ba-4648-877a-861ffb4ce523/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:38:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "/opt/stack/data/nova/instances/6ece3a65-78ba-4648-877a-861ffb4ce523/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:38:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "/opt/stack/data/nova/instances/6ece3a65-78ba-4648-877a-861ffb4ce523/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:38:09 user nova-compute[74805]: DEBUG nova.objects.instance [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6ece3a65-78ba-4648-877a-861ffb4ce523 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:38:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "7385d404a30eca169892b35b30b8adb4683c22dd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:38:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "7385d404a30eca169892b35b30b8adb4683c22dd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:38:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7385d404a30eca169892b35b30b8adb4683c22dd.part --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:10 user nova-compute[74805]: DEBUG nova.compute.manager [req-1104de68-76d8-4399-bc5f-81f6bf94cf1b req-15e7ac01-5300-46b9-824d-7adbd1d990b2 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Received event network-vif-plugged-b4c47025-7d95-4d09-9371-614d2b198868 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:38:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1104de68-76d8-4399-bc5f-81f6bf94cf1b req-15e7ac01-5300-46b9-824d-7adbd1d990b2 service nova] Acquiring lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:38:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1104de68-76d8-4399-bc5f-81f6bf94cf1b req-15e7ac01-5300-46b9-824d-7adbd1d990b2 service nova] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:38:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1104de68-76d8-4399-bc5f-81f6bf94cf1b req-15e7ac01-5300-46b9-824d-7adbd1d990b2 service nova] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:38:10 user nova-compute[74805]: DEBUG nova.compute.manager [req-1104de68-76d8-4399-bc5f-81f6bf94cf1b req-15e7ac01-5300-46b9-824d-7adbd1d990b2 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] No waiting events found dispatching network-vif-plugged-b4c47025-7d95-4d09-9371-614d2b198868 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:38:10 user nova-compute[74805]: WARNING nova.compute.manager [req-1104de68-76d8-4399-bc5f-81f6bf94cf1b req-15e7ac01-5300-46b9-824d-7adbd1d990b2 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Received unexpected event network-vif-plugged-b4c47025-7d95-4d09-9371-614d2b198868 for instance with vm_state active and task_state rescuing.
Nov 15 04:38:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7385d404a30eca169892b35b30b8adb4683c22dd.part --force-share --output=json" returned: 0 in 0.169s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:10 user nova-compute[74805]: DEBUG nova.virt.images [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] e66333db-4ab9-42fc-a2e3-310983ee30cd was qcow2, converting to raw {{(pid=74805) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 04:38:10 user nova-compute[74805]: DEBUG nova.privsep.utils [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74805) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 04:38:10 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7385d404a30eca169892b35b30b8adb4683c22dd.part /opt/stack/data/nova/instances/_base/7385d404a30eca169892b35b30b8adb4683c22dd.converted {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7385d404a30eca169892b35b30b8adb4683c22dd.part /opt/stack/data/nova/instances/_base/7385d404a30eca169892b35b30b8adb4683c22dd.converted" returned: 0 in 0.730s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7385d404a30eca169892b35b30b8adb4683c22dd.converted --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7385d404a30eca169892b35b30b8adb4683c22dd.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "7385d404a30eca169892b35b30b8adb4683c22dd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.295s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "7385d404a30eca169892b35b30b8adb4683c22dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "7385d404a30eca169892b35b30b8adb4683c22dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7385d404a30eca169892b35b30b8adb4683c22dd --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7385d404a30eca169892b35b30b8adb4683c22dd --force-share --output=json" returned: 0 in 0.171s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7385d404a30eca169892b35b30b8adb4683c22dd,backing_fmt=raw /opt/stack/data/nova/instances/6ece3a65-78ba-4648-877a-861ffb4ce523/disk.rescue {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7385d404a30eca169892b35b30b8adb4683c22dd,backing_fmt=raw /opt/stack/data/nova/instances/6ece3a65-78ba-4648-877a-861ffb4ce523/disk.rescue" returned: 0 in 0.047s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "7385d404a30eca169892b35b30b8adb4683c22dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG nova.objects.instance [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lazy-loading 'migration_context' on Instance uuid 6ece3a65-78ba-4648-877a-861ffb4ce523 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG nova.objects.base [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Object Instance<6ece3a65-78ba-4648-877a-861ffb4ce523> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Start _get_guest_xml network_info=[{"id": "b4c47025-7d95-4d09-9371-614d2b198868", "address": "fa:16:3e:fb:ec:0a", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "vif_mac": "fa:16:3e:fb:ec:0a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c47025-7d", "ovs_interfaceid": "b4c47025-7d95-4d09-9371-614d2b198868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e66333db-4ab9-42fc-a2e3-310983ee30cd', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eUclRvSm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '6ece3a65-78ba-4648-877a-861ffb4ce523', 'attached_at': '', 'detached_at': '', 'volume_id': 'cf37200c-a534-4aae-8d56-966f0f260ada', 'serial': 'cf37200c-a534-4aae-8d56-966f0f260ada'}, 'delete_on_termination': False, 'attachment_id': 'c275f878-5c05-43e9-8108-0cd743751883', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG nova.objects.instance [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lazy-loading 'resources' on Instance uuid 6ece3a65-78ba-4648-877a-861ffb4ce523 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG nova.objects.base [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Object Instance<6ece3a65-78ba-4648-877a-861ffb4ce523> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG nova.objects.instance [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lazy-loading 'numa_topology' on Instance uuid 6ece3a65-78ba-4648-877a-861ffb4ce523 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG nova.objects.base [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Object Instance<6ece3a65-78ba-4648-877a-861ffb4ce523> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:38:11 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:38:11 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:38:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG nova.objects.instance [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6ece3a65-78ba-4648-877a-861ffb4ce523 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG nova.objects.base [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Object Instance<6ece3a65-78ba-4648-877a-861ffb4ce523> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eUclRvSm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:38:11 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:38:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:38:11 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:38:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:38:11 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:38:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5caaa8c-04b1-46aa-b6e3-9837b856626c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = eUclRvSm\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 04:38:11 user nova-compute[74805]: node.name = iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada
Nov 15 04:38:11 user nova-compute[74805]: node.tpgt = -1
Nov 15 04:38:11 user nova-compute[74805]: node.startup = automatic
Nov 15 04:38:11 user nova-compute[74805]: node.leading_login = No
Nov 15 04:38:11 user nova-compute[74805]: iface.iscsi_ifacename = default
Nov 15 04:38:11 user nova-compute[74805]: iface.net_ifacename = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.ipaddress = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.prefix_len = 0
Nov 15 04:38:11 user nova-compute[74805]: iface.hwaddress = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.transport_name = tcp
Nov 15 04:38:11 user nova-compute[74805]: iface.initiatorname = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.state = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.vlan_id = 0
Nov 15 04:38:11 user nova-compute[74805]: iface.vlan_priority = 0
Nov 15 04:38:11 user nova-compute[74805]: iface.vlan_state = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.iface_num = 0
Nov 15 04:38:11 user nova-compute[74805]: iface.mtu = 0
Nov 15 04:38:11 user nova-compute[74805]: iface.port = 0
Nov 15 04:38:11 user nova-compute[74805]: iface.bootproto = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.subnet_mask = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.gateway = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.dhcp_alt_client_id = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.dhcp_dns = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.dhcp_learn_iqn = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.dhcp_vendor_id_state = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.dhcp_vendor_id = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.dhcp_slp_da = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.fragmentation = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.gratuitous_arp = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.incoming_forwarding = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.tos_state = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.tos = 0
Nov 15 04:38:11 user nova-compute[74805]: iface.ttl = 0
Nov 15 04:38:11 user nova-compute[74805]: iface.delayed_ack = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.tcp_nagle = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.tcp_wsf_state = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.tcp_wsf = 0
Nov 15 04:38:11 user nova-compute[74805]: iface.tcp_timer_scale = 0
Nov 15 04:38:11 user nova-compute[74805]: iface.tcp_timestamp = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.redirect = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.def_task_mgmt_timeout = 0
Nov 15 04:38:11 user nova-compute[74805]: iface.header_digest = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.data_digest = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.immediate_data = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.initial_r2t = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.data_seq_inorder = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.data_pdu_inorder = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.erl = 0
Nov 15 04:38:11 user nova-compute[74805]: iface.max_receive_data_len = 0
Nov 15 04:38:11 user nova-compute[74805]: iface.first_burst_len = 0
Nov 15 04:38:11 user nova-compute[74805]: iface.max_outstanding_r2t = 0
Nov 15 04:38:11 user nova-compute[74805]: iface.max_burst_len = 0
Nov 15 04:38:11 user nova-compute[74805]: iface.chap_auth = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.bidi_chap = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.strict_login_compliance = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.discovery_auth = <empty>
Nov 15 04:38:11 user nova-compute[74805]: iface.discovery_logout = <empty>
Nov 15 04:38:11 user nova-compute[74805]: node.discovery_address = <empty>
Nov 15 04:38:11 user nova-compute[74805]: node.discovery_port = 0
Nov 15 04:38:11 user nova-compute[74805]: node.discovery_type = static
Nov 15 04:38:11 user nova-compute[74805]: node.session.initial_cmdsn = 0
Nov 15 04:38:11 user nova-compute[74805]: node.session.initial_login_retry_max = 8
Nov 15 04:38:11 user nova-compute[74805]: node.session.xmit_thread_priority = -20
Nov 15 04:38:11 user nova-compute[74805]: node.session.cmds_max = 128
Nov 15 04:38:11 user nova-compute[74805]: node.session.queue_depth = 32
Nov 15 04:38:11 user nova-compute[74805]: node.session.nr_sessions = 1
Nov 15 04:38:11 user nova-compute[74805]: node.session.auth.authmethod = CHAP
Nov 15 04:38:11 user nova-compute[74805]: node.session.auth.username = eUclRvSm
Nov 15 04:38:11 user nova-compute[74805]: node.session.auth.password = ***
Nov 15 04:38:11 user nova-compute[74805]: node.session.auth.username_in = <empty>
Nov 15 04:38:11 user nova-compute[74805]: node.session.auth.password_in = <empty>
Nov 15 04:38:11 user nova-compute[74805]: node.session.auth.chap_algs = MD5
Nov 15 04:38:11 user nova-compute[74805]: node.session.timeo.replacement_timeout = 120
Nov 15 04:38:11 user nova-compute[74805]: node.session.err_timeo.abort_timeout = 15
Nov 15 04:38:11 user nova-compute[74805]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 04:38:11 user nova-compute[74805]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 04:38:11 user nova-compute[74805]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 04:38:11 user nova-compute[74805]: node.session.iscsi.FastAbort = Yes
Nov 15 04:38:11 user nova-compute[74805]: node.session.iscsi.InitialR2T = No
Nov 15 04:38:11 user nova-compute[74805]: node.session.iscsi.ImmediateData = Yes
Nov 15 04:38:11 user nova-compute[74805]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 04:38:11 user nova-compute[74805]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 04:38:11 user nova-compute[74805]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 04:38:11 user nova-compute[74805]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 04:38:11 user nova-compute[74805]: node.session.iscsi.MaxConnections = 1
Nov 15 04:38:11 user nova-compute[74805]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 04:38:11 user nova-compute[74805]: node.session.iscsi.ERL = 0
Nov 15 04:38:11 user nova-compute[74805]: node.session.scan = manual
Nov 15 04:38:11 user nova-compute[74805]: node.session.reopen_max = 0
Nov 15 04:38:11 user nova-compute[74805]: node.conn[0].address = 172.16.0.220
Nov 15 04:38:11 user nova-compute[74805]: node.conn[0].port = 3260
Nov 15 04:38:11 user nova-compute[74805]: node.conn[0].startup = manual
Nov 15 04:38:11 user nova-compute[74805]: node.conn[0].tcp.window_size = 524288
Nov 15 04:38:11 user nova-compute[74805]: node.conn[0].tcp.type_of_service = 0
Nov 15 04:38:11 user nova-compute[74805]: node.conn[0].timeo.logout_timeout = 15
Nov 15 04:38:11 user nova-compute[74805]: node.conn[0].timeo.login_timeout = 15
Nov 15 04:38:11 user nova-compute[74805]: node.conn[0].timeo.auth_timeout = 45
Nov 15 04:38:11 user nova-compute[74805]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 04:38:11 user nova-compute[74805]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 04:38:11 user nova-compute[74805]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 04:38:11 user nova-compute[74805]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 04:38:11 user nova-compute[74805]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 04:38:11 user nova-compute[74805]: node.conn[0].iscsi.DataDigest = None
Nov 15 04:38:11 user nova-compute[74805]: node.conn[0].iscsi.IFMarker = No
Nov 15 04:38:11 user nova-compute[74805]: node.conn[0].iscsi.OFMarker = No
Nov 15 04:38:11 user nova-compute[74805]: # END RECORD
Nov 15 04:38:11 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d08191-5e7c-4a07-b2a4-7bbfa2289e43]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[54870cd1-6cfa-40d1-8144-c5875c47e8f2]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eUclRvSm {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eUclRvSm" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55dc5e5-75e9-4c56-8046-0cc107cf7fdc]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eUclRvSm'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:38:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:12 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c0b74b-c580-4fd8-86bc-6a4476a0d8d8]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:38:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:12 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3ee61c-77e8-473f-abca-9331871bab52]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:38:12 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:38:12 user nova-compute[74805]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c (non-flash)
Nov 15 04:38:12 user nova-compute[74805]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d (non-flash)
Nov 15 04:38:12 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:38:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:38:12 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:38:12 user nova-compute[74805]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c (non-flash)
Nov 15 04:38:12 user nova-compute[74805]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d (non-flash)
Nov 15 04:38:12 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:38:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.132s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:38:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:38:12 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] HCTL ('33', '0', '0', 0) found on session 51 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:38:12 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:38:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:12 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af76cdb-10a4-4ec6-9429-26e77f827f44]: (4, ('0 0 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:12 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Searching for a device in session 51 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:38:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eUclRvSm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:38:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.155s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:38:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] <== connect_volume: return (156ms) {'type': 'block', 'scsi_wwn': '26464343761633262', 'path': '/dev/sdb'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:38:12 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464343761633262', 'path': '/dev/sdb'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:38:12 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:36:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1272061911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1272061911',id=44,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:36:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d11645073d58476491d101b9f3ee4052',ramdisk_id='',reservation_id='r-b2efqm1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1297861260',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:36:33Z,user_data=None,user_id='8cba9273daa1478fa6cc8274443b4f40',uuid=6ece3a65-78ba-4648-877a-861ffb4ce523,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4c47025-7d95-4d09-9371-614d2b198868", "address": "fa:16:3e:fb:ec:0a", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "vif_mac": "fa:16:3e:fb:ec:0a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c47025-7d", "ovs_interfaceid": "b4c47025-7d95-4d09-9371-614d2b198868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:38:12 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Converting VIF {"id": "b4c47025-7d95-4d09-9371-614d2b198868", "address": "fa:16:3e:fb:ec:0a", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "vif_mac": "fa:16:3e:fb:ec:0a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c47025-7d", "ovs_interfaceid": "b4c47025-7d95-4d09-9371-614d2b198868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:38:12 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:ec:0a,bridge_name='br-int',has_traffic_filtering=True,id=b4c47025-7d95-4d09-9371-614d2b198868,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4c47025-7d') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:38:12 user nova-compute[74805]: DEBUG nova.objects.instance [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ece3a65-78ba-4648-877a-861ffb4ce523 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:38:12 user nova-compute[74805]: DEBUG nova.objects.base [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Object Instance<6ece3a65-78ba-4648-877a-861ffb4ce523> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:38:12 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:38:12 user nova-compute[74805]:   <uuid>6ece3a65-78ba-4648-877a-861ffb4ce523</uuid>
Nov 15 04:38:12 user nova-compute[74805]:   <name>instance-0000002c</name>
Nov 15 04:38:12 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:38:12 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:38:12 user nova-compute[74805]:   <metadata>
Nov 15 04:38:12 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:38:12 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:38:12 user nova-compute[74805]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1272061911</nova:name>
Nov 15 04:38:12 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:38:11</nova:creationTime>
Nov 15 04:38:12 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:38:12 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:38:12 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:38:12 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:38:12 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:38:12 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:38:12 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:38:12 user nova-compute[74805]:       <nova:owner>
Nov 15 04:38:12 user nova-compute[74805]:         <nova:user uuid="8cba9273daa1478fa6cc8274443b4f40">tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member</nova:user>
Nov 15 04:38:12 user nova-compute[74805]:         <nova:project uuid="d11645073d58476491d101b9f3ee4052">tempest-ServerBootFromVolumeStableRescueTest-1297861260</nova:project>
Nov 15 04:38:12 user nova-compute[74805]:       </nova:owner>
Nov 15 04:38:12 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:38:12 user nova-compute[74805]:       <nova:ports>
Nov 15 04:38:12 user nova-compute[74805]:         <nova:port uuid="b4c47025-7d95-4d09-9371-614d2b198868">
Nov 15 04:38:12 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 04:38:12 user nova-compute[74805]:         </nova:port>
Nov 15 04:38:12 user nova-compute[74805]:       </nova:ports>
Nov 15 04:38:12 user nova-compute[74805]:     </nova:instance>
Nov 15 04:38:12 user nova-compute[74805]:   </metadata>
Nov 15 04:38:12 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:38:12 user nova-compute[74805]:     <system>
Nov 15 04:38:12 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:38:12 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:38:12 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:38:12 user nova-compute[74805]:       <entry name="serial">6ece3a65-78ba-4648-877a-861ffb4ce523</entry>
Nov 15 04:38:12 user nova-compute[74805]:       <entry name="uuid">6ece3a65-78ba-4648-877a-861ffb4ce523</entry>
Nov 15 04:38:12 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:38:12 user nova-compute[74805]:     </system>
Nov 15 04:38:12 user nova-compute[74805]:   </sysinfo>
Nov 15 04:38:12 user nova-compute[74805]:   <os>
Nov 15 04:38:12 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:38:12 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:38:12 user nova-compute[74805]:   </os>
Nov 15 04:38:12 user nova-compute[74805]:   <features>
Nov 15 04:38:12 user nova-compute[74805]:     <acpi/>
Nov 15 04:38:12 user nova-compute[74805]:     <apic/>
Nov 15 04:38:12 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:38:12 user nova-compute[74805]:   </features>
Nov 15 04:38:12 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:38:12 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:38:12 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:38:12 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:38:12 user nova-compute[74805]:   </clock>
Nov 15 04:38:12 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:38:12 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:38:12 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:38:12 user nova-compute[74805]:   </cpu>
Nov 15 04:38:12 user nova-compute[74805]:   <devices>
Nov 15 04:38:12 user nova-compute[74805]:     <disk type="block" device="disk">
Nov 15 04:38:12 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:38:12 user nova-compute[74805]:       <source dev="/dev/sdb"/>
Nov 15 04:38:12 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:38:12 user nova-compute[74805]:       <serial>cf37200c-a534-4aae-8d56-966f0f260ada</serial>
Nov 15 04:38:12 user nova-compute[74805]:     </disk>
Nov 15 04:38:12 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:38:12 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:38:12 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/6ece3a65-78ba-4648-877a-861ffb4ce523/disk.rescue"/>
Nov 15 04:38:12 user nova-compute[74805]:       <target dev="vdb" bus="virtio"/>
Nov 15 04:38:12 user nova-compute[74805]:       <boot order="1"/>
Nov 15 04:38:12 user nova-compute[74805]:     </disk>
Nov 15 04:38:12 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:38:12 user nova-compute[74805]:       <mac address="fa:16:3e:fb:ec:0a"/>
Nov 15 04:38:12 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:38:12 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:38:12 user nova-compute[74805]:       <target dev="tapb4c47025-7d"/>
Nov 15 04:38:12 user nova-compute[74805]:     </interface>
Nov 15 04:38:12 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:38:12 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/6ece3a65-78ba-4648-877a-861ffb4ce523/console.log" append="off"/>
Nov 15 04:38:12 user nova-compute[74805]:     </serial>
Nov 15 04:38:12 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:38:12 user nova-compute[74805]:     <video>
Nov 15 04:38:12 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:38:12 user nova-compute[74805]:     </video>
Nov 15 04:38:12 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:38:12 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:38:12 user nova-compute[74805]:     </rng>
Nov 15 04:38:12 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:38:12 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:38:12 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:38:12 user nova-compute[74805]:     </memballoon>
Nov 15 04:38:12 user nova-compute[74805]:   </devices>
Nov 15 04:38:12 user nova-compute[74805]: </domain>
Nov 15 04:38:12 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:38:12 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Instance destroyed successfully.
Nov 15 04:38:12 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:38:12 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:38:12 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] No VIF found with MAC fa:16:3e:fb:ec:0a, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:38:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:13 user nova-compute[74805]: DEBUG nova.compute.manager [req-65d35c3e-db42-4015-a78d-7f0074f393eb req-d136f9f1-6730-44ed-8034-d18cf4290bd2 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Received event network-vif-plugged-b4c47025-7d95-4d09-9371-614d2b198868 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:38:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-65d35c3e-db42-4015-a78d-7f0074f393eb req-d136f9f1-6730-44ed-8034-d18cf4290bd2 service nova] Acquiring lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:38:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-65d35c3e-db42-4015-a78d-7f0074f393eb req-d136f9f1-6730-44ed-8034-d18cf4290bd2 service nova] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:38:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-65d35c3e-db42-4015-a78d-7f0074f393eb req-d136f9f1-6730-44ed-8034-d18cf4290bd2 service nova] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:38:13 user nova-compute[74805]: DEBUG nova.compute.manager [req-65d35c3e-db42-4015-a78d-7f0074f393eb req-d136f9f1-6730-44ed-8034-d18cf4290bd2 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] No waiting events found dispatching network-vif-plugged-b4c47025-7d95-4d09-9371-614d2b198868 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:38:13 user nova-compute[74805]: WARNING nova.compute.manager [req-65d35c3e-db42-4015-a78d-7f0074f393eb req-d136f9f1-6730-44ed-8034-d18cf4290bd2 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Received unexpected event network-vif-plugged-b4c47025-7d95-4d09-9371-614d2b198868 for instance with vm_state active and task_state rescuing.
Nov 15 04:38:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:15 user nova-compute[74805]: DEBUG nova.compute.manager [req-317cae32-abe0-400c-93db-5c3faad1a67d req-60bfd478-5069-4f5b-a91d-a2253057dabd service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Received event network-vif-plugged-b4c47025-7d95-4d09-9371-614d2b198868 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:38:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-317cae32-abe0-400c-93db-5c3faad1a67d req-60bfd478-5069-4f5b-a91d-a2253057dabd service nova] Acquiring lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:38:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-317cae32-abe0-400c-93db-5c3faad1a67d req-60bfd478-5069-4f5b-a91d-a2253057dabd service nova] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:38:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-317cae32-abe0-400c-93db-5c3faad1a67d req-60bfd478-5069-4f5b-a91d-a2253057dabd service nova] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:38:15 user nova-compute[74805]: DEBUG nova.compute.manager [req-317cae32-abe0-400c-93db-5c3faad1a67d req-60bfd478-5069-4f5b-a91d-a2253057dabd service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] No waiting events found dispatching network-vif-plugged-b4c47025-7d95-4d09-9371-614d2b198868 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:38:15 user nova-compute[74805]: WARNING nova.compute.manager [req-317cae32-abe0-400c-93db-5c3faad1a67d req-60bfd478-5069-4f5b-a91d-a2253057dabd service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Received unexpected event network-vif-plugged-b4c47025-7d95-4d09-9371-614d2b198868 for instance with vm_state active and task_state rescuing.
Nov 15 04:38:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:16 user nova-compute[74805]: DEBUG nova.compute.manager [None req-8ab65170-6c7c-43ee-b55f-e484df48474a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:38:18 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:38:19 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:38:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:21 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:38:21 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:38:22 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:38:25 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:38:25 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:38:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-75731a3d-3c78-4014-a8dc-f38c3d7b3305" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:38:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-75731a3d-3c78-4014-a8dc-f38c3d7b3305" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:38:25 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:38:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:25 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Updating instance_info_cache with network_info: [{"id": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "address": "fa:16:3e:8f:e3:f6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39aa6c19-c3", "ovs_interfaceid": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:38:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-75731a3d-3c78-4014-a8dc-f38c3d7b3305" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:38:25 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:38:25 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:38:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:38:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:38:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:38:25 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:38:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:26 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f99a9557-4951-49f0-931c-0dbab16478d8 is timed out.
Nov 15 04:38:26 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Successfully detached device vdb from instance f99a9557-4951-49f0-931c-0dbab16478d8 from the live domain config.
Nov 15 04:38:26 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eVJBhDgN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:38:26 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:38:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df7827f-104d-447d-a999-5aa0708f3b58]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:38:26 user nova-compute[74805]: No targets found.
Nov 15 04:38:26 user nova-compute[74805]: iSNS:
Nov 15 04:38:26 user nova-compute[74805]: No targets found.
Nov 15 04:38:26 user nova-compute[74805]: STATIC:
Nov 15 04:38:26 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c
Nov 15 04:38:26 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:38:26 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:38:26 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f
Nov 15 04:38:26 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:38:26 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:38:26 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d
Nov 15 04:38:26 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:38:26 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:38:26 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada
Nov 15 04:38:26 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:38:26 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:38:26 user nova-compute[74805]: FIRMWARE:
Nov 15 04:38:26 user nova-compute[74805]: No targets found.
Nov 15 04:38:26 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:38:26 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:38:26 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[02183b87-1a58-4a84-99b0-dc2345fd9166]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02f8b21-425f-4e8e-b8a5-240d90c13a79]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:38:26 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:38:26 user nova-compute[74805]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c (non-flash)
Nov 15 04:38:26 user nova-compute[74805]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d (non-flash)
Nov 15 04:38:26 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:38:26 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:38:26 user nova-compute[74805]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c (non-flash)
Nov 15 04:38:26 user nova-compute[74805]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d (non-flash)
Nov 15 04:38:26 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2fb4285ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d'): ({'sde'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Removing single pathed devices sde {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3695f38e-0c81-4b80-83d1-a1895f12c097]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eff513f-34ca-46c2-9ece-ef6e8b7f9eaf]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Flushing IO for device /dev/sde {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db7b73f-2db1-4ac4-ae8a-9442d64fbe18]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9eeb7dd-cf50-41fa-8332-7cc049ec815d]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] SCSI volumes sde have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d925c1-1696-4610-9bbd-5d1047b53ed0]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[820376bc-56b7-442b-a239-64c90a63fb0c]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d, portal: 172.16.0.220,3260]
Nov 15 04:38:27 user nova-compute[74805]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d, portal: 172.16.0.220,3260] successful.
Nov 15 04:38:27 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31299136-a0b0-4366-b865-e2616b1a245d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f78aa0-cb84-4e43-a9b3-d4e7fc6d5dd1]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] <== disconnect_volume: return (401ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ece3a65-78ba-4648-877a-861ffb4ce523/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ece3a65-78ba-4648-877a-861ffb4ce523/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ece3a65-78ba-4648-877a-861ffb4ce523/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ece3a65-78ba-4648-877a-861ffb4ce523/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:28 user nova-compute[74805]: DEBUG nova.objects.instance [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lazy-loading 'flavor' on Instance uuid f99a9557-4951-49f0-931c-0dbab16478d8 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:38:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1c98cf71-6197-46ec-9abc-dbce0841d5e8 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.028s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:38:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:28 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:38:28 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:38:28 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=8149MB free_disk=24.825485229492188GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:38:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:38:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:38:29 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 9f267864-0b72-431d-9b0d-c63436002a4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:38:29 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 38196606-a9c9-4604-ad21-2ec7511a8b28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:38:29 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 288a5e5c-f8e9-4507-b29c-93e7595922ac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:38:29 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance f99a9557-4951-49f0-931c-0dbab16478d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:38:29 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 75731a3d-3c78-4014-a8dc-f38c3d7b3305 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:38:29 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:38:29 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 6ece3a65-78ba-4648-877a-861ffb4ce523 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:38:29 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 4612bf54-bb3c-47e8-a6ff-bd5470687844 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:38:29 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:38:29 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:38:29 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:38:29 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:38:29 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:38:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.427s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:38:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:31 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:38:31 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:38:31 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:38:32 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:38:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:52 user nova-compute[74805]: INFO nova.compute.manager [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Rescuing
Nov 15 04:38:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "refresh_cache-75731a3d-3c78-4014-a8dc-f38c3d7b3305" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:38:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquired lock "refresh_cache-75731a3d-3c78-4014-a8dc-f38c3d7b3305" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:38:52 user nova-compute[74805]: DEBUG nova.network.neutron [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:38:52 user nova-compute[74805]: DEBUG nova.network.neutron [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Updating instance_info_cache with network_info: [{"id": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "address": "fa:16:3e:8f:e3:f6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39aa6c19-c3", "ovs_interfaceid": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:38:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Releasing lock "refresh_cache-75731a3d-3c78-4014-a8dc-f38c3d7b3305" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:38:53 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:53 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:53 user nova-compute[74805]: DEBUG nova.compute.manager [req-5ed09c9f-2219-4097-85f9-9d31de3a4fc5 req-02ec30e9-e8cc-466e-a51d-b82ddd9deb83 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received event network-vif-unplugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:38:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5ed09c9f-2219-4097-85f9-9d31de3a4fc5 req-02ec30e9-e8cc-466e-a51d-b82ddd9deb83 service nova] Acquiring lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:38:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5ed09c9f-2219-4097-85f9-9d31de3a4fc5 req-02ec30e9-e8cc-466e-a51d-b82ddd9deb83 service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:38:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5ed09c9f-2219-4097-85f9-9d31de3a4fc5 req-02ec30e9-e8cc-466e-a51d-b82ddd9deb83 service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:38:53 user nova-compute[74805]: DEBUG nova.compute.manager [req-5ed09c9f-2219-4097-85f9-9d31de3a4fc5 req-02ec30e9-e8cc-466e-a51d-b82ddd9deb83 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] No waiting events found dispatching network-vif-unplugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:38:53 user nova-compute[74805]: WARNING nova.compute.manager [req-5ed09c9f-2219-4097-85f9-9d31de3a4fc5 req-02ec30e9-e8cc-466e-a51d-b82ddd9deb83 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received unexpected event network-vif-unplugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a for instance with vm_state active and task_state rescuing.
Nov 15 04:38:53 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:53 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:53 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:53 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:53 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:53 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Instance destroyed successfully.
Nov 15 04:38:53 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Attempting rescue
Nov 15 04:38:53 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74805) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 04:38:53 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Instance directory exists: not creating {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 04:38:53 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Creating image(s)
Nov 15 04:38:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "/opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:38:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "/opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:38:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "/opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:38:53 user nova-compute[74805]: DEBUG nova.objects.instance [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lazy-loading 'trusted_certs' on Instance uuid 75731a3d-3c78-4014-a8dc-f38c3d7b3305 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:38:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:38:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:38:53 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:53 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.182s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk.rescue {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk.rescue" returned: 0 in 0.046s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.objects.instance [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lazy-loading 'migration_context' on Instance uuid 75731a3d-3c78-4014-a8dc-f38c3d7b3305 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.objects.base [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Object Instance<75731a3d-3c78-4014-a8dc-f38c3d7b3305> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Start _get_guest_xml network_info=[{"id": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "address": "fa:16:3e:8f:e3:f6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "vif_mac": "fa:16:3e:8f:e3:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39aa6c19-c3", "ovs_interfaceid": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.objects.instance [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lazy-loading 'resources' on Instance uuid 75731a3d-3c78-4014-a8dc-f38c3d7b3305 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.objects.base [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Object Instance<75731a3d-3c78-4014-a8dc-f38c3d7b3305> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.objects.instance [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lazy-loading 'numa_topology' on Instance uuid 75731a3d-3c78-4014-a8dc-f38c3d7b3305 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.objects.base [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Object Instance<75731a3d-3c78-4014-a8dc-f38c3d7b3305> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:38:54 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:38:54 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.objects.instance [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lazy-loading 'vcpu_model' on Instance uuid 75731a3d-3c78-4014-a8dc-f38c3d7b3305 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.objects.base [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Object Instance<75731a3d-3c78-4014-a8dc-f38c3d7b3305> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:34:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2014027379',display_name='tempest-ServerRescueNegativeTestJSON-server-2014027379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2014027379',id=41,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:34:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66fc455c6c7049d79a5c64451c126d56',ramdisk_id='',reservation_id='r-xszr1u4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-370335706',owner_user_name='tempest-ServerRescueNegativeTestJSON-370335706-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:34:16Z,user_data=None,user_id='6da72213d3ae446088876b3a3c34f976',uuid=75731a3d-3c78-4014-a8dc-f38c3d7b3305,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "address": "fa:16:3e:8f:e3:f6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "vif_mac": "fa:16:3e:8f:e3:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39aa6c19-c3", "ovs_interfaceid": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Converting VIF {"id": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "address": "fa:16:3e:8f:e3:f6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "vif_mac": "fa:16:3e:8f:e3:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39aa6c19-c3", "ovs_interfaceid": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:e3:f6,bridge_name='br-int',has_traffic_filtering=True,id=39aa6c19-c319-4f9d-ac4e-a1deccecc95a,network=Network(98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39aa6c19-c3') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.objects.instance [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lazy-loading 'pci_devices' on Instance uuid 75731a3d-3c78-4014-a8dc-f38c3d7b3305 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.objects.base [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Object Instance<75731a3d-3c78-4014-a8dc-f38c3d7b3305> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:38:54 user nova-compute[74805]:   <uuid>75731a3d-3c78-4014-a8dc-f38c3d7b3305</uuid>
Nov 15 04:38:54 user nova-compute[74805]:   <name>instance-00000029</name>
Nov 15 04:38:54 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:38:54 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:38:54 user nova-compute[74805]:   <metadata>
Nov 15 04:38:54 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:38:54 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:38:54 user nova-compute[74805]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2014027379</nova:name>
Nov 15 04:38:54 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:38:54</nova:creationTime>
Nov 15 04:38:54 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:38:54 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:38:54 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:38:54 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:38:54 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:38:54 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:38:54 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:38:54 user nova-compute[74805]:       <nova:owner>
Nov 15 04:38:54 user nova-compute[74805]:         <nova:user uuid="6da72213d3ae446088876b3a3c34f976">tempest-ServerRescueNegativeTestJSON-370335706-project-member</nova:user>
Nov 15 04:38:54 user nova-compute[74805]:         <nova:project uuid="66fc455c6c7049d79a5c64451c126d56">tempest-ServerRescueNegativeTestJSON-370335706</nova:project>
Nov 15 04:38:54 user nova-compute[74805]:       </nova:owner>
Nov 15 04:38:54 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:38:54 user nova-compute[74805]:       <nova:ports>
Nov 15 04:38:54 user nova-compute[74805]:         <nova:port uuid="39aa6c19-c319-4f9d-ac4e-a1deccecc95a">
Nov 15 04:38:54 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 04:38:54 user nova-compute[74805]:         </nova:port>
Nov 15 04:38:54 user nova-compute[74805]:       </nova:ports>
Nov 15 04:38:54 user nova-compute[74805]:     </nova:instance>
Nov 15 04:38:54 user nova-compute[74805]:   </metadata>
Nov 15 04:38:54 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:38:54 user nova-compute[74805]:     <system>
Nov 15 04:38:54 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:38:54 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:38:54 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:38:54 user nova-compute[74805]:       <entry name="serial">75731a3d-3c78-4014-a8dc-f38c3d7b3305</entry>
Nov 15 04:38:54 user nova-compute[74805]:       <entry name="uuid">75731a3d-3c78-4014-a8dc-f38c3d7b3305</entry>
Nov 15 04:38:54 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:38:54 user nova-compute[74805]:     </system>
Nov 15 04:38:54 user nova-compute[74805]:   </sysinfo>
Nov 15 04:38:54 user nova-compute[74805]:   <os>
Nov 15 04:38:54 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:38:54 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:38:54 user nova-compute[74805]:   </os>
Nov 15 04:38:54 user nova-compute[74805]:   <features>
Nov 15 04:38:54 user nova-compute[74805]:     <acpi/>
Nov 15 04:38:54 user nova-compute[74805]:     <apic/>
Nov 15 04:38:54 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:38:54 user nova-compute[74805]:   </features>
Nov 15 04:38:54 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:38:54 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:38:54 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:38:54 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:38:54 user nova-compute[74805]:   </clock>
Nov 15 04:38:54 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:38:54 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:38:54 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:38:54 user nova-compute[74805]:   </cpu>
Nov 15 04:38:54 user nova-compute[74805]:   <devices>
Nov 15 04:38:54 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:38:54 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:38:54 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk.rescue"/>
Nov 15 04:38:54 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:38:54 user nova-compute[74805]:     </disk>
Nov 15 04:38:54 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:38:54 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:38:54 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk"/>
Nov 15 04:38:54 user nova-compute[74805]:       <target dev="vdb" bus="virtio"/>
Nov 15 04:38:54 user nova-compute[74805]:     </disk>
Nov 15 04:38:54 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:38:54 user nova-compute[74805]:       <mac address="fa:16:3e:8f:e3:f6"/>
Nov 15 04:38:54 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:38:54 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:38:54 user nova-compute[74805]:       <target dev="tap39aa6c19-c3"/>
Nov 15 04:38:54 user nova-compute[74805]:     </interface>
Nov 15 04:38:54 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:38:54 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/console.log" append="off"/>
Nov 15 04:38:54 user nova-compute[74805]:     </serial>
Nov 15 04:38:54 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:38:54 user nova-compute[74805]:     <video>
Nov 15 04:38:54 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:38:54 user nova-compute[74805]:     </video>
Nov 15 04:38:54 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:38:54 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:38:54 user nova-compute[74805]:     </rng>
Nov 15 04:38:54 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:38:54 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:38:54 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:38:54 user nova-compute[74805]:     </memballoon>
Nov 15 04:38:54 user nova-compute[74805]:   </devices>
Nov 15 04:38:54 user nova-compute[74805]: </domain>
Nov 15 04:38:54 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:38:54 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Instance destroyed successfully.
Nov 15 04:38:54 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:38:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] No VIF found with MAC fa:16:3e:8f:e3:f6, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:38:55 user nova-compute[74805]: DEBUG nova.compute.manager [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received event network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:38:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] Acquiring lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:38:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:38:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:38:55 user nova-compute[74805]: DEBUG nova.compute.manager [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] No waiting events found dispatching network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:38:55 user nova-compute[74805]: WARNING nova.compute.manager [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received unexpected event network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a for instance with vm_state active and task_state rescuing.
Nov 15 04:38:55 user nova-compute[74805]: DEBUG nova.compute.manager [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received event network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:38:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] Acquiring lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:38:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:38:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:38:55 user nova-compute[74805]: DEBUG nova.compute.manager [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] No waiting events found dispatching network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:38:55 user nova-compute[74805]: WARNING nova.compute.manager [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received unexpected event network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a for instance with vm_state active and task_state rescuing.
Nov 15 04:38:55 user nova-compute[74805]: DEBUG nova.compute.manager [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received event network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:38:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] Acquiring lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:38:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:38:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:38:55 user nova-compute[74805]: DEBUG nova.compute.manager [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] No waiting events found dispatching network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:38:55 user nova-compute[74805]: WARNING nova.compute.manager [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received unexpected event network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a for instance with vm_state active and task_state rescuing.
Nov 15 04:38:55 user nova-compute[74805]: DEBUG nova.compute.manager [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received event network-vif-unplugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:38:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] Acquiring lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:38:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:38:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:38:55 user nova-compute[74805]: DEBUG nova.compute.manager [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] No waiting events found dispatching network-vif-unplugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:38:55 user nova-compute[74805]: WARNING nova.compute.manager [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received unexpected event network-vif-unplugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a for instance with vm_state active and task_state rescuing.
Nov 15 04:38:55 user nova-compute[74805]: DEBUG nova.compute.manager [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received event network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:38:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] Acquiring lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:38:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:38:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:38:55 user nova-compute[74805]: DEBUG nova.compute.manager [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] No waiting events found dispatching network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:38:55 user nova-compute[74805]: WARNING nova.compute.manager [req-ea8555e8-efbe-40b5-9c33-a3237eb96708 req-6eed6e6e-3c7b-444e-96aa-74bcd332ca85 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received unexpected event network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a for instance with vm_state active and task_state rescuing.
Nov 15 04:38:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:38:57 user nova-compute[74805]: DEBUG nova.compute.manager [req-35a32959-ab38-45e5-838a-5b37b0bbbf8f req-4835da0a-de03-4dee-b3a4-19347e1a809c service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received event network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:38:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-35a32959-ab38-45e5-838a-5b37b0bbbf8f req-4835da0a-de03-4dee-b3a4-19347e1a809c service nova] Acquiring lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:38:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-35a32959-ab38-45e5-838a-5b37b0bbbf8f req-4835da0a-de03-4dee-b3a4-19347e1a809c service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:38:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-35a32959-ab38-45e5-838a-5b37b0bbbf8f req-4835da0a-de03-4dee-b3a4-19347e1a809c service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:38:57 user nova-compute[74805]: DEBUG nova.compute.manager [req-35a32959-ab38-45e5-838a-5b37b0bbbf8f req-4835da0a-de03-4dee-b3a4-19347e1a809c service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] No waiting events found dispatching network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:38:57 user nova-compute[74805]: WARNING nova.compute.manager [req-35a32959-ab38-45e5-838a-5b37b0bbbf8f req-4835da0a-de03-4dee-b3a4-19347e1a809c service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received unexpected event network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a for instance with vm_state active and task_state rescuing.
Nov 15 04:38:57 user nova-compute[74805]: DEBUG nova.compute.manager [req-35a32959-ab38-45e5-838a-5b37b0bbbf8f req-4835da0a-de03-4dee-b3a4-19347e1a809c service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received event network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:38:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-35a32959-ab38-45e5-838a-5b37b0bbbf8f req-4835da0a-de03-4dee-b3a4-19347e1a809c service nova] Acquiring lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:38:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-35a32959-ab38-45e5-838a-5b37b0bbbf8f req-4835da0a-de03-4dee-b3a4-19347e1a809c service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:38:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-35a32959-ab38-45e5-838a-5b37b0bbbf8f req-4835da0a-de03-4dee-b3a4-19347e1a809c service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:38:57 user nova-compute[74805]: DEBUG nova.compute.manager [req-35a32959-ab38-45e5-838a-5b37b0bbbf8f req-4835da0a-de03-4dee-b3a4-19347e1a809c service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] No waiting events found dispatching network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:38:57 user nova-compute[74805]: WARNING nova.compute.manager [req-35a32959-ab38-45e5-838a-5b37b0bbbf8f req-4835da0a-de03-4dee-b3a4-19347e1a809c service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received unexpected event network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a for instance with vm_state active and task_state rescuing.
Nov 15 04:38:58 user nova-compute[74805]: DEBUG nova.compute.manager [None req-e1562e36-3300-428b-a256-393f467be972 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:38:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:09 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4339079d-4632-4211-8e53-08cfb5274cd3 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "f99a9557-4951-49f0-931c-0dbab16478d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:39:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4339079d-4632-4211-8e53-08cfb5274cd3 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:39:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4339079d-4632-4211-8e53-08cfb5274cd3 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "f99a9557-4951-49f0-931c-0dbab16478d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:39:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4339079d-4632-4211-8e53-08cfb5274cd3 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:39:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4339079d-4632-4211-8e53-08cfb5274cd3 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:39:11 user nova-compute[74805]: INFO nova.compute.manager [None req-4339079d-4632-4211-8e53-08cfb5274cd3 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Terminating instance
Nov 15 04:39:11 user nova-compute[74805]: DEBUG nova.compute.manager [None req-4339079d-4632-4211-8e53-08cfb5274cd3 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:39:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:11 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Instance destroyed successfully.
Nov 15 04:39:11 user nova-compute[74805]: DEBUG nova.objects.instance [None req-4339079d-4632-4211-8e53-08cfb5274cd3 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lazy-loading 'resources' on Instance uuid f99a9557-4951-49f0-931c-0dbab16478d8 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:39:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-4339079d-4632-4211-8e53-08cfb5274cd3 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:32:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-124357738',display_name='tempest-SnapshotDataIntegrityTests-server-124357738',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-124357738',id=40,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdWApAF8/n64KUzvHQdqifpjanLu6B37SuhfpePZVT/97i3CRnT59nnDVWT+Fl4iL1jZbsr6kolFi8r5TV7yEVhKsxwxp71vlHXJXt1VvonUbMOXIvcPljkOkUTuo7AGg==',key_name='tempest-keypair-799908981',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:32:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8464c1b545064c9f8e5f20d23417ed48',ramdisk_id='',reservation_id='r-v3q0eazd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-251201261',owner_user_name='tempest-SnapshotDataIntegrityTests-251201261-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:32:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bbd120c964844bf93a8df3fad453cc9',uuid=f99a9557-4951-49f0-931c-0dbab16478d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36f925e7-241b-453e-84bd-a6dc8c213650", "address": "fa:16:3e:f6:5f:e4", "network": {"id": "c5d73469-8aa8-4d7b-bee8-ffcedcaae340", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1298527383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8464c1b545064c9f8e5f20d23417ed48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f925e7-24", "ovs_interfaceid": "36f925e7-241b-453e-84bd-a6dc8c213650", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:39:11 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-4339079d-4632-4211-8e53-08cfb5274cd3 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Converting VIF {"id": "36f925e7-241b-453e-84bd-a6dc8c213650", "address": "fa:16:3e:f6:5f:e4", "network": {"id": "c5d73469-8aa8-4d7b-bee8-ffcedcaae340", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1298527383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8464c1b545064c9f8e5f20d23417ed48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f925e7-24", "ovs_interfaceid": "36f925e7-241b-453e-84bd-a6dc8c213650", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:39:11 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-4339079d-4632-4211-8e53-08cfb5274cd3 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:5f:e4,bridge_name='br-int',has_traffic_filtering=True,id=36f925e7-241b-453e-84bd-a6dc8c213650,network=Network(c5d73469-8aa8-4d7b-bee8-ffcedcaae340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f925e7-24') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:39:11 user nova-compute[74805]: DEBUG os_vif [None req-4339079d-4632-4211-8e53-08cfb5274cd3 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:5f:e4,bridge_name='br-int',has_traffic_filtering=True,id=36f925e7-241b-453e-84bd-a6dc8c213650,network=Network(c5d73469-8aa8-4d7b-bee8-ffcedcaae340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f925e7-24') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:39:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36f925e7-24, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:39:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:39:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f3677555-d75f-4fec-a181-8128a98022fb) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:39:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:11 user nova-compute[74805]: INFO os_vif [None req-4339079d-4632-4211-8e53-08cfb5274cd3 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:5f:e4,bridge_name='br-int',has_traffic_filtering=True,id=36f925e7-241b-453e-84bd-a6dc8c213650,network=Network(c5d73469-8aa8-4d7b-bee8-ffcedcaae340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f925e7-24')
Nov 15 04:39:11 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-4339079d-4632-4211-8e53-08cfb5274cd3 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Deleting instance files /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8_del
Nov 15 04:39:11 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-4339079d-4632-4211-8e53-08cfb5274cd3 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Deletion of /opt/stack/data/nova/instances/f99a9557-4951-49f0-931c-0dbab16478d8_del complete
Nov 15 04:39:11 user nova-compute[74805]: INFO nova.compute.manager [None req-4339079d-4632-4211-8e53-08cfb5274cd3 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 04:39:11 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-4339079d-4632-4211-8e53-08cfb5274cd3 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:39:11 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:39:11 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:39:12 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:39:12 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Took 0.80 seconds to deallocate network for instance.
Nov 15 04:39:12 user nova-compute[74805]: DEBUG nova.compute.manager [req-84aa92bf-d7e7-4a7a-9452-278e0119d33e req-a7d3b450-c2e3-48f9-bab0-8c8d33b8eef8 service nova] [instance: f99a9557-4951-49f0-931c-0dbab16478d8] Received event network-vif-deleted-36f925e7-241b-453e-84bd-a6dc8c213650 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:39:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4339079d-4632-4211-8e53-08cfb5274cd3 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:39:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4339079d-4632-4211-8e53-08cfb5274cd3 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:39:13 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-4339079d-4632-4211-8e53-08cfb5274cd3 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:39:13 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-4339079d-4632-4211-8e53-08cfb5274cd3 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:39:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4339079d-4632-4211-8e53-08cfb5274cd3 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:39:13 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-4339079d-4632-4211-8e53-08cfb5274cd3 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Deleted allocations for instance f99a9557-4951-49f0-931c-0dbab16478d8
Nov 15 04:39:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-4339079d-4632-4211-8e53-08cfb5274cd3 tempest-SnapshotDataIntegrityTests-251201261 tempest-SnapshotDataIntegrityTests-251201261-project-member] Lock "f99a9557-4951-49f0-931c-0dbab16478d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.193s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:39:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Acquiring lock "824f863d-192f-4339-9f7f-95ca57ebc9c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:39:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lock "824f863d-192f-4339-9f7f-95ca57ebc9c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:39:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:15 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:39:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:39:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:39:16 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:39:16 user nova-compute[74805]: INFO nova.compute.claims [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Claim successful on node user
Nov 15 04:39:16 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:39:16 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:39:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.354s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:39:16 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:39:16 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:39:16 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:39:16 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:39:16 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:39:16 user nova-compute[74805]: DEBUG nova.policy [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '023f2f5ee5e6461ab40705d667b0d0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ba7eede774be18ff3afa71255c4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:39:16 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:39:16 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:39:16 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Creating image(s)
Nov 15 04:39:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Acquiring lock "/opt/stack/data/nova/instances/824f863d-192f-4339-9f7f-95ca57ebc9c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:39:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lock "/opt/stack/data/nova/instances/824f863d-192f-4339-9f7f-95ca57ebc9c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:39:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lock "/opt/stack/data/nova/instances/824f863d-192f-4339-9f7f-95ca57ebc9c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:39:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.175s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:39:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:39:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/824f863d-192f-4339-9f7f-95ca57ebc9c1/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/824f863d-192f-4339-9f7f-95ca57ebc9c1/disk 1073741824" returned: 0 in 0.064s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:16 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:39:16 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:17 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Successfully created port: e8efc40e-9156-4814-903d-0226be4bc489 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:39:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.171s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:17 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Checking if we can resize image /opt/stack/data/nova/instances/824f863d-192f-4339-9f7f-95ca57ebc9c1/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:39:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/824f863d-192f-4339-9f7f-95ca57ebc9c1/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:17 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/824f863d-192f-4339-9f7f-95ca57ebc9c1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:17 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Cannot resize image /opt/stack/data/nova/instances/824f863d-192f-4339-9f7f-95ca57ebc9c1/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:39:17 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:39:17 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Ensure instance console log exists: /opt/stack/data/nova/instances/824f863d-192f-4339-9f7f-95ca57ebc9c1/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:39:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:39:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:39:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:39:17 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Successfully updated port: e8efc40e-9156-4814-903d-0226be4bc489 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:39:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Acquiring lock "refresh_cache-824f863d-192f-4339-9f7f-95ca57ebc9c1" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:39:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Acquired lock "refresh_cache-824f863d-192f-4339-9f7f-95ca57ebc9c1" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:39:17 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.compute.manager [req-00e33c7d-9e20-4ff1-a642-a6136a6fbea2 req-7ca6af67-9089-447a-91d8-86b5db26161a service nova] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Received event network-changed-e8efc40e-9156-4814-903d-0226be4bc489 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.compute.manager [req-00e33c7d-9e20-4ff1-a642-a6136a6fbea2 req-7ca6af67-9089-447a-91d8-86b5db26161a service nova] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Refreshing instance network info cache due to event network-changed-e8efc40e-9156-4814-903d-0226be4bc489. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-00e33c7d-9e20-4ff1-a642-a6136a6fbea2 req-7ca6af67-9089-447a-91d8-86b5db26161a service nova] Acquiring lock "refresh_cache-824f863d-192f-4339-9f7f-95ca57ebc9c1" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.network.neutron [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Updating instance_info_cache with network_info: [{"id": "e8efc40e-9156-4814-903d-0226be4bc489", "address": "fa:16:3e:ae:a1:94", "network": {"id": "75bd3e51-ad70-4471-8e61-f53bb210ac0f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-300432593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c2ba7eede774be18ff3afa71255c4b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efc40e-91", "ovs_interfaceid": "e8efc40e-9156-4814-903d-0226be4bc489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Releasing lock "refresh_cache-824f863d-192f-4339-9f7f-95ca57ebc9c1" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Instance network_info: |[{"id": "e8efc40e-9156-4814-903d-0226be4bc489", "address": "fa:16:3e:ae:a1:94", "network": {"id": "75bd3e51-ad70-4471-8e61-f53bb210ac0f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-300432593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c2ba7eede774be18ff3afa71255c4b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efc40e-91", "ovs_interfaceid": "e8efc40e-9156-4814-903d-0226be4bc489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-00e33c7d-9e20-4ff1-a642-a6136a6fbea2 req-7ca6af67-9089-447a-91d8-86b5db26161a service nova] Acquired lock "refresh_cache-824f863d-192f-4339-9f7f-95ca57ebc9c1" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.network.neutron [req-00e33c7d-9e20-4ff1-a642-a6136a6fbea2 req-7ca6af67-9089-447a-91d8-86b5db26161a service nova] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Refreshing network info cache for port e8efc40e-9156-4814-903d-0226be4bc489 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Start _get_guest_xml network_info=[{"id": "e8efc40e-9156-4814-903d-0226be4bc489", "address": "fa:16:3e:ae:a1:94", "network": {"id": "75bd3e51-ad70-4471-8e61-f53bb210ac0f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-300432593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c2ba7eede774be18ff3afa71255c4b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efc40e-91", "ovs_interfaceid": "e8efc40e-9156-4814-903d-0226be4bc489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:39:18 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:39:18 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:39:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-941657600',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-941657600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9416576',id=46,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPPi5/PfbPuyS7/M81Us8uIsiIYhG6VMC5bAGMfkCpnrWsIDtLgItCqc4MhHsnuZWtG2kRQogmf1lGejZk+nqohcia1t5yJ293EsMaeS9DrwDVigWJGK365ND3Wdid4rw==',key_name='tempest-keypair-134236616',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c2ba7eede774be18ff3afa71255c4b5',ramdisk_id='',reservation_id='r-sw9tscow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-327380662',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:39:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='023f2f5ee5e6461ab40705d667b0d0b5',uuid=824f863d-192f-4339-9f7f-95ca57ebc9c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8efc40e-9156-4814-903d-0226be4bc489", "address": "fa:16:3e:ae:a1:94", "network": {"id": "75bd3e51-ad70-4471-8e61-f53bb210ac0f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-300432593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c2ba7eede774be18ff3afa71255c4b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efc40e-91", "ovs_interfaceid": "e8efc40e-9156-4814-903d-0226be4bc489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Converting VIF {"id": "e8efc40e-9156-4814-903d-0226be4bc489", "address": "fa:16:3e:ae:a1:94", "network": {"id": "75bd3e51-ad70-4471-8e61-f53bb210ac0f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-300432593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c2ba7eede774be18ff3afa71255c4b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efc40e-91", "ovs_interfaceid": "e8efc40e-9156-4814-903d-0226be4bc489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:a1:94,bridge_name='br-int',has_traffic_filtering=True,id=e8efc40e-9156-4814-903d-0226be4bc489,network=Network(75bd3e51-ad70-4471-8e61-f53bb210ac0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8efc40e-91') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.objects.instance [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lazy-loading 'pci_devices' on Instance uuid 824f863d-192f-4339-9f7f-95ca57ebc9c1 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:39:18 user nova-compute[74805]:   <uuid>824f863d-192f-4339-9f7f-95ca57ebc9c1</uuid>
Nov 15 04:39:18 user nova-compute[74805]:   <name>instance-0000002e</name>
Nov 15 04:39:18 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:39:18 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:39:18 user nova-compute[74805]:   <metadata>
Nov 15 04:39:18 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:39:18 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:39:18 user nova-compute[74805]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-941657600</nova:name>
Nov 15 04:39:18 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:39:18</nova:creationTime>
Nov 15 04:39:18 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:39:18 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:39:18 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:39:18 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:39:18 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:39:18 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:39:18 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:39:18 user nova-compute[74805]:       <nova:owner>
Nov 15 04:39:18 user nova-compute[74805]:         <nova:user uuid="023f2f5ee5e6461ab40705d667b0d0b5">tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member</nova:user>
Nov 15 04:39:18 user nova-compute[74805]:         <nova:project uuid="8c2ba7eede774be18ff3afa71255c4b5">tempest-TestServerVolumeAttachScenarioOldVersion-327380662</nova:project>
Nov 15 04:39:18 user nova-compute[74805]:       </nova:owner>
Nov 15 04:39:18 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:39:18 user nova-compute[74805]:       <nova:ports>
Nov 15 04:39:18 user nova-compute[74805]:         <nova:port uuid="e8efc40e-9156-4814-903d-0226be4bc489">
Nov 15 04:39:18 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 04:39:18 user nova-compute[74805]:         </nova:port>
Nov 15 04:39:18 user nova-compute[74805]:       </nova:ports>
Nov 15 04:39:18 user nova-compute[74805]:     </nova:instance>
Nov 15 04:39:18 user nova-compute[74805]:   </metadata>
Nov 15 04:39:18 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:39:18 user nova-compute[74805]:     <system>
Nov 15 04:39:18 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:39:18 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:39:18 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:39:18 user nova-compute[74805]:       <entry name="serial">824f863d-192f-4339-9f7f-95ca57ebc9c1</entry>
Nov 15 04:39:18 user nova-compute[74805]:       <entry name="uuid">824f863d-192f-4339-9f7f-95ca57ebc9c1</entry>
Nov 15 04:39:18 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:39:18 user nova-compute[74805]:     </system>
Nov 15 04:39:18 user nova-compute[74805]:   </sysinfo>
Nov 15 04:39:18 user nova-compute[74805]:   <os>
Nov 15 04:39:18 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:39:18 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:39:18 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:39:18 user nova-compute[74805]:   </os>
Nov 15 04:39:18 user nova-compute[74805]:   <features>
Nov 15 04:39:18 user nova-compute[74805]:     <acpi/>
Nov 15 04:39:18 user nova-compute[74805]:     <apic/>
Nov 15 04:39:18 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:39:18 user nova-compute[74805]:   </features>
Nov 15 04:39:18 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:39:18 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:39:18 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:39:18 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:39:18 user nova-compute[74805]:   </clock>
Nov 15 04:39:18 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:39:18 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:39:18 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:39:18 user nova-compute[74805]:   </cpu>
Nov 15 04:39:18 user nova-compute[74805]:   <devices>
Nov 15 04:39:18 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:39:18 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:39:18 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/824f863d-192f-4339-9f7f-95ca57ebc9c1/disk"/>
Nov 15 04:39:18 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:39:18 user nova-compute[74805]:     </disk>
Nov 15 04:39:18 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:39:18 user nova-compute[74805]:       <mac address="fa:16:3e:ae:a1:94"/>
Nov 15 04:39:18 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:39:18 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:39:18 user nova-compute[74805]:       <target dev="tape8efc40e-91"/>
Nov 15 04:39:18 user nova-compute[74805]:     </interface>
Nov 15 04:39:18 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:39:18 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/824f863d-192f-4339-9f7f-95ca57ebc9c1/console.log" append="off"/>
Nov 15 04:39:18 user nova-compute[74805]:     </serial>
Nov 15 04:39:18 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:39:18 user nova-compute[74805]:     <video>
Nov 15 04:39:18 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:39:18 user nova-compute[74805]:     </video>
Nov 15 04:39:18 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:39:18 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:39:18 user nova-compute[74805]:     </rng>
Nov 15 04:39:18 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:39:18 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:39:18 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:39:18 user nova-compute[74805]:     </memballoon>
Nov 15 04:39:18 user nova-compute[74805]:   </devices>
Nov 15 04:39:18 user nova-compute[74805]: </domain>
Nov 15 04:39:18 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:39:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-941657600',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-941657600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9416576',id=46,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPPi5/PfbPuyS7/M81Us8uIsiIYhG6VMC5bAGMfkCpnrWsIDtLgItCqc4MhHsnuZWtG2kRQogmf1lGejZk+nqohcia1t5yJ293EsMaeS9DrwDVigWJGK365ND3Wdid4rw==',key_name='tempest-keypair-134236616',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c2ba7eede774be18ff3afa71255c4b5',ramdisk_id='',reservation_id='r-sw9tscow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-327380662',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:39:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='023f2f5ee5e6461ab40705d667b0d0b5',uuid=824f863d-192f-4339-9f7f-95ca57ebc9c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8efc40e-9156-4814-903d-0226be4bc489", "address": "fa:16:3e:ae:a1:94", "network": {"id": "75bd3e51-ad70-4471-8e61-f53bb210ac0f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-300432593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c2ba7eede774be18ff3afa71255c4b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efc40e-91", "ovs_interfaceid": "e8efc40e-9156-4814-903d-0226be4bc489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Converting VIF {"id": "e8efc40e-9156-4814-903d-0226be4bc489", "address": "fa:16:3e:ae:a1:94", "network": {"id": "75bd3e51-ad70-4471-8e61-f53bb210ac0f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-300432593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c2ba7eede774be18ff3afa71255c4b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efc40e-91", "ovs_interfaceid": "e8efc40e-9156-4814-903d-0226be4bc489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:a1:94,bridge_name='br-int',has_traffic_filtering=True,id=e8efc40e-9156-4814-903d-0226be4bc489,network=Network(75bd3e51-ad70-4471-8e61-f53bb210ac0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8efc40e-91') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG os_vif [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:a1:94,bridge_name='br-int',has_traffic_filtering=True,id=e8efc40e-9156-4814-903d-0226be4bc489,network=Network(75bd3e51-ad70-4471-8e61-f53bb210ac0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8efc40e-91') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32f49d2c-e0c2-5392-9060-37d8659056bc', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8efc40e-91, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8efc40e-91, col_values=(('qos', UUID('60ebf9bc-25bb-48a0-93f0-8a27fb39e6d4')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8efc40e-91, col_values=(('external_ids', {'iface-id': 'e8efc40e-9156-4814-903d-0226be4bc489', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:a1:94', 'vm-uuid': '824f863d-192f-4339-9f7f-95ca57ebc9c1'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:18 user nova-compute[74805]: INFO os_vif [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:a1:94,bridge_name='br-int',has_traffic_filtering=True,id=e8efc40e-9156-4814-903d-0226be4bc489,network=Network(75bd3e51-ad70-4471-8e61-f53bb210ac0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8efc40e-91')
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] No VIF found with MAC fa:16:3e:ae:a1:94, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.network.neutron [req-00e33c7d-9e20-4ff1-a642-a6136a6fbea2 req-7ca6af67-9089-447a-91d8-86b5db26161a service nova] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Updated VIF entry in instance network info cache for port e8efc40e-9156-4814-903d-0226be4bc489. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG nova.network.neutron [req-00e33c7d-9e20-4ff1-a642-a6136a6fbea2 req-7ca6af67-9089-447a-91d8-86b5db26161a service nova] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Updating instance_info_cache with network_info: [{"id": "e8efc40e-9156-4814-903d-0226be4bc489", "address": "fa:16:3e:ae:a1:94", "network": {"id": "75bd3e51-ad70-4471-8e61-f53bb210ac0f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-300432593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c2ba7eede774be18ff3afa71255c4b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efc40e-91", "ovs_interfaceid": "e8efc40e-9156-4814-903d-0226be4bc489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:39:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-00e33c7d-9e20-4ff1-a642-a6136a6fbea2 req-7ca6af67-9089-447a-91d8-86b5db26161a service nova] Releasing lock "refresh_cache-824f863d-192f-4339-9f7f-95ca57ebc9c1" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:39:19 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:39:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:20 user nova-compute[74805]: DEBUG nova.compute.manager [req-8a8ac3d1-447d-413e-bfb7-27cae44eaf5c req-23a30c8b-dfec-41c1-8b37-c6c888d1a0cb service nova] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Received event network-vif-plugged-e8efc40e-9156-4814-903d-0226be4bc489 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:39:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8a8ac3d1-447d-413e-bfb7-27cae44eaf5c req-23a30c8b-dfec-41c1-8b37-c6c888d1a0cb service nova] Acquiring lock "824f863d-192f-4339-9f7f-95ca57ebc9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:39:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8a8ac3d1-447d-413e-bfb7-27cae44eaf5c req-23a30c8b-dfec-41c1-8b37-c6c888d1a0cb service nova] Lock "824f863d-192f-4339-9f7f-95ca57ebc9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:39:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-8a8ac3d1-447d-413e-bfb7-27cae44eaf5c req-23a30c8b-dfec-41c1-8b37-c6c888d1a0cb service nova] Lock "824f863d-192f-4339-9f7f-95ca57ebc9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:39:20 user nova-compute[74805]: DEBUG nova.compute.manager [req-8a8ac3d1-447d-413e-bfb7-27cae44eaf5c req-23a30c8b-dfec-41c1-8b37-c6c888d1a0cb service nova] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] No waiting events found dispatching network-vif-plugged-e8efc40e-9156-4814-903d-0226be4bc489 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:39:20 user nova-compute[74805]: WARNING nova.compute.manager [req-8a8ac3d1-447d-413e-bfb7-27cae44eaf5c req-23a30c8b-dfec-41c1-8b37-c6c888d1a0cb service nova] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Received unexpected event network-vif-plugged-e8efc40e-9156-4814-903d-0226be4bc489 for instance with vm_state building and task_state spawning.
Nov 15 04:39:20 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:39:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:21 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:39:21 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:39:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:39:21 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Instance spawned successfully.
Nov 15 04:39:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:39:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:39:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:39:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:39:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:39:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:39:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:39:22 user nova-compute[74805]: INFO nova.compute.manager [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Took 5.48 seconds to spawn the instance on the hypervisor.
Nov 15 04:39:22 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:39:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-7ce25b55-637e-4bfc-b68f-33a4879636f9 req-a1ee8f05-8198-4367-a86f-c502807f1016 service nova] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Received event network-vif-plugged-e8efc40e-9156-4814-903d-0226be4bc489 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:39:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7ce25b55-637e-4bfc-b68f-33a4879636f9 req-a1ee8f05-8198-4367-a86f-c502807f1016 service nova] Acquiring lock "824f863d-192f-4339-9f7f-95ca57ebc9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:39:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7ce25b55-637e-4bfc-b68f-33a4879636f9 req-a1ee8f05-8198-4367-a86f-c502807f1016 service nova] Lock "824f863d-192f-4339-9f7f-95ca57ebc9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:39:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7ce25b55-637e-4bfc-b68f-33a4879636f9 req-a1ee8f05-8198-4367-a86f-c502807f1016 service nova] Lock "824f863d-192f-4339-9f7f-95ca57ebc9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:39:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-7ce25b55-637e-4bfc-b68f-33a4879636f9 req-a1ee8f05-8198-4367-a86f-c502807f1016 service nova] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] No waiting events found dispatching network-vif-plugged-e8efc40e-9156-4814-903d-0226be4bc489 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:39:22 user nova-compute[74805]: WARNING nova.compute.manager [req-7ce25b55-637e-4bfc-b68f-33a4879636f9 req-a1ee8f05-8198-4367-a86f-c502807f1016 service nova] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Received unexpected event network-vif-plugged-e8efc40e-9156-4814-903d-0226be4bc489 for instance with vm_state building and task_state spawning.
Nov 15 04:39:22 user nova-compute[74805]: INFO nova.compute.manager [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Took 6.15 seconds to build instance.
Nov 15 04:39:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ce0b77db-eaa5-41af-829a-6abf70fd546c tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lock "824f863d-192f-4339-9f7f-95ca57ebc9c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.247s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:39:23 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:39:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:24 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:39:25 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:39:25 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:39:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:39:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:39:25 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:39:25 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Updating instance_info_cache with network_info: [{"id": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "address": "fa:16:3e:c6:13:c6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9bd2e9-b1", "ovs_interfaceid": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:39:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:39:25 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:39:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:26 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:39:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:39:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:39:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:39:26 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:39:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.365s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:26 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "4612bf54-bb3c-47e8-a6ff-bd5470687844" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:39:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "4612bf54-bb3c-47e8-a6ff-bd5470687844" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:39:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "4612bf54-bb3c-47e8-a6ff-bd5470687844-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:39:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "4612bf54-bb3c-47e8-a6ff-bd5470687844-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:39:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "4612bf54-bb3c-47e8-a6ff-bd5470687844-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:39:27 user nova-compute[74805]: INFO nova.compute.manager [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Terminating instance
Nov 15 04:39:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:39:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG nova.compute.manager [req-ab506085-dc41-4e30-adb9-8f9edc030ba1 req-c595d12a-7428-4578-9dd6-a0e6ef2dad01 service nova] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Received event network-vif-unplugged-aad08482-050c-4d99-babd-5c9d8b0a11d6 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ab506085-dc41-4e30-adb9-8f9edc030ba1 req-c595d12a-7428-4578-9dd6-a0e6ef2dad01 service nova] Acquiring lock "4612bf54-bb3c-47e8-a6ff-bd5470687844-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ab506085-dc41-4e30-adb9-8f9edc030ba1 req-c595d12a-7428-4578-9dd6-a0e6ef2dad01 service nova] Lock "4612bf54-bb3c-47e8-a6ff-bd5470687844-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ab506085-dc41-4e30-adb9-8f9edc030ba1 req-c595d12a-7428-4578-9dd6-a0e6ef2dad01 service nova] Lock "4612bf54-bb3c-47e8-a6ff-bd5470687844-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG nova.compute.manager [req-ab506085-dc41-4e30-adb9-8f9edc030ba1 req-c595d12a-7428-4578-9dd6-a0e6ef2dad01 service nova] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] No waiting events found dispatching network-vif-unplugged-aad08482-050c-4d99-babd-5c9d8b0a11d6 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG nova.compute.manager [req-ab506085-dc41-4e30-adb9-8f9edc030ba1 req-c595d12a-7428-4578-9dd6-a0e6ef2dad01 service nova] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Received event network-vif-unplugged-aad08482-050c-4d99-babd-5c9d8b0a11d6 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ece3a65-78ba-4648-877a-861ffb4ce523/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ece3a65-78ba-4648-877a-861ffb4ce523/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ece3a65-78ba-4648-877a-861ffb4ce523/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:28 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Instance destroyed successfully.
Nov 15 04:39:28 user nova-compute[74805]: DEBUG nova.objects.instance [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lazy-loading 'resources' on Instance uuid 4612bf54-bb3c-47e8-a6ff-bd5470687844 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:37:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-440899373',display_name='tempest-TestVolumeBootPattern-server-440899373',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-440899373',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:37:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2744859f249a4326ab6d268319a34b7f',ramdisk_id='',reservation_id='r-utfal2ua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2043506637',owner_user_name='tempest-TestVolumeBootPattern-2043506637-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:37:53Z,user_data=None,user_id='0bd96ecd9d404779ad64456c6517591f',uuid=4612bf54-bb3c-47e8-a6ff-bd5470687844,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aad08482-050c-4d99-babd-5c9d8b0a11d6", "address": "fa:16:3e:6e:e9:e6", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad08482-05", "ovs_interfaceid": "aad08482-050c-4d99-babd-5c9d8b0a11d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converting VIF {"id": "aad08482-050c-4d99-babd-5c9d8b0a11d6", "address": "fa:16:3e:6e:e9:e6", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad08482-05", "ovs_interfaceid": "aad08482-050c-4d99-babd-5c9d8b0a11d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:e9:e6,bridge_name='br-int',has_traffic_filtering=True,id=aad08482-050c-4d99-babd-5c9d8b0a11d6,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaad08482-05') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG os_vif [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:e9:e6,bridge_name='br-int',has_traffic_filtering=True,id=aad08482-050c-4d99-babd-5c9d8b0a11d6,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaad08482-05') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaad08482-05, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f7ff898a-c578-4f92-9b46-ba9fe058d060) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:39:28 user nova-compute[74805]: INFO os_vif [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:e9:e6,bridge_name='br-int',has_traffic_filtering=True,id=aad08482-050c-4d99-babd-5c9d8b0a11d6,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaad08482-05')
Nov 15 04:39:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eANbBDKn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:39:28 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:39:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ece3a65-78ba-4648-877a-861ffb4ce523/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[97370cd4-7548-48bd-b8d6-60d3a2b5ac95]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:39:28 user nova-compute[74805]: No targets found.
Nov 15 04:39:28 user nova-compute[74805]: iSNS:
Nov 15 04:39:28 user nova-compute[74805]: No targets found.
Nov 15 04:39:28 user nova-compute[74805]: STATIC:
Nov 15 04:39:28 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c
Nov 15 04:39:28 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:39:28 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:39:28 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f
Nov 15 04:39:28 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:39:28 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:39:28 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada
Nov 15 04:39:28 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:39:28 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:39:28 user nova-compute[74805]: FIRMWARE:
Nov 15 04:39:28 user nova-compute[74805]: No targets found.
Nov 15 04:39:28 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:39:28 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:39:28 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/824f863d-192f-4339-9f7f-95ca57ebc9c1/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf4e1f0-0182-47b6-a531-d9760cc800ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[409c83ee-9f4a-4e84-ae80-7e66bbaf677b]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:39:28 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:39:28 user nova-compute[74805]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c (non-flash)
Nov 15 04:39:28 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:39:28 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:39:28 user nova-compute[74805]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c (non-flash)
Nov 15 04:39:28 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c7651b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c'): ({'sdd'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Removing single pathed devices sdd {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0d36aa-4492-4468-a544-cc058509aa32]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f0dd08-9f66-425e-834f-732526399faa]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Flushing IO for device /dev/sdd {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f52f24e-31fd-4726-98d3-4ec4b1932a3d]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/824f863d-192f-4339-9f7f-95ca57ebc9c1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/824f863d-192f-4339-9f7f-95ca57ebc9c1/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.071s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1785b0-34d0-456f-843e-da93c867919a]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] SCSI volumes sdd have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO7971a6fb-78f27996bc58c04d', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7971a6fb', '/dev/disk/by-id/scsi-23738663237393936') {{(pid=85029) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a949ca5-ca3d-4b20-b7e3-026e831d115a]: (4, None) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5a0eee-60f4-461e-8471-fd3c0adfe2b3]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5079e8-1f11-4d91-b47f-19caec19736d]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c, portal: 172.16.0.220,3260]
Nov 15 04:39:28 user nova-compute[74805]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c, portal: 172.16.0.220,3260] successful.
Nov 15 04:39:28 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/824f863d-192f-4339-9f7f-95ca57ebc9c1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9edb5d45-686c-413e-8821-3409bb3ada0c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d26b87b-c43d-4c2a-86c4-deef1380e853]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] <== disconnect_volume: return (383ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:39:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:39:28 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Deleting instance files /opt/stack/data/nova/instances/4612bf54-bb3c-47e8-a6ff-bd5470687844_del
Nov 15 04:39:28 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Deletion of /opt/stack/data/nova/instances/4612bf54-bb3c-47e8-a6ff-bd5470687844_del complete
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:28 user nova-compute[74805]: INFO nova.compute.manager [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 15 04:39:28 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:39:29 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:39:29 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:39:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:29 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:39:29 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Took 0.43 seconds to deallocate network for instance.
Nov 15 04:39:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:39:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:39:30 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:39:30 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:39:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=8198MB free_disk=24.831207275390625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:39:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:39:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:39:30 user nova-compute[74805]: DEBUG nova.compute.manager [req-e5855d49-0425-4dfe-bf62-bb3d2d60e6b2 req-a3fcbc3a-2c3c-4e7f-8702-13240dce072a service nova] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Received event network-vif-plugged-aad08482-050c-4d99-babd-5c9d8b0a11d6 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:39:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e5855d49-0425-4dfe-bf62-bb3d2d60e6b2 req-a3fcbc3a-2c3c-4e7f-8702-13240dce072a service nova] Acquiring lock "4612bf54-bb3c-47e8-a6ff-bd5470687844-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:39:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e5855d49-0425-4dfe-bf62-bb3d2d60e6b2 req-a3fcbc3a-2c3c-4e7f-8702-13240dce072a service nova] Lock "4612bf54-bb3c-47e8-a6ff-bd5470687844-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:39:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e5855d49-0425-4dfe-bf62-bb3d2d60e6b2 req-a3fcbc3a-2c3c-4e7f-8702-13240dce072a service nova] Lock "4612bf54-bb3c-47e8-a6ff-bd5470687844-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:39:30 user nova-compute[74805]: DEBUG nova.compute.manager [req-e5855d49-0425-4dfe-bf62-bb3d2d60e6b2 req-a3fcbc3a-2c3c-4e7f-8702-13240dce072a service nova] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] No waiting events found dispatching network-vif-plugged-aad08482-050c-4d99-babd-5c9d8b0a11d6 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:39:30 user nova-compute[74805]: WARNING nova.compute.manager [req-e5855d49-0425-4dfe-bf62-bb3d2d60e6b2 req-a3fcbc3a-2c3c-4e7f-8702-13240dce072a service nova] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Received unexpected event network-vif-plugged-aad08482-050c-4d99-babd-5c9d8b0a11d6 for instance with vm_state active and task_state deleting.
Nov 15 04:39:30 user nova-compute[74805]: DEBUG nova.compute.manager [req-e5855d49-0425-4dfe-bf62-bb3d2d60e6b2 req-a3fcbc3a-2c3c-4e7f-8702-13240dce072a service nova] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Received event network-vif-deleted-aad08482-050c-4d99-babd-5c9d8b0a11d6 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:39:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 9f267864-0b72-431d-9b0d-c63436002a4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:39:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 38196606-a9c9-4604-ad21-2ec7511a8b28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:39:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 288a5e5c-f8e9-4507-b29c-93e7595922ac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:39:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 75731a3d-3c78-4014-a8dc-f38c3d7b3305 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:39:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:39:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 6ece3a65-78ba-4648-877a-861ffb4ce523 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:39:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 4612bf54-bb3c-47e8-a6ff-bd5470687844 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:39:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 824f863d-192f-4339-9f7f-95ca57ebc9c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:39:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:39:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:39:30 user nova-compute[74805]: INFO nova.compute.manager [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Took 0.77 seconds to detach 1 volumes for instance.
Nov 15 04:39:30 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 4612bf54-bb3c-47e8-a6ff-bd5470687844] Deleting volume: 9edb5d45-686c-413e-8821-3409bb3ada0c {{(pid=74805) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 04:39:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:39:30 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:39:30 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:39:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:39:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.437s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:39:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.134s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:39:30 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:39:30 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:39:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:39:30 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Deleted allocations for instance 4612bf54-bb3c-47e8-a6ff-bd5470687844
Nov 15 04:39:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ad1337c2-b410-4152-bc30-24a5012afddd tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "4612bf54-bb3c-47e8-a6ff-bd5470687844" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.142s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:39:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:32 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:39:32 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:39:32 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:39:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:53 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:39:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:39:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:39:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:39:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:58 user nova-compute[74805]: INFO nova.compute.manager [None req-2da7241f-569f-4601-9fdd-f5e71583e26a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Unrescuing
Nov 15 04:39:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2da7241f-569f-4601-9fdd-f5e71583e26a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "refresh_cache-6ece3a65-78ba-4648-877a-861ffb4ce523" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:39:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2da7241f-569f-4601-9fdd-f5e71583e26a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquired lock "refresh_cache-6ece3a65-78ba-4648-877a-861ffb4ce523" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:39:58 user nova-compute[74805]: DEBUG nova.network.neutron [None req-2da7241f-569f-4601-9fdd-f5e71583e26a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:39:59 user nova-compute[74805]: DEBUG nova.network.neutron [None req-2da7241f-569f-4601-9fdd-f5e71583e26a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Updating instance_info_cache with network_info: [{"id": "b4c47025-7d95-4d09-9371-614d2b198868", "address": "fa:16:3e:fb:ec:0a", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c47025-7d", "ovs_interfaceid": "b4c47025-7d95-4d09-9371-614d2b198868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:39:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2da7241f-569f-4601-9fdd-f5e71583e26a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Releasing lock "refresh_cache-6ece3a65-78ba-4648-877a-861ffb4ce523" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:39:59 user nova-compute[74805]: DEBUG nova.objects.instance [None req-2da7241f-569f-4601-9fdd-f5e71583e26a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lazy-loading 'flavor' on Instance uuid 6ece3a65-78ba-4648-877a-861ffb4ce523 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:39:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:59 user nova-compute[74805]: DEBUG nova.compute.manager [req-dc3db444-3dd4-4b60-a5e2-680d355c9355 req-c2d3957e-e53f-488e-bf71-24eb075b0bf8 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Received event network-vif-unplugged-b4c47025-7d95-4d09-9371-614d2b198868 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:39:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-dc3db444-3dd4-4b60-a5e2-680d355c9355 req-c2d3957e-e53f-488e-bf71-24eb075b0bf8 service nova] Acquiring lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:39:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-dc3db444-3dd4-4b60-a5e2-680d355c9355 req-c2d3957e-e53f-488e-bf71-24eb075b0bf8 service nova] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:39:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-dc3db444-3dd4-4b60-a5e2-680d355c9355 req-c2d3957e-e53f-488e-bf71-24eb075b0bf8 service nova] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:39:59 user nova-compute[74805]: DEBUG nova.compute.manager [req-dc3db444-3dd4-4b60-a5e2-680d355c9355 req-c2d3957e-e53f-488e-bf71-24eb075b0bf8 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] No waiting events found dispatching network-vif-unplugged-b4c47025-7d95-4d09-9371-614d2b198868 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:39:59 user nova-compute[74805]: WARNING nova.compute.manager [req-dc3db444-3dd4-4b60-a5e2-680d355c9355 req-c2d3957e-e53f-488e-bf71-24eb075b0bf8 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Received unexpected event network-vif-unplugged-b4c47025-7d95-4d09-9371-614d2b198868 for instance with vm_state rescued and task_state unrescuing.
Nov 15 04:39:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:39:59 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Instance destroyed successfully.
Nov 15 04:40:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:01 user nova-compute[74805]: DEBUG nova.compute.manager [req-c5bcad2c-dc1c-459f-9466-c993822b41c1 req-dff907b9-549b-446e-be84-ee027af1e614 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Received event network-vif-plugged-b4c47025-7d95-4d09-9371-614d2b198868 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:40:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c5bcad2c-dc1c-459f-9466-c993822b41c1 req-dff907b9-549b-446e-be84-ee027af1e614 service nova] Acquiring lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:40:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c5bcad2c-dc1c-459f-9466-c993822b41c1 req-dff907b9-549b-446e-be84-ee027af1e614 service nova] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:40:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c5bcad2c-dc1c-459f-9466-c993822b41c1 req-dff907b9-549b-446e-be84-ee027af1e614 service nova] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:40:01 user nova-compute[74805]: DEBUG nova.compute.manager [req-c5bcad2c-dc1c-459f-9466-c993822b41c1 req-dff907b9-549b-446e-be84-ee027af1e614 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] No waiting events found dispatching network-vif-plugged-b4c47025-7d95-4d09-9371-614d2b198868 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:40:01 user nova-compute[74805]: WARNING nova.compute.manager [req-c5bcad2c-dc1c-459f-9466-c993822b41c1 req-dff907b9-549b-446e-be84-ee027af1e614 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Received unexpected event network-vif-plugged-b4c47025-7d95-4d09-9371-614d2b198868 for instance with vm_state rescued and task_state unrescuing.
Nov 15 04:40:01 user nova-compute[74805]: DEBUG nova.compute.manager [req-c5bcad2c-dc1c-459f-9466-c993822b41c1 req-dff907b9-549b-446e-be84-ee027af1e614 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Received event network-vif-plugged-b4c47025-7d95-4d09-9371-614d2b198868 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:40:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c5bcad2c-dc1c-459f-9466-c993822b41c1 req-dff907b9-549b-446e-be84-ee027af1e614 service nova] Acquiring lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:40:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c5bcad2c-dc1c-459f-9466-c993822b41c1 req-dff907b9-549b-446e-be84-ee027af1e614 service nova] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:40:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c5bcad2c-dc1c-459f-9466-c993822b41c1 req-dff907b9-549b-446e-be84-ee027af1e614 service nova] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:40:01 user nova-compute[74805]: DEBUG nova.compute.manager [req-c5bcad2c-dc1c-459f-9466-c993822b41c1 req-dff907b9-549b-446e-be84-ee027af1e614 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] No waiting events found dispatching network-vif-plugged-b4c47025-7d95-4d09-9371-614d2b198868 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:40:01 user nova-compute[74805]: WARNING nova.compute.manager [req-c5bcad2c-dc1c-459f-9466-c993822b41c1 req-dff907b9-549b-446e-be84-ee027af1e614 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Received unexpected event network-vif-plugged-b4c47025-7d95-4d09-9371-614d2b198868 for instance with vm_state rescued and task_state unrescuing.
Nov 15 04:40:01 user nova-compute[74805]: DEBUG nova.compute.manager [req-c5bcad2c-dc1c-459f-9466-c993822b41c1 req-dff907b9-549b-446e-be84-ee027af1e614 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Received event network-vif-plugged-b4c47025-7d95-4d09-9371-614d2b198868 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:40:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c5bcad2c-dc1c-459f-9466-c993822b41c1 req-dff907b9-549b-446e-be84-ee027af1e614 service nova] Acquiring lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:40:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c5bcad2c-dc1c-459f-9466-c993822b41c1 req-dff907b9-549b-446e-be84-ee027af1e614 service nova] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:40:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c5bcad2c-dc1c-459f-9466-c993822b41c1 req-dff907b9-549b-446e-be84-ee027af1e614 service nova] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:40:01 user nova-compute[74805]: DEBUG nova.compute.manager [req-c5bcad2c-dc1c-459f-9466-c993822b41c1 req-dff907b9-549b-446e-be84-ee027af1e614 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] No waiting events found dispatching network-vif-plugged-b4c47025-7d95-4d09-9371-614d2b198868 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:40:01 user nova-compute[74805]: WARNING nova.compute.manager [req-c5bcad2c-dc1c-459f-9466-c993822b41c1 req-dff907b9-549b-446e-be84-ee027af1e614 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Received unexpected event network-vif-plugged-b4c47025-7d95-4d09-9371-614d2b198868 for instance with vm_state rescued and task_state unrescuing.
Nov 15 04:40:03 user nova-compute[74805]: DEBUG nova.compute.manager [None req-2da7241f-569f-4601-9fdd-f5e71583e26a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:40:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:40:18 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:40:18 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74805) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 04:40:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:40:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:40:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:40:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:40:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:19 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:40:20 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:40:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:21 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:40:23 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:40:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:25 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:40:25 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:40:25 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Cleaning up deleted instances {{(pid=74805) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 04:40:25 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] There are 0 instances to clean {{(pid=74805) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 04:40:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:26 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:40:26 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:40:26 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Rebuilding the list of instances to heal {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 04:40:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-9f267864-0b72-431d-9b0d-c63436002a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:40:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-9f267864-0b72-431d-9b0d-c63436002a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:40:26 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:40:26 user nova-compute[74805]: DEBUG nova.objects.instance [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lazy-loading 'info_cache' on Instance uuid 9f267864-0b72-431d-9b0d-c63436002a4c {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:40:27 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Updating instance_info_cache with network_info: [{"id": "bd5458e6-03d9-4fab-bbfb-23989a82c193", "address": "fa:16:3e:86:87:bc", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5458e6-03", "ovs_interfaceid": "bd5458e6-03d9-4fab-bbfb-23989a82c193", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:40:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-9f267864-0b72-431d-9b0d-c63436002a4c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:40:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:40:27 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:40:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:40:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:40:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:40:27 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:40:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:40:27 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:40:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:40:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:40:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "fc2f6bf9-8d88-4e9b-afd3-98e747430e6c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:40:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "fc2f6bf9-8d88-4e9b-afd3-98e747430e6c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:40:28 user nova-compute[74805]: DEBUG nova.compute.manager [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:40:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:40:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:40:28 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:40:28 user nova-compute[74805]: INFO nova.compute.claims [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Claim successful on node user
Nov 15 04:40:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:40:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:40:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:28 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:40:28 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:40:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:40:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG nova.compute.manager [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG nova.compute.manager [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG nova.network.neutron [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:40:29 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:40:29 user nova-compute[74805]: DEBUG nova.compute.manager [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG nova.policy [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bd96ecd9d404779ad64456c6517591f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2744859f249a4326ab6d268319a34b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:40:29 user nova-compute[74805]: INFO nova.virt.block_device [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Booting with volume 83075b96-5275-42b0-b5b3-5bb801112eea at /dev/vda
Nov 15 04:40:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/824f863d-192f-4339-9f7f-95ca57ebc9c1/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG os_brick.utils [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd41a3b8-571e-4da0-8943-181f9fad1b43]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6a59c1-48fc-4101-9ce7-29e209dd1885]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23ae460-6f20-4a01-9890-8671d4ff55e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d53d4b-5735-46e3-a3a6-263bfef180ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/824f863d-192f-4339-9f7f-95ca57ebc9c1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/824f863d-192f-4339-9f7f-95ca57ebc9c1/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:40:29 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:40:29 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c00a2f-7de8-4ad9-83c7-9b7db129f0ec]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG os_brick.utils [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Updating existing volume attachment record: ae6007f9-6f6b-4964-8030-b4e3c279733b {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/824f863d-192f-4339-9f7f-95ca57ebc9c1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG nova.network.neutron [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Successfully created port: e0bd84d5-354d-4e71-a2d9-a1ce442dc1df {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:40:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:30 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:40:30 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:30 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:40:30 user nova-compute[74805]: DEBUG nova.network.neutron [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Successfully updated port: e0bd84d5-354d-4e71-a2d9-a1ce442dc1df {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:40:30 user nova-compute[74805]: DEBUG nova.compute.manager [req-5c119a0a-c8c4-47ec-8300-6edbea7523a7 req-b92901bf-646b-4096-8a01-a5f120caffb6 service nova] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Received event network-changed-e0bd84d5-354d-4e71-a2d9-a1ce442dc1df {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:40:30 user nova-compute[74805]: DEBUG nova.compute.manager [req-5c119a0a-c8c4-47ec-8300-6edbea7523a7 req-b92901bf-646b-4096-8a01-a5f120caffb6 service nova] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Refreshing instance network info cache due to event network-changed-e0bd84d5-354d-4e71-a2d9-a1ce442dc1df. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:40:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5c119a0a-c8c4-47ec-8300-6edbea7523a7 req-b92901bf-646b-4096-8a01-a5f120caffb6 service nova] Acquiring lock "refresh_cache-fc2f6bf9-8d88-4e9b-afd3-98e747430e6c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:40:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5c119a0a-c8c4-47ec-8300-6edbea7523a7 req-b92901bf-646b-4096-8a01-a5f120caffb6 service nova] Acquired lock "refresh_cache-fc2f6bf9-8d88-4e9b-afd3-98e747430e6c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:40:30 user nova-compute[74805]: DEBUG nova.network.neutron [req-5c119a0a-c8c4-47ec-8300-6edbea7523a7 req-b92901bf-646b-4096-8a01-a5f120caffb6 service nova] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Refreshing network info cache for port e0bd84d5-354d-4e71-a2d9-a1ce442dc1df {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:40:30 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:40:30 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:40:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=8213MB free_disk=24.794265747070312GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:40:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:40:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:40:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "refresh_cache-fc2f6bf9-8d88-4e9b-afd3-98e747430e6c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:40:30 user nova-compute[74805]: DEBUG nova.network.neutron [req-5c119a0a-c8c4-47ec-8300-6edbea7523a7 req-b92901bf-646b-4096-8a01-a5f120caffb6 service nova] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:40:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 9f267864-0b72-431d-9b0d-c63436002a4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:40:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 38196606-a9c9-4604-ad21-2ec7511a8b28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:40:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 288a5e5c-f8e9-4507-b29c-93e7595922ac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:40:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 75731a3d-3c78-4014-a8dc-f38c3d7b3305 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:40:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:40:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 6ece3a65-78ba-4648-877a-861ffb4ce523 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:40:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 824f863d-192f-4339-9f7f-95ca57ebc9c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:40:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance fc2f6bf9-8d88-4e9b-afd3-98e747430e6c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:40:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:40:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:40:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:30 user nova-compute[74805]: DEBUG nova.network.neutron [req-5c119a0a-c8c4-47ec-8300-6edbea7523a7 req-b92901bf-646b-4096-8a01-a5f120caffb6 service nova] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:40:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5c119a0a-c8c4-47ec-8300-6edbea7523a7 req-b92901bf-646b-4096-8a01-a5f120caffb6 service nova] Releasing lock "refresh_cache-fc2f6bf9-8d88-4e9b-afd3-98e747430e6c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:40:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquired lock "refresh_cache-fc2f6bf9-8d88-4e9b-afd3-98e747430e6c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:40:30 user nova-compute[74805]: DEBUG nova.network.neutron [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:40:31 user nova-compute[74805]: DEBUG nova.network.neutron [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:40:31 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:40:31 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:40:31 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:40:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.412s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:40:31 user nova-compute[74805]: DEBUG nova.network.neutron [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Updating instance_info_cache with network_info: [{"id": "e0bd84d5-354d-4e71-a2d9-a1ce442dc1df", "address": "fa:16:3e:41:71:15", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bd84d5-35", "ovs_interfaceid": "e0bd84d5-354d-4e71-a2d9-a1ce442dc1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:40:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Releasing lock "refresh_cache-fc2f6bf9-8d88-4e9b-afd3-98e747430e6c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:40:31 user nova-compute[74805]: DEBUG nova.compute.manager [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Instance network_info: |[{"id": "e0bd84d5-354d-4e71-a2d9-a1ce442dc1df", "address": "fa:16:3e:41:71:15", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bd84d5-35", "ovs_interfaceid": "e0bd84d5-354d-4e71-a2d9-a1ce442dc1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:40:31 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:40:31 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:40:31 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:40:32 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:40:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG nova.compute.manager [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:40:34 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Creating image(s)
Nov 15 04:40:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Did not create local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Ensure instance console log exists: /opt/stack/data/nova/instances/fc2f6bf9-8d88-4e9b-afd3-98e747430e6c/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Start _get_guest_xml network_info=[{"id": "e0bd84d5-354d-4e71-a2d9-a1ce442dc1df", "address": "fa:16:3e:41:71:15", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bd84d5-35", "ovs_interfaceid": "e0bd84d5-354d-4e71-a2d9-a1ce442dc1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dUVxyRcC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fc2f6bf9-8d88-4e9b-afd3-98e747430e6c', 'attached_at': '', 'detached_at': '', 'volume_id': '83075b96-5275-42b0-b5b3-5bb801112eea', 'serial': '83075b96-5275-42b0-b5b3-5bb801112eea'}, 'delete_on_termination': True, 'attachment_id': 'ae6007f9-6f6b-4964-8030-b4e3c279733b', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:40:34 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:40:34 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:40:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dUVxyRcC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:40:34 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:40:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:40:34 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:40:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:40:34 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3883e7b6-a12b-40bb-91f9-240269b43c6c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:40:34 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[84644079-12a3-4b39-b1d1-95aaa24d4b38]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea] added
Nov 15 04:40:34 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[08928eec-9c61-45fd-aede-8d63d1e98b32]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb78ded-f481-4b72-9f52-cf0795d01145]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dUVxyRcC {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dUVxyRcC" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc63be3d-4e19-4cbb-9d42-7f1ea10bd4f3]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dUVxyRcC'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec6709d-bb96-470c-8b4e-1a0f7d90dedf]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ef47d6-b3c9-46ff-befc-fe3158e72cf1]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:40:34 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:40:34 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:40:34 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:40:34 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[10271d08-22f5-435c-bf42-b3ef30247fdc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea, portal: 172.16.0.220,3260]
Nov 15 04:40:34 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea, portal: 172.16.0.220,3260] successful.
Nov 15 04:40:34 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2976e3d0-734c-4807-9c62-7ed1e2cc988c]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[374e7473-71a6-4ee7-9e8b-2c6444403207]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:40:34 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:40:34 user nova-compute[74805]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)
Nov 15 04:40:34 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:40:34 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:40:34 user nova-compute[74805]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)
Nov 15 04:40:34 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f003e3f3-ad5e-4c84-a533-0b20dccde2e0]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:40:34 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: None {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dUVxyRcC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23163356463636637', 'path': '/dev/sdc'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163356463636637', 'path': '/dev/sdc'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:40:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1368588530',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1368588530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1368588530',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPVhaJRbx/KF2fraGUFym8TuSHMCm+vr08sQSUwQYIBIb1+EFD3I6MyH1WfQ5L2pKwKyLMV17sD92SFso34OMbCx9xYOq37NycVpD4suFLRe0spFwbkj2cB2nj7NN+NAg==',key_name='tempest-keypair-1367394065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2744859f249a4326ab6d268319a34b7f',ramdisk_id='',reservation_id='r-zu081ob5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2043506637',owner_user_name='tempest-TestVolumeBootPattern-2043506637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:40:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bd96ecd9d404779ad64456c6517591f',uuid=fc2f6bf9-8d88-4e9b-afd3-98e747430e6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0bd84d5-354d-4e71-a2d9-a1ce442dc1df", "address": "fa:16:3e:41:71:15", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bd84d5-35", "ovs_interfaceid": "e0bd84d5-354d-4e71-a2d9-a1ce442dc1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converting VIF {"id": "e0bd84d5-354d-4e71-a2d9-a1ce442dc1df", "address": "fa:16:3e:41:71:15", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bd84d5-35", "ovs_interfaceid": "e0bd84d5-354d-4e71-a2d9-a1ce442dc1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:71:15,bridge_name='br-int',has_traffic_filtering=True,id=e0bd84d5-354d-4e71-a2d9-a1ce442dc1df,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0bd84d5-35') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG nova.objects.instance [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lazy-loading 'pci_devices' on Instance uuid fc2f6bf9-8d88-4e9b-afd3-98e747430e6c {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:40:35 user nova-compute[74805]:   <uuid>fc2f6bf9-8d88-4e9b-afd3-98e747430e6c</uuid>
Nov 15 04:40:35 user nova-compute[74805]:   <name>instance-0000002f</name>
Nov 15 04:40:35 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:40:35 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:40:35 user nova-compute[74805]:   <metadata>
Nov 15 04:40:35 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:40:35 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:40:35 user nova-compute[74805]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1368588530</nova:name>
Nov 15 04:40:35 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:40:34</nova:creationTime>
Nov 15 04:40:35 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:40:35 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:40:35 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:40:35 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:40:35 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:40:35 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:40:35 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:40:35 user nova-compute[74805]:       <nova:owner>
Nov 15 04:40:35 user nova-compute[74805]:         <nova:user uuid="0bd96ecd9d404779ad64456c6517591f">tempest-TestVolumeBootPattern-2043506637-project-member</nova:user>
Nov 15 04:40:35 user nova-compute[74805]:         <nova:project uuid="2744859f249a4326ab6d268319a34b7f">tempest-TestVolumeBootPattern-2043506637</nova:project>
Nov 15 04:40:35 user nova-compute[74805]:       </nova:owner>
Nov 15 04:40:35 user nova-compute[74805]:       <nova:ports>
Nov 15 04:40:35 user nova-compute[74805]:         <nova:port uuid="e0bd84d5-354d-4e71-a2d9-a1ce442dc1df">
Nov 15 04:40:35 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 04:40:35 user nova-compute[74805]:         </nova:port>
Nov 15 04:40:35 user nova-compute[74805]:       </nova:ports>
Nov 15 04:40:35 user nova-compute[74805]:     </nova:instance>
Nov 15 04:40:35 user nova-compute[74805]:   </metadata>
Nov 15 04:40:35 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:40:35 user nova-compute[74805]:     <system>
Nov 15 04:40:35 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:40:35 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:40:35 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:40:35 user nova-compute[74805]:       <entry name="serial">fc2f6bf9-8d88-4e9b-afd3-98e747430e6c</entry>
Nov 15 04:40:35 user nova-compute[74805]:       <entry name="uuid">fc2f6bf9-8d88-4e9b-afd3-98e747430e6c</entry>
Nov 15 04:40:35 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:40:35 user nova-compute[74805]:     </system>
Nov 15 04:40:35 user nova-compute[74805]:   </sysinfo>
Nov 15 04:40:35 user nova-compute[74805]:   <os>
Nov 15 04:40:35 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:40:35 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:40:35 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:40:35 user nova-compute[74805]:   </os>
Nov 15 04:40:35 user nova-compute[74805]:   <features>
Nov 15 04:40:35 user nova-compute[74805]:     <acpi/>
Nov 15 04:40:35 user nova-compute[74805]:     <apic/>
Nov 15 04:40:35 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:40:35 user nova-compute[74805]:   </features>
Nov 15 04:40:35 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:40:35 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:40:35 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:40:35 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:40:35 user nova-compute[74805]:   </clock>
Nov 15 04:40:35 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:40:35 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:40:35 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:40:35 user nova-compute[74805]:   </cpu>
Nov 15 04:40:35 user nova-compute[74805]:   <devices>
Nov 15 04:40:35 user nova-compute[74805]:     <disk type="block" device="disk">
Nov 15 04:40:35 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:40:35 user nova-compute[74805]:       <source dev="/dev/sdc"/>
Nov 15 04:40:35 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:40:35 user nova-compute[74805]:       <serial>83075b96-5275-42b0-b5b3-5bb801112eea</serial>
Nov 15 04:40:35 user nova-compute[74805]:     </disk>
Nov 15 04:40:35 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:40:35 user nova-compute[74805]:       <mac address="fa:16:3e:41:71:15"/>
Nov 15 04:40:35 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:40:35 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:40:35 user nova-compute[74805]:       <target dev="tape0bd84d5-35"/>
Nov 15 04:40:35 user nova-compute[74805]:     </interface>
Nov 15 04:40:35 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:40:35 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/fc2f6bf9-8d88-4e9b-afd3-98e747430e6c/console.log" append="off"/>
Nov 15 04:40:35 user nova-compute[74805]:     </serial>
Nov 15 04:40:35 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:40:35 user nova-compute[74805]:     <video>
Nov 15 04:40:35 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:40:35 user nova-compute[74805]:     </video>
Nov 15 04:40:35 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:40:35 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:40:35 user nova-compute[74805]:     </rng>
Nov 15 04:40:35 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:40:35 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:40:35 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:40:35 user nova-compute[74805]:     </memballoon>
Nov 15 04:40:35 user nova-compute[74805]:   </devices>
Nov 15 04:40:35 user nova-compute[74805]: </domain>
Nov 15 04:40:35 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:40:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1368588530',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1368588530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1368588530',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPVhaJRbx/KF2fraGUFym8TuSHMCm+vr08sQSUwQYIBIb1+EFD3I6MyH1WfQ5L2pKwKyLMV17sD92SFso34OMbCx9xYOq37NycVpD4suFLRe0spFwbkj2cB2nj7NN+NAg==',key_name='tempest-keypair-1367394065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2744859f249a4326ab6d268319a34b7f',ramdisk_id='',reservation_id='r-zu081ob5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2043506637',owner_user_name='tempest-TestVolumeBootPattern-2043506637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:40:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bd96ecd9d404779ad64456c6517591f',uuid=fc2f6bf9-8d88-4e9b-afd3-98e747430e6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0bd84d5-354d-4e71-a2d9-a1ce442dc1df", "address": "fa:16:3e:41:71:15", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bd84d5-35", "ovs_interfaceid": "e0bd84d5-354d-4e71-a2d9-a1ce442dc1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converting VIF {"id": "e0bd84d5-354d-4e71-a2d9-a1ce442dc1df", "address": "fa:16:3e:41:71:15", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bd84d5-35", "ovs_interfaceid": "e0bd84d5-354d-4e71-a2d9-a1ce442dc1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:71:15,bridge_name='br-int',has_traffic_filtering=True,id=e0bd84d5-354d-4e71-a2d9-a1ce442dc1df,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0bd84d5-35') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG os_vif [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:71:15,bridge_name='br-int',has_traffic_filtering=True,id=e0bd84d5-354d-4e71-a2d9-a1ce442dc1df,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0bd84d5-35') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc554276-7610-5530-a26b-5ff3ac0fd969', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0bd84d5-35, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape0bd84d5-35, col_values=(('qos', UUID('74a31e8c-90a7-47d9-974f-14bc0ea7c22e')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape0bd84d5-35, col_values=(('external_ids', {'iface-id': 'e0bd84d5-354d-4e71-a2d9-a1ce442dc1df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:71:15', 'vm-uuid': 'fc2f6bf9-8d88-4e9b-afd3-98e747430e6c'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:35 user nova-compute[74805]: INFO os_vif [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:71:15,bridge_name='br-int',has_traffic_filtering=True,id=e0bd84d5-354d-4e71-a2d9-a1ce442dc1df,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0bd84d5-35')
Nov 15 04:40:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] No VIF found with MAC fa:16:3e:41:71:15, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:40:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:36 user nova-compute[74805]: DEBUG nova.compute.manager [req-d66708ea-34eb-4a5e-b199-006c3768a348 req-f1eb4075-c03a-4a4b-a53d-f9e8d831cd03 service nova] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Received event network-vif-plugged-e0bd84d5-354d-4e71-a2d9-a1ce442dc1df {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:40:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d66708ea-34eb-4a5e-b199-006c3768a348 req-f1eb4075-c03a-4a4b-a53d-f9e8d831cd03 service nova] Acquiring lock "fc2f6bf9-8d88-4e9b-afd3-98e747430e6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:40:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d66708ea-34eb-4a5e-b199-006c3768a348 req-f1eb4075-c03a-4a4b-a53d-f9e8d831cd03 service nova] Lock "fc2f6bf9-8d88-4e9b-afd3-98e747430e6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:40:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d66708ea-34eb-4a5e-b199-006c3768a348 req-f1eb4075-c03a-4a4b-a53d-f9e8d831cd03 service nova] Lock "fc2f6bf9-8d88-4e9b-afd3-98e747430e6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:40:36 user nova-compute[74805]: DEBUG nova.compute.manager [req-d66708ea-34eb-4a5e-b199-006c3768a348 req-f1eb4075-c03a-4a4b-a53d-f9e8d831cd03 service nova] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] No waiting events found dispatching network-vif-plugged-e0bd84d5-354d-4e71-a2d9-a1ce442dc1df {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:40:36 user nova-compute[74805]: WARNING nova.compute.manager [req-d66708ea-34eb-4a5e-b199-006c3768a348 req-f1eb4075-c03a-4a4b-a53d-f9e8d831cd03 service nova] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Received unexpected event network-vif-plugged-e0bd84d5-354d-4e71-a2d9-a1ce442dc1df for instance with vm_state building and task_state spawning.
Nov 15 04:40:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:38 user nova-compute[74805]: DEBUG nova.compute.manager [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:40:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:40:38 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Instance spawned successfully.
Nov 15 04:40:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:40:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:40:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:40:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:40:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:40:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:40:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:40:38 user nova-compute[74805]: INFO nova.compute.manager [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Took 4.87 seconds to spawn the instance on the hypervisor.
Nov 15 04:40:38 user nova-compute[74805]: DEBUG nova.compute.manager [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:40:39 user nova-compute[74805]: DEBUG nova.compute.manager [req-5fa46816-2d75-4f25-bed4-b0733b606a35 req-c390fb9d-29ae-4fb5-9881-e93ca29a18ea service nova] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Received event network-vif-plugged-e0bd84d5-354d-4e71-a2d9-a1ce442dc1df {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:40:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5fa46816-2d75-4f25-bed4-b0733b606a35 req-c390fb9d-29ae-4fb5-9881-e93ca29a18ea service nova] Acquiring lock "fc2f6bf9-8d88-4e9b-afd3-98e747430e6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:40:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5fa46816-2d75-4f25-bed4-b0733b606a35 req-c390fb9d-29ae-4fb5-9881-e93ca29a18ea service nova] Lock "fc2f6bf9-8d88-4e9b-afd3-98e747430e6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:40:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5fa46816-2d75-4f25-bed4-b0733b606a35 req-c390fb9d-29ae-4fb5-9881-e93ca29a18ea service nova] Lock "fc2f6bf9-8d88-4e9b-afd3-98e747430e6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:40:39 user nova-compute[74805]: DEBUG nova.compute.manager [req-5fa46816-2d75-4f25-bed4-b0733b606a35 req-c390fb9d-29ae-4fb5-9881-e93ca29a18ea service nova] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] No waiting events found dispatching network-vif-plugged-e0bd84d5-354d-4e71-a2d9-a1ce442dc1df {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:40:39 user nova-compute[74805]: WARNING nova.compute.manager [req-5fa46816-2d75-4f25-bed4-b0733b606a35 req-c390fb9d-29ae-4fb5-9881-e93ca29a18ea service nova] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Received unexpected event network-vif-plugged-e0bd84d5-354d-4e71-a2d9-a1ce442dc1df for instance with vm_state building and task_state spawning.
Nov 15 04:40:39 user nova-compute[74805]: INFO nova.compute.manager [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Took 10.51 seconds to build instance.
Nov 15 04:40:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-868d1edb-7506-4c3c-b908-f3612d988476 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "fc2f6bf9-8d88-4e9b-afd3-98e747430e6c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.615s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:40:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:43 user nova-compute[74805]: INFO nova.compute.manager [None req-5de76973-7a43-4063-a9de-c5818ad834a1 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Unrescuing
Nov 15 04:40:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5de76973-7a43-4063-a9de-c5818ad834a1 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "refresh_cache-75731a3d-3c78-4014-a8dc-f38c3d7b3305" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:40:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5de76973-7a43-4063-a9de-c5818ad834a1 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquired lock "refresh_cache-75731a3d-3c78-4014-a8dc-f38c3d7b3305" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:40:43 user nova-compute[74805]: DEBUG nova.network.neutron [None req-5de76973-7a43-4063-a9de-c5818ad834a1 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:40:43 user nova-compute[74805]: DEBUG nova.network.neutron [None req-5de76973-7a43-4063-a9de-c5818ad834a1 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Updating instance_info_cache with network_info: [{"id": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "address": "fa:16:3e:8f:e3:f6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39aa6c19-c3", "ovs_interfaceid": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:40:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-5de76973-7a43-4063-a9de-c5818ad834a1 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Releasing lock "refresh_cache-75731a3d-3c78-4014-a8dc-f38c3d7b3305" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:40:43 user nova-compute[74805]: DEBUG nova.objects.instance [None req-5de76973-7a43-4063-a9de-c5818ad834a1 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lazy-loading 'flavor' on Instance uuid 75731a3d-3c78-4014-a8dc-f38c3d7b3305 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:40:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:43 user nova-compute[74805]: DEBUG nova.compute.manager [req-5809e17e-b57a-4fd4-bf6e-65fe909247b6 req-ed396b93-5c45-4b2e-9311-a743048110cb service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received event network-vif-unplugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:40:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5809e17e-b57a-4fd4-bf6e-65fe909247b6 req-ed396b93-5c45-4b2e-9311-a743048110cb service nova] Acquiring lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:40:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5809e17e-b57a-4fd4-bf6e-65fe909247b6 req-ed396b93-5c45-4b2e-9311-a743048110cb service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:40:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5809e17e-b57a-4fd4-bf6e-65fe909247b6 req-ed396b93-5c45-4b2e-9311-a743048110cb service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:40:43 user nova-compute[74805]: DEBUG nova.compute.manager [req-5809e17e-b57a-4fd4-bf6e-65fe909247b6 req-ed396b93-5c45-4b2e-9311-a743048110cb service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] No waiting events found dispatching network-vif-unplugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:40:43 user nova-compute[74805]: WARNING nova.compute.manager [req-5809e17e-b57a-4fd4-bf6e-65fe909247b6 req-ed396b93-5c45-4b2e-9311-a743048110cb service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received unexpected event network-vif-unplugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a for instance with vm_state rescued and task_state unrescuing.
Nov 15 04:40:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:44 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:40:44 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Instance destroyed successfully.
Nov 15 04:40:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-086f0a9a-7e77-4647-b2be-b314333b8123 req-b56f2aa9-7c7a-4989-bf72-3e40f5f40ca6 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received event network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:40:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-086f0a9a-7e77-4647-b2be-b314333b8123 req-b56f2aa9-7c7a-4989-bf72-3e40f5f40ca6 service nova] Acquiring lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:40:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-086f0a9a-7e77-4647-b2be-b314333b8123 req-b56f2aa9-7c7a-4989-bf72-3e40f5f40ca6 service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:40:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-086f0a9a-7e77-4647-b2be-b314333b8123 req-b56f2aa9-7c7a-4989-bf72-3e40f5f40ca6 service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:40:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-086f0a9a-7e77-4647-b2be-b314333b8123 req-b56f2aa9-7c7a-4989-bf72-3e40f5f40ca6 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] No waiting events found dispatching network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:40:45 user nova-compute[74805]: WARNING nova.compute.manager [req-086f0a9a-7e77-4647-b2be-b314333b8123 req-b56f2aa9-7c7a-4989-bf72-3e40f5f40ca6 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received unexpected event network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a for instance with vm_state rescued and task_state unrescuing.
Nov 15 04:40:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-086f0a9a-7e77-4647-b2be-b314333b8123 req-b56f2aa9-7c7a-4989-bf72-3e40f5f40ca6 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received event network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:40:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-086f0a9a-7e77-4647-b2be-b314333b8123 req-b56f2aa9-7c7a-4989-bf72-3e40f5f40ca6 service nova] Acquiring lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:40:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-086f0a9a-7e77-4647-b2be-b314333b8123 req-b56f2aa9-7c7a-4989-bf72-3e40f5f40ca6 service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:40:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-086f0a9a-7e77-4647-b2be-b314333b8123 req-b56f2aa9-7c7a-4989-bf72-3e40f5f40ca6 service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:40:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-086f0a9a-7e77-4647-b2be-b314333b8123 req-b56f2aa9-7c7a-4989-bf72-3e40f5f40ca6 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] No waiting events found dispatching network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:40:45 user nova-compute[74805]: WARNING nova.compute.manager [req-086f0a9a-7e77-4647-b2be-b314333b8123 req-b56f2aa9-7c7a-4989-bf72-3e40f5f40ca6 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received unexpected event network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a for instance with vm_state rescued and task_state unrescuing.
Nov 15 04:40:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-086f0a9a-7e77-4647-b2be-b314333b8123 req-b56f2aa9-7c7a-4989-bf72-3e40f5f40ca6 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received event network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:40:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-086f0a9a-7e77-4647-b2be-b314333b8123 req-b56f2aa9-7c7a-4989-bf72-3e40f5f40ca6 service nova] Acquiring lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:40:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-086f0a9a-7e77-4647-b2be-b314333b8123 req-b56f2aa9-7c7a-4989-bf72-3e40f5f40ca6 service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:40:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-086f0a9a-7e77-4647-b2be-b314333b8123 req-b56f2aa9-7c7a-4989-bf72-3e40f5f40ca6 service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:40:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-086f0a9a-7e77-4647-b2be-b314333b8123 req-b56f2aa9-7c7a-4989-bf72-3e40f5f40ca6 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] No waiting events found dispatching network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:40:45 user nova-compute[74805]: WARNING nova.compute.manager [req-086f0a9a-7e77-4647-b2be-b314333b8123 req-b56f2aa9-7c7a-4989-bf72-3e40f5f40ca6 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received unexpected event network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a for instance with vm_state rescued and task_state unrescuing.
Nov 15 04:40:47 user nova-compute[74805]: DEBUG nova.compute.manager [None req-5de76973-7a43-4063-a9de-c5818ad834a1 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:40:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:55 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:40:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:40:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:41:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:41:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:41:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:41:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:41:06 user nova-compute[74805]: DEBUG nova.compute.manager [req-21eb959e-a9db-416c-9835-96e882251a1a req-ec689061-d8df-44f8-8305-4d2252a15393 service nova] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Received event network-changed-e8efc40e-9156-4814-903d-0226be4bc489 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:41:06 user nova-compute[74805]: DEBUG nova.compute.manager [req-21eb959e-a9db-416c-9835-96e882251a1a req-ec689061-d8df-44f8-8305-4d2252a15393 service nova] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Refreshing instance network info cache due to event network-changed-e8efc40e-9156-4814-903d-0226be4bc489. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:41:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-21eb959e-a9db-416c-9835-96e882251a1a req-ec689061-d8df-44f8-8305-4d2252a15393 service nova] Acquiring lock "refresh_cache-824f863d-192f-4339-9f7f-95ca57ebc9c1" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:41:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-21eb959e-a9db-416c-9835-96e882251a1a req-ec689061-d8df-44f8-8305-4d2252a15393 service nova] Acquired lock "refresh_cache-824f863d-192f-4339-9f7f-95ca57ebc9c1" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:41:06 user nova-compute[74805]: DEBUG nova.network.neutron [req-21eb959e-a9db-416c-9835-96e882251a1a req-ec689061-d8df-44f8-8305-4d2252a15393 service nova] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Refreshing network info cache for port e8efc40e-9156-4814-903d-0226be4bc489 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:41:07 user nova-compute[74805]: DEBUG nova.network.neutron [req-21eb959e-a9db-416c-9835-96e882251a1a req-ec689061-d8df-44f8-8305-4d2252a15393 service nova] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Updated VIF entry in instance network info cache for port e8efc40e-9156-4814-903d-0226be4bc489. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:41:07 user nova-compute[74805]: DEBUG nova.network.neutron [req-21eb959e-a9db-416c-9835-96e882251a1a req-ec689061-d8df-44f8-8305-4d2252a15393 service nova] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Updating instance_info_cache with network_info: [{"id": "e8efc40e-9156-4814-903d-0226be4bc489", "address": "fa:16:3e:ae:a1:94", "network": {"id": "75bd3e51-ad70-4471-8e61-f53bb210ac0f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-300432593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c2ba7eede774be18ff3afa71255c4b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efc40e-91", "ovs_interfaceid": "e8efc40e-9156-4814-903d-0226be4bc489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:41:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-21eb959e-a9db-416c-9835-96e882251a1a req-ec689061-d8df-44f8-8305-4d2252a15393 service nova] Releasing lock "refresh_cache-824f863d-192f-4339-9f7f-95ca57ebc9c1" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:41:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Acquiring lock "824f863d-192f-4339-9f7f-95ca57ebc9c1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:41:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lock "824f863d-192f-4339-9f7f-95ca57ebc9c1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:41:08 user nova-compute[74805]: DEBUG nova.objects.instance [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lazy-loading 'flavor' on Instance uuid 824f863d-192f-4339-9f7f-95ca57ebc9c1 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:41:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lock "824f863d-192f-4339-9f7f-95ca57ebc9c1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.122s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:41:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Acquiring lock "824f863d-192f-4339-9f7f-95ca57ebc9c1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:41:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lock "824f863d-192f-4339-9f7f-95ca57ebc9c1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:41:09 user nova-compute[74805]: INFO nova.compute.manager [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Attaching volume 89026aeb-9a71-4cb6-b6c1-e08662f78c08 to /dev/vdb
Nov 15 04:41:09 user nova-compute[74805]: DEBUG os_brick.utils [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:41:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5652997f-529d-4666-bca1-8edca7cbb29e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3648fa60-73b5-45f4-bcb5-9050e87560f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e8d485-f947-4dd1-a444-85997238ce86]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92ce2b6-ce95-44e9-9151-53c13db47728]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:41:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:41:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:41:09 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:41:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fdb110-f07e-412f-b266-ef6db31429e0]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:41:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:41:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:41:09 user nova-compute[74805]: DEBUG os_brick.utils [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:41:09 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Updating existing volume attachment record: 9ce9fc5a-b521-4b58-98a9-216d8c1ce5c3 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:41:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:41:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RlkSWpxB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:41:13 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:41:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:41:13 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:41:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:41:13 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c881c356-730b-4d80-acce-2de3a6f6f0d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:41:13 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e5899b-c2b8-41af-ae7e-2db5e2fb0ee8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08] added
Nov 15 04:41:13 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9e4e5f-80c1-4c67-8faa-b5d6e8ee5937]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28faf88-0ad4-4107-9c43-324f8a11f326]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RlkSWpxB {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RlkSWpxB" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c4e630-fb1d-489d-946e-832bb8a4aa29]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RlkSWpxB'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f540fb-a644-46bc-8e60-c85733a0f46b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9452ccf0-c971-42ef-90c3-2ca6f3756625]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:41:13 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:41:13 user nova-compute[74805]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)
Nov 15 04:41:13 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:41:13 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:41:13 user nova-compute[74805]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)
Nov 15 04:41:13 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c579c3a1-8727-492c-8ea7-ea8260ad72c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08, portal: 172.16.0.220,3260]
Nov 15 04:41:13 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08, portal: 172.16.0.220,3260] successful.
Nov 15 04:41:13 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71a77a1-e9a6-452e-93dc-11ed39712341]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb182e2-6c0a-4301-9655-d8c14fe4d861]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:41:13 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:41:13 user nova-compute[74805]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)
Nov 15 04:41:13 user nova-compute[74805]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08 (non-flash)
Nov 15 04:41:13 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:41:13 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:41:13 user nova-compute[74805]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)
Nov 15 04:41:13 user nova-compute[74805]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08 (non-flash)
Nov 15 04:41:13 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] HCTL ('35', '-', '-', 0) found on session 57 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcfaf81-d663-4c76-8373-6319d5076dc6]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:41:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RlkSWpxB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:41:15 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:41:15 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23731343963376330', 'path': '/dev/sdd'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:41:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731343963376330', 'path': '/dev/sdd'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:41:15 user nova-compute[74805]: DEBUG nova.objects.instance [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lazy-loading 'flavor' on Instance uuid 824f863d-192f-4339-9f7f-95ca57ebc9c1 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:41:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:41:15 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:41:15 user nova-compute[74805]:   <source dev="/dev/sdd"/>
Nov 15 04:41:15 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:41:15 user nova-compute[74805]:   <serial>89026aeb-9a71-4cb6-b6c1-e08662f78c08</serial>
Nov 15 04:41:15 user nova-compute[74805]: </disk>
Nov 15 04:41:15 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:41:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:41:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:41:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] No VIF found with MAC fa:16:3e:ae:a1:94, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:41:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:41:15 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-069a2ec0-a54b-4fc0-8262-9734f1b975e1 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lock "824f863d-192f-4339-9f7f-95ca57ebc9c1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.493s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:41:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:41:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Acquiring lock "824f863d-192f-4339-9f7f-95ca57ebc9c1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:41:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lock "824f863d-192f-4339-9f7f-95ca57ebc9c1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:41:17 user nova-compute[74805]: INFO nova.compute.manager [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Detaching volume 89026aeb-9a71-4cb6-b6c1-e08662f78c08
Nov 15 04:41:17 user nova-compute[74805]: INFO nova.virt.block_device [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Attempting to driver detach volume 89026aeb-9a71-4cb6-b6c1-e08662f78c08 from mountpoint /dev/vdb
Nov 15 04:41:17 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Attempting to detach device vdb from instance 824f863d-192f-4339-9f7f-95ca57ebc9c1 from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:41:17 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:41:17 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:41:17 user nova-compute[74805]:   <source dev="/dev/sdd"/>
Nov 15 04:41:17 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:41:17 user nova-compute[74805]:   <serial>89026aeb-9a71-4cb6-b6c1-e08662f78c08</serial>
Nov 15 04:41:17 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:41:17 user nova-compute[74805]: </disk>
Nov 15 04:41:17 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:41:17 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Successfully detached device vdb from instance 824f863d-192f-4339-9f7f-95ca57ebc9c1 from the persistent domain config.
Nov 15 04:41:17 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 824f863d-192f-4339-9f7f-95ca57ebc9c1 from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:41:17 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:41:17 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:41:17 user nova-compute[74805]:   <source dev="/dev/sdd"/>
Nov 15 04:41:17 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:41:17 user nova-compute[74805]:   <serial>89026aeb-9a71-4cb6-b6c1-e08662f78c08</serial>
Nov 15 04:41:17 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:41:17 user nova-compute[74805]: </disk>
Nov 15 04:41:17 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:41:17 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 824f863d-192f-4339-9f7f-95ca57ebc9c1 {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:41:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:41:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:41:21 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:41:21 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:41:23 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:41:25 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:41:25 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:41:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:41:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-38196606-a9c9-4604-ad21-2ec7511a8b28" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-38196606-a9c9-4604-ad21-2ec7511a8b28" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Updating instance_info_cache with network_info: [{"id": "23517101-97ec-4772-ab6b-6f626a6547bc", "address": "fa:16:3e:da:ef:08", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23517101-97", "ovs_interfaceid": "23517101-97ec-4772-ab6b-6f626a6547bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-38196606-a9c9-4604-ad21-2ec7511a8b28" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Triggering sync for uuid 9f267864-0b72-431d-9b0d-c63436002a4c {{(pid=74805) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Triggering sync for uuid 38196606-a9c9-4604-ad21-2ec7511a8b28 {{(pid=74805) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Triggering sync for uuid 288a5e5c-f8e9-4507-b29c-93e7595922ac {{(pid=74805) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Triggering sync for uuid 75731a3d-3c78-4014-a8dc-f38c3d7b3305 {{(pid=74805) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Triggering sync for uuid 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af {{(pid=74805) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Triggering sync for uuid 6ece3a65-78ba-4648-877a-861ffb4ce523 {{(pid=74805) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Triggering sync for uuid 824f863d-192f-4339-9f7f-95ca57ebc9c1 {{(pid=74805) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Triggering sync for uuid fc2f6bf9-8d88-4e9b-afd3-98e747430e6c {{(pid=74805) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "9f267864-0b72-431d-9b0d-c63436002a4c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "9f267864-0b72-431d-9b0d-c63436002a4c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "38196606-a9c9-4604-ad21-2ec7511a8b28" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "288a5e5c-f8e9-4507-b29c-93e7595922ac" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "288a5e5c-f8e9-4507-b29c-93e7595922ac" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "6ece3a65-78ba-4648-877a-861ffb4ce523" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "824f863d-192f-4339-9f7f-95ca57ebc9c1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "fc2f6bf9-8d88-4e9b-afd3-98e747430e6c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "fc2f6bf9-8d88-4e9b-afd3-98e747430e6c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "9f267864-0b72-431d-9b0d-c63436002a4c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "288a5e5c-f8e9-4507-b29c-93e7595922ac" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:41:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "fc2f6bf9-8d88-4e9b-afd3-98e747430e6c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:41:28 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:41:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:41:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:41:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:41:28 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:41:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:41:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:41:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:41:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/824f863d-192f-4339-9f7f-95ca57ebc9c1/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/824f863d-192f-4339-9f7f-95ca57ebc9c1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/824f863d-192f-4339-9f7f-95ca57ebc9c1/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:30 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/824f863d-192f-4339-9f7f-95ca57ebc9c1/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:30 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:30 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:30 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:30 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:41:30 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:41:30 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:41:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=8068MB free_disk=24.791339874267578GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:41:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:41:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:41:31 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 9f267864-0b72-431d-9b0d-c63436002a4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:41:31 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 38196606-a9c9-4604-ad21-2ec7511a8b28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:41:31 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 288a5e5c-f8e9-4507-b29c-93e7595922ac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:41:31 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 75731a3d-3c78-4014-a8dc-f38c3d7b3305 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:41:31 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:41:31 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 6ece3a65-78ba-4648-877a-861ffb4ce523 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:41:31 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 824f863d-192f-4339-9f7f-95ca57ebc9c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:41:31 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance fc2f6bf9-8d88-4e9b-afd3-98e747430e6c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:41:31 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:41:31 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:41:31 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Refreshing inventories for resource provider ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 04:41:31 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Updating ProviderTree inventory for provider ada87504-5552-4a33-b754-f9a54c67fe39 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 04:41:31 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Updating inventory in ProviderTree for provider ada87504-5552-4a33-b754-f9a54c67fe39 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 04:41:31 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Refreshing aggregate associations for resource provider ada87504-5552-4a33-b754-f9a54c67fe39, aggregates: None {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 04:41:31 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Refreshing trait associations for resource provider ada87504-5552-4a33-b754-f9a54c67fe39, traits: COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 04:41:31 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:41:31 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:41:31 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:41:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.665s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:41:33 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:41:33 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:41:33 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:41:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:41:37 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 824f863d-192f-4339-9f7f-95ca57ebc9c1 is timed out.
Nov 15 04:41:37 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Successfully detached device vdb from instance 824f863d-192f-4339-9f7f-95ca57ebc9c1 from the live domain config.
Nov 15 04:41:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:41:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RlkSWpxB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:41:37 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:41:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:41:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:41:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e452bcf0-b526-445c-b052-f9f4692f54a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:41:37 user nova-compute[74805]: No targets found.
Nov 15 04:41:37 user nova-compute[74805]: iSNS:
Nov 15 04:41:37 user nova-compute[74805]: No targets found.
Nov 15 04:41:37 user nova-compute[74805]: STATIC:
Nov 15 04:41:37 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08
Nov 15 04:41:37 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:41:37 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:41:37 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f
Nov 15 04:41:37 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:41:37 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:41:37 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea
Nov 15 04:41:37 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:41:37 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:41:37 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada
Nov 15 04:41:37 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:41:37 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:41:37 user nova-compute[74805]: FIRMWARE:
Nov 15 04:41:37 user nova-compute[74805]: No targets found.
Nov 15 04:41:37 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:41:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:41:37 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:41:37 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:41:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:41:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97db0f3-62c0-4e64-abd4-39301d9e91ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e07992-f1aa-4cf9-aba9-135c6520c053]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:41:38 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:41:38 user nova-compute[74805]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)
Nov 15 04:41:38 user nova-compute[74805]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08 (non-flash)
Nov 15 04:41:38 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:41:38 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:41:38 user nova-compute[74805]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)
Nov 15 04:41:38 user nova-compute[74805]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08 (non-flash)
Nov 15 04:41:38 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2fb4366dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08'): ({'sdd'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Removing single pathed devices sdd {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9791ab7d-2398-46a5-b959-f490371aae82]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[766b7aad-ee5d-48c9-900f-6127f76288d3]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Flushing IO for device /dev/sdd {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bf640d-a937-4ee5-bf1d-88d453dd4569]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c370ef35-ce4c-4ee6-aa59-20f312bc9007]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] SCSI volumes sdd have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e49c0b0-e3cc-43b3-8f15-1f4d339ae034]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3361586-16be-4d42-b50f-e6187118f483]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08, portal: 172.16.0.220,3260]
Nov 15 04:41:38 user nova-compute[74805]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08, portal: 172.16.0.220,3260] successful.
Nov 15 04:41:38 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89026aeb-9a71-4cb6-b6c1-e08662f78c08 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f18f65-5bbd-478b-acc6-6bedad8d0f4e]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] <== disconnect_volume: return (335ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:41:38 user nova-compute[74805]: DEBUG nova.objects.instance [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lazy-loading 'flavor' on Instance uuid 824f863d-192f-4339-9f7f-95ca57ebc9c1 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:41:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3c9ae28d-7d97-4503-ab08-91a70a89dd94 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lock "824f863d-192f-4339-9f7f-95ca57ebc9c1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.650s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:41:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "824f863d-192f-4339-9f7f-95ca57ebc9c1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 11.387s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:41:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "824f863d-192f-4339-9f7f-95ca57ebc9c1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:41:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:41:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:41:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:41:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "6ece3a65-78ba-4648-877a-861ffb4ce523" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:41:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:41:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:41:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:41:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:41:49 user nova-compute[74805]: INFO nova.compute.manager [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Terminating instance
Nov 15 04:41:49 user nova-compute[74805]: DEBUG nova.compute.manager [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:41:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:41:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:41:49 user nova-compute[74805]: DEBUG nova.compute.manager [req-651c335e-1e65-4b7c-b123-e8f51ee50cbe req-a6eca4cb-bff2-450b-90e3-be213605dc07 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Received event network-vif-unplugged-b4c47025-7d95-4d09-9371-614d2b198868 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:41:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-651c335e-1e65-4b7c-b123-e8f51ee50cbe req-a6eca4cb-bff2-450b-90e3-be213605dc07 service nova] Acquiring lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:41:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-651c335e-1e65-4b7c-b123-e8f51ee50cbe req-a6eca4cb-bff2-450b-90e3-be213605dc07 service nova] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:41:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-651c335e-1e65-4b7c-b123-e8f51ee50cbe req-a6eca4cb-bff2-450b-90e3-be213605dc07 service nova] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:41:49 user nova-compute[74805]: DEBUG nova.compute.manager [req-651c335e-1e65-4b7c-b123-e8f51ee50cbe req-a6eca4cb-bff2-450b-90e3-be213605dc07 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] No waiting events found dispatching network-vif-unplugged-b4c47025-7d95-4d09-9371-614d2b198868 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:41:49 user nova-compute[74805]: DEBUG nova.compute.manager [req-651c335e-1e65-4b7c-b123-e8f51ee50cbe req-a6eca4cb-bff2-450b-90e3-be213605dc07 service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Received event network-vif-unplugged-b4c47025-7d95-4d09-9371-614d2b198868 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:41:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:41:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:41:50 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Instance destroyed successfully.
Nov 15 04:41:50 user nova-compute[74805]: DEBUG nova.objects.instance [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lazy-loading 'resources' on Instance uuid 6ece3a65-78ba-4648-877a-861ffb4ce523 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:36:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1272061911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1272061911',id=44,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:38:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d11645073d58476491d101b9f3ee4052',ramdisk_id='',reservation_id='r-b2efqm1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1297861260',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:40:03Z,user_data=None,user_id='8cba9273daa1478fa6cc8274443b4f40',uuid=6ece3a65-78ba-4648-877a-861ffb4ce523,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4c47025-7d95-4d09-9371-614d2b198868", "address": "fa:16:3e:fb:ec:0a", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c47025-7d", "ovs_interfaceid": "b4c47025-7d95-4d09-9371-614d2b198868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Converting VIF {"id": "b4c47025-7d95-4d09-9371-614d2b198868", "address": "fa:16:3e:fb:ec:0a", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c47025-7d", "ovs_interfaceid": "b4c47025-7d95-4d09-9371-614d2b198868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:ec:0a,bridge_name='br-int',has_traffic_filtering=True,id=b4c47025-7d95-4d09-9371-614d2b198868,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4c47025-7d') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG os_vif [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:ec:0a,bridge_name='br-int',has_traffic_filtering=True,id=b4c47025-7d95-4d09-9371-614d2b198868,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4c47025-7d') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4c47025-7d, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec819942-d25e-4b74-a354-666d0809dd6a) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:41:50 user nova-compute[74805]: INFO os_vif [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:ec:0a,bridge_name='br-int',has_traffic_filtering=True,id=b4c47025-7d95-4d09-9371-614d2b198868,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4c47025-7d')
Nov 15 04:41:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eUclRvSm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:41:50 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:41:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0d4206-18e1-45aa-93e3-e1f5c0659ef3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:41:50 user nova-compute[74805]: No targets found.
Nov 15 04:41:50 user nova-compute[74805]: iSNS:
Nov 15 04:41:50 user nova-compute[74805]: No targets found.
Nov 15 04:41:50 user nova-compute[74805]: STATIC:
Nov 15 04:41:50 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f
Nov 15 04:41:50 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:41:50 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:41:50 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea
Nov 15 04:41:50 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:41:50 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:41:50 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada
Nov 15 04:41:50 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:41:50 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:41:50 user nova-compute[74805]: FIRMWARE:
Nov 15 04:41:50 user nova-compute[74805]: No targets found.
Nov 15 04:41:50 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:41:50 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:41:50 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d2a07f-f1fd-4518-8eb2-7cef59b83b63]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae44b749-9285-4bb7-aa27-9d2e65fb2bcd]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:41:50 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:41:50 user nova-compute[74805]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)
Nov 15 04:41:50 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:41:50 user nova-compute[74805]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada (non-flash)
Nov 15 04:41:50 user nova-compute[74805]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)
Nov 15 04:41:50 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c71a440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada'): ({'sdb'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Removing single pathed devices sdb {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f874ddc-f445-4f73-9a3d-e5452d4ef40a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1c3361-aefb-4dbc-ad42-ed81e867cd46]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Flushing IO for device /dev/sdb {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c95e7b3-d0e7-43a3-b40f-b29e989c0ef6]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc0d975-a638-4bb8-b91f-c9f6f15fe9d0]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9c412c-7cc9-4c22-96d3-57b5928af79d]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0659aca0-b9af-4456-808c-2e8c3bc80aed]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada, portal: 172.16.0.220,3260]
Nov 15 04:41:50 user nova-compute[74805]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada, portal: 172.16.0.220,3260] successful.
Nov 15 04:41:50 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf37200c-a534-4aae-8d56-966f0f260ada -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8379d336-1aac-47f3-9f65-eb7fd7d274d2]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] <== disconnect_volume: return (296ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:41:50 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Deleting instance files /opt/stack/data/nova/instances/6ece3a65-78ba-4648-877a-861ffb4ce523_del
Nov 15 04:41:50 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Deletion of /opt/stack/data/nova/instances/6ece3a65-78ba-4648-877a-861ffb4ce523_del complete
Nov 15 04:41:50 user nova-compute[74805]: INFO nova.compute.manager [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 15 04:41:50 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:41:50 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:41:51 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:41:51 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Took 0.44 seconds to deallocate network for instance.
Nov 15 04:41:51 user nova-compute[74805]: INFO nova.compute.manager [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Took 0.77 seconds to detach 1 volumes for instance.
Nov 15 04:41:51 user nova-compute[74805]: DEBUG nova.compute.manager [req-bf9c62a2-27f6-4aae-bb69-4e1ea4fa242b req-10988a45-4af7-4693-af72-65bea9882b0f service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Received event network-vif-plugged-b4c47025-7d95-4d09-9371-614d2b198868 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:41:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bf9c62a2-27f6-4aae-bb69-4e1ea4fa242b req-10988a45-4af7-4693-af72-65bea9882b0f service nova] Acquiring lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:41:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bf9c62a2-27f6-4aae-bb69-4e1ea4fa242b req-10988a45-4af7-4693-af72-65bea9882b0f service nova] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:41:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bf9c62a2-27f6-4aae-bb69-4e1ea4fa242b req-10988a45-4af7-4693-af72-65bea9882b0f service nova] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:41:51 user nova-compute[74805]: DEBUG nova.compute.manager [req-bf9c62a2-27f6-4aae-bb69-4e1ea4fa242b req-10988a45-4af7-4693-af72-65bea9882b0f service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] No waiting events found dispatching network-vif-plugged-b4c47025-7d95-4d09-9371-614d2b198868 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:41:51 user nova-compute[74805]: WARNING nova.compute.manager [req-bf9c62a2-27f6-4aae-bb69-4e1ea4fa242b req-10988a45-4af7-4693-af72-65bea9882b0f service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Received unexpected event network-vif-plugged-b4c47025-7d95-4d09-9371-614d2b198868 for instance with vm_state active and task_state deleting.
Nov 15 04:41:51 user nova-compute[74805]: DEBUG nova.compute.manager [req-bf9c62a2-27f6-4aae-bb69-4e1ea4fa242b req-10988a45-4af7-4693-af72-65bea9882b0f service nova] [instance: 6ece3a65-78ba-4648-877a-861ffb4ce523] Received event network-vif-deleted-b4c47025-7d95-4d09-9371-614d2b198868 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:41:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:41:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:41:52 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:41:52 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:41:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:41:52 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Deleted allocations for instance 6ece3a65-78ba-4648-877a-861ffb4ce523
Nov 15 04:41:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-50d77e3f-3718-4580-bea7-a29444db5fcf tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "6ece3a65-78ba-4648-877a-861ffb4ce523" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.865s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:41:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-920e038a-e79d-4f49-b130-af60818eb516 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Acquiring lock "824f863d-192f-4339-9f7f-95ca57ebc9c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:42:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-920e038a-e79d-4f49-b130-af60818eb516 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lock "824f863d-192f-4339-9f7f-95ca57ebc9c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:42:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-920e038a-e79d-4f49-b130-af60818eb516 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Acquiring lock "824f863d-192f-4339-9f7f-95ca57ebc9c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:42:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-920e038a-e79d-4f49-b130-af60818eb516 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lock "824f863d-192f-4339-9f7f-95ca57ebc9c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:42:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-920e038a-e79d-4f49-b130-af60818eb516 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lock "824f863d-192f-4339-9f7f-95ca57ebc9c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:42:09 user nova-compute[74805]: INFO nova.compute.manager [None req-920e038a-e79d-4f49-b130-af60818eb516 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Terminating instance
Nov 15 04:42:09 user nova-compute[74805]: DEBUG nova.compute.manager [None req-920e038a-e79d-4f49-b130-af60818eb516 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:42:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:10 user nova-compute[74805]: DEBUG nova.compute.manager [req-2db126c1-4a6a-4fe6-9923-8460864cf2e5 req-f0ef0b3f-8428-43bd-ba85-06a97356189d service nova] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Received event network-vif-unplugged-e8efc40e-9156-4814-903d-0226be4bc489 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:42:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2db126c1-4a6a-4fe6-9923-8460864cf2e5 req-f0ef0b3f-8428-43bd-ba85-06a97356189d service nova] Acquiring lock "824f863d-192f-4339-9f7f-95ca57ebc9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:42:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2db126c1-4a6a-4fe6-9923-8460864cf2e5 req-f0ef0b3f-8428-43bd-ba85-06a97356189d service nova] Lock "824f863d-192f-4339-9f7f-95ca57ebc9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:42:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2db126c1-4a6a-4fe6-9923-8460864cf2e5 req-f0ef0b3f-8428-43bd-ba85-06a97356189d service nova] Lock "824f863d-192f-4339-9f7f-95ca57ebc9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:42:10 user nova-compute[74805]: DEBUG nova.compute.manager [req-2db126c1-4a6a-4fe6-9923-8460864cf2e5 req-f0ef0b3f-8428-43bd-ba85-06a97356189d service nova] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] No waiting events found dispatching network-vif-unplugged-e8efc40e-9156-4814-903d-0226be4bc489 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:42:10 user nova-compute[74805]: DEBUG nova.compute.manager [req-2db126c1-4a6a-4fe6-9923-8460864cf2e5 req-f0ef0b3f-8428-43bd-ba85-06a97356189d service nova] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Received event network-vif-unplugged-e8efc40e-9156-4814-903d-0226be4bc489 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:42:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:10 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Instance destroyed successfully.
Nov 15 04:42:10 user nova-compute[74805]: DEBUG nova.objects.instance [None req-920e038a-e79d-4f49-b130-af60818eb516 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lazy-loading 'resources' on Instance uuid 824f863d-192f-4339-9f7f-95ca57ebc9c1 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:42:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-920e038a-e79d-4f49-b130-af60818eb516 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:39:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-941657600',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-941657600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9416576',id=46,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPPi5/PfbPuyS7/M81Us8uIsiIYhG6VMC5bAGMfkCpnrWsIDtLgItCqc4MhHsnuZWtG2kRQogmf1lGejZk+nqohcia1t5yJ293EsMaeS9DrwDVigWJGK365ND3Wdid4rw==',key_name='tempest-keypair-134236616',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:39:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c2ba7eede774be18ff3afa71255c4b5',ramdisk_id='',reservation_id='r-sw9tscow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-327380662',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:39:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='023f2f5ee5e6461ab40705d667b0d0b5',uuid=824f863d-192f-4339-9f7f-95ca57ebc9c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8efc40e-9156-4814-903d-0226be4bc489", "address": "fa:16:3e:ae:a1:94", "network": {"id": "75bd3e51-ad70-4471-8e61-f53bb210ac0f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-300432593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c2ba7eede774be18ff3afa71255c4b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efc40e-91", "ovs_interfaceid": "e8efc40e-9156-4814-903d-0226be4bc489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:42:10 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-920e038a-e79d-4f49-b130-af60818eb516 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Converting VIF {"id": "e8efc40e-9156-4814-903d-0226be4bc489", "address": "fa:16:3e:ae:a1:94", "network": {"id": "75bd3e51-ad70-4471-8e61-f53bb210ac0f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-300432593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c2ba7eede774be18ff3afa71255c4b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efc40e-91", "ovs_interfaceid": "e8efc40e-9156-4814-903d-0226be4bc489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:42:10 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-920e038a-e79d-4f49-b130-af60818eb516 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:a1:94,bridge_name='br-int',has_traffic_filtering=True,id=e8efc40e-9156-4814-903d-0226be4bc489,network=Network(75bd3e51-ad70-4471-8e61-f53bb210ac0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8efc40e-91') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:42:10 user nova-compute[74805]: DEBUG os_vif [None req-920e038a-e79d-4f49-b130-af60818eb516 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:a1:94,bridge_name='br-int',has_traffic_filtering=True,id=e8efc40e-9156-4814-903d-0226be4bc489,network=Network(75bd3e51-ad70-4471-8e61-f53bb210ac0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8efc40e-91') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:42:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8efc40e-91, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:42:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:42:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60ebf9bc-25bb-48a0-93f0-8a27fb39e6d4) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:42:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:42:10 user nova-compute[74805]: INFO os_vif [None req-920e038a-e79d-4f49-b130-af60818eb516 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:a1:94,bridge_name='br-int',has_traffic_filtering=True,id=e8efc40e-9156-4814-903d-0226be4bc489,network=Network(75bd3e51-ad70-4471-8e61-f53bb210ac0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8efc40e-91')
Nov 15 04:42:10 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-920e038a-e79d-4f49-b130-af60818eb516 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Deleting instance files /opt/stack/data/nova/instances/824f863d-192f-4339-9f7f-95ca57ebc9c1_del
Nov 15 04:42:10 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-920e038a-e79d-4f49-b130-af60818eb516 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Deletion of /opt/stack/data/nova/instances/824f863d-192f-4339-9f7f-95ca57ebc9c1_del complete
Nov 15 04:42:10 user nova-compute[74805]: INFO nova.compute.manager [None req-920e038a-e79d-4f49-b130-af60818eb516 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 15 04:42:10 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-920e038a-e79d-4f49-b130-af60818eb516 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:42:10 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:42:10 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:42:11 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:42:11 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Took 0.76 seconds to deallocate network for instance.
Nov 15 04:42:11 user nova-compute[74805]: DEBUG nova.compute.manager [req-8b104cda-6837-45c2-9494-9556f6e3eb90 req-c7b7b565-7cb0-45a2-a5d5-852877667ab8 service nova] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Received event network-vif-deleted-e8efc40e-9156-4814-903d-0226be4bc489 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:42:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-920e038a-e79d-4f49-b130-af60818eb516 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:42:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-920e038a-e79d-4f49-b130-af60818eb516 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:42:11 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-920e038a-e79d-4f49-b130-af60818eb516 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:42:11 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-920e038a-e79d-4f49-b130-af60818eb516 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:42:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-920e038a-e79d-4f49-b130-af60818eb516 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:42:11 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-920e038a-e79d-4f49-b130-af60818eb516 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Deleted allocations for instance 824f863d-192f-4339-9f7f-95ca57ebc9c1
Nov 15 04:42:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-920e038a-e79d-4f49-b130-af60818eb516 tempest-TestServerVolumeAttachScenarioOldVersion-327380662 tempest-TestServerVolumeAttachScenarioOldVersion-327380662-project-member] Lock "824f863d-192f-4339-9f7f-95ca57ebc9c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.087s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:42:12 user nova-compute[74805]: DEBUG nova.compute.manager [req-e50654d7-bce2-4a45-b6a3-eab2a7158c30 req-79f8231d-2dd4-477e-b0d5-52114b3decf6 service nova] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Received event network-vif-plugged-e8efc40e-9156-4814-903d-0226be4bc489 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:42:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e50654d7-bce2-4a45-b6a3-eab2a7158c30 req-79f8231d-2dd4-477e-b0d5-52114b3decf6 service nova] Acquiring lock "824f863d-192f-4339-9f7f-95ca57ebc9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:42:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e50654d7-bce2-4a45-b6a3-eab2a7158c30 req-79f8231d-2dd4-477e-b0d5-52114b3decf6 service nova] Lock "824f863d-192f-4339-9f7f-95ca57ebc9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:42:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e50654d7-bce2-4a45-b6a3-eab2a7158c30 req-79f8231d-2dd4-477e-b0d5-52114b3decf6 service nova] Lock "824f863d-192f-4339-9f7f-95ca57ebc9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:42:12 user nova-compute[74805]: DEBUG nova.compute.manager [req-e50654d7-bce2-4a45-b6a3-eab2a7158c30 req-79f8231d-2dd4-477e-b0d5-52114b3decf6 service nova] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] No waiting events found dispatching network-vif-plugged-e8efc40e-9156-4814-903d-0226be4bc489 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:42:12 user nova-compute[74805]: WARNING nova.compute.manager [req-e50654d7-bce2-4a45-b6a3-eab2a7158c30 req-79f8231d-2dd4-477e-b0d5-52114b3decf6 service nova] [instance: 824f863d-192f-4339-9f7f-95ca57ebc9c1] Received unexpected event network-vif-plugged-e8efc40e-9156-4814-903d-0226be4bc489 for instance with vm_state deleted and task_state None.
Nov 15 04:42:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:19 user nova-compute[74805]: DEBUG nova.compute.manager [req-7d6e56d5-a64b-4450-ad51-6bfd476632c0 req-603d0f65-df94-4c85-b91f-ebedb5acaa31 service nova] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Received event network-changed-e0bd84d5-354d-4e71-a2d9-a1ce442dc1df {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:42:19 user nova-compute[74805]: DEBUG nova.compute.manager [req-7d6e56d5-a64b-4450-ad51-6bfd476632c0 req-603d0f65-df94-4c85-b91f-ebedb5acaa31 service nova] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Refreshing instance network info cache due to event network-changed-e0bd84d5-354d-4e71-a2d9-a1ce442dc1df. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:42:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7d6e56d5-a64b-4450-ad51-6bfd476632c0 req-603d0f65-df94-4c85-b91f-ebedb5acaa31 service nova] Acquiring lock "refresh_cache-fc2f6bf9-8d88-4e9b-afd3-98e747430e6c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:42:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7d6e56d5-a64b-4450-ad51-6bfd476632c0 req-603d0f65-df94-4c85-b91f-ebedb5acaa31 service nova] Acquired lock "refresh_cache-fc2f6bf9-8d88-4e9b-afd3-98e747430e6c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:42:19 user nova-compute[74805]: DEBUG nova.network.neutron [req-7d6e56d5-a64b-4450-ad51-6bfd476632c0 req-603d0f65-df94-4c85-b91f-ebedb5acaa31 service nova] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Refreshing network info cache for port e0bd84d5-354d-4e71-a2d9-a1ce442dc1df {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:42:19 user nova-compute[74805]: DEBUG nova.network.neutron [req-7d6e56d5-a64b-4450-ad51-6bfd476632c0 req-603d0f65-df94-4c85-b91f-ebedb5acaa31 service nova] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Updated VIF entry in instance network info cache for port e0bd84d5-354d-4e71-a2d9-a1ce442dc1df. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:42:19 user nova-compute[74805]: DEBUG nova.network.neutron [req-7d6e56d5-a64b-4450-ad51-6bfd476632c0 req-603d0f65-df94-4c85-b91f-ebedb5acaa31 service nova] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Updating instance_info_cache with network_info: [{"id": "e0bd84d5-354d-4e71-a2d9-a1ce442dc1df", "address": "fa:16:3e:41:71:15", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bd84d5-35", "ovs_interfaceid": "e0bd84d5-354d-4e71-a2d9-a1ce442dc1df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:42:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-7d6e56d5-a64b-4450-ad51-6bfd476632c0 req-603d0f65-df94-4c85-b91f-ebedb5acaa31 service nova] Releasing lock "refresh_cache-fc2f6bf9-8d88-4e9b-afd3-98e747430e6c" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:42:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:42:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:21 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:42:23 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:42:24 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:42:25 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:42:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:26 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:42:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "c64c5066-6594-44fd-82ec-eff57feedc0d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:42:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "c64c5066-6594-44fd-82ec-eff57feedc0d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:42:26 user nova-compute[74805]: DEBUG nova.compute.manager [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:42:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:42:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:42:26 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:42:26 user nova-compute[74805]: INFO nova.compute.claims [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Claim successful on node user
Nov 15 04:42:27 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:42:27 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:42:27 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:42:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:42:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:42:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:42:27 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:42:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:42:27 user nova-compute[74805]: DEBUG nova.network.neutron [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:42:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-288a5e5c-f8e9-4507-b29c-93e7595922ac" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:42:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-288a5e5c-f8e9-4507-b29c-93e7595922ac" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:42:27 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:42:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:42:27 user nova-compute[74805]: DEBUG nova.policy [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bd96ecd9d404779ad64456c6517591f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2744859f249a4326ab6d268319a34b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:42:27 user nova-compute[74805]: INFO nova.virt.block_device [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Booting with volume snapshot faa52b0f-76d1-45b7-9255-178af4b4819f at /dev/vda
Nov 15 04:42:27 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Updating instance_info_cache with network_info: [{"id": "e0bce47a-8a77-465f-806c-8d4e9b38ca63", "address": "fa:16:3e:23:45:c9", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bce47a-8a", "ovs_interfaceid": "e0bce47a-8a77-465f-806c-8d4e9b38ca63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:42:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-288a5e5c-f8e9-4507-b29c-93e7595922ac" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:42:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:42:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:28 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:42:28 user nova-compute[74805]: DEBUG nova.network.neutron [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Successfully created port: 211e7ebe-80a2-499b-9822-3c4619139037 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:42:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:42:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:42:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:42:28 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:42:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:42:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:42:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:42:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:28 user nova-compute[74805]: DEBUG nova.network.neutron [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Successfully updated port: 211e7ebe-80a2-499b-9822-3c4619139037 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:42:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:42:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "refresh_cache-c64c5066-6594-44fd-82ec-eff57feedc0d" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:42:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquired lock "refresh_cache-c64c5066-6594-44fd-82ec-eff57feedc0d" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:42:28 user nova-compute[74805]: DEBUG nova.network.neutron [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:42:28 user nova-compute[74805]: DEBUG nova.compute.manager [req-b1634a59-ac0e-445b-8cfa-38e273953ac4 req-8a47a01e-81a6-42d3-8b07-831cb78c5842 service nova] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Received event network-changed-211e7ebe-80a2-499b-9822-3c4619139037 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:42:28 user nova-compute[74805]: DEBUG nova.compute.manager [req-b1634a59-ac0e-445b-8cfa-38e273953ac4 req-8a47a01e-81a6-42d3-8b07-831cb78c5842 service nova] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Refreshing instance network info cache due to event network-changed-211e7ebe-80a2-499b-9822-3c4619139037. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:42:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b1634a59-ac0e-445b-8cfa-38e273953ac4 req-8a47a01e-81a6-42d3-8b07-831cb78c5842 service nova] Acquiring lock "refresh_cache-c64c5066-6594-44fd-82ec-eff57feedc0d" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:42:28 user nova-compute[74805]: DEBUG nova.network.neutron [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:42:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:42:28 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:42:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:29 user nova-compute[74805]: DEBUG nova.network.neutron [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Updating instance_info_cache with network_info: [{"id": "211e7ebe-80a2-499b-9822-3c4619139037", "address": "fa:16:3e:6b:b6:b7", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211e7ebe-80", "ovs_interfaceid": "211e7ebe-80a2-499b-9822-3c4619139037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:42:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Releasing lock "refresh_cache-c64c5066-6594-44fd-82ec-eff57feedc0d" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:42:29 user nova-compute[74805]: DEBUG nova.compute.manager [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Instance network_info: |[{"id": "211e7ebe-80a2-499b-9822-3c4619139037", "address": "fa:16:3e:6b:b6:b7", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211e7ebe-80", "ovs_interfaceid": "211e7ebe-80a2-499b-9822-3c4619139037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:42:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b1634a59-ac0e-445b-8cfa-38e273953ac4 req-8a47a01e-81a6-42d3-8b07-831cb78c5842 service nova] Acquired lock "refresh_cache-c64c5066-6594-44fd-82ec-eff57feedc0d" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:42:29 user nova-compute[74805]: DEBUG nova.network.neutron [req-b1634a59-ac0e-445b-8cfa-38e273953ac4 req-8a47a01e-81a6-42d3-8b07-831cb78c5842 service nova] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Refreshing network info cache for port 211e7ebe-80a2-499b-9822-3c4619139037 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:42:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:42:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:42:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:29 user nova-compute[74805]: DEBUG nova.network.neutron [req-b1634a59-ac0e-445b-8cfa-38e273953ac4 req-8a47a01e-81a6-42d3-8b07-831cb78c5842 service nova] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Updated VIF entry in instance network info cache for port 211e7ebe-80a2-499b-9822-3c4619139037. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:42:29 user nova-compute[74805]: DEBUG nova.network.neutron [req-b1634a59-ac0e-445b-8cfa-38e273953ac4 req-8a47a01e-81a6-42d3-8b07-831cb78c5842 service nova] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Updating instance_info_cache with network_info: [{"id": "211e7ebe-80a2-499b-9822-3c4619139037", "address": "fa:16:3e:6b:b6:b7", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211e7ebe-80", "ovs_interfaceid": "211e7ebe-80a2-499b-9822-3c4619139037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:42:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-b1634a59-ac0e-445b-8cfa-38e273953ac4 req-8a47a01e-81a6-42d3-8b07-831cb78c5842 service nova] Releasing lock "refresh_cache-c64c5066-6594-44fd-82ec-eff57feedc0d" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:42:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:42:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:42:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:42:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:30 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:42:30 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:42:30 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:42:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=8399MB free_disk=24.809757232666016GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:42:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:42:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:42:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 9f267864-0b72-431d-9b0d-c63436002a4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:42:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 38196606-a9c9-4604-ad21-2ec7511a8b28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:42:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 288a5e5c-f8e9-4507-b29c-93e7595922ac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:42:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 75731a3d-3c78-4014-a8dc-f38c3d7b3305 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:42:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:42:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance fc2f6bf9-8d88-4e9b-afd3-98e747430e6c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:42:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance c64c5066-6594-44fd-82ec-eff57feedc0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:42:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:42:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:42:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:30 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:42:30 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:42:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:42:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.415s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:42:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:32 user nova-compute[74805]: DEBUG os_brick.utils [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:42:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:42:32 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db628ee-acf4-4e90-9154-7a4a207aff3b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:42:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:42:32 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[36334fe0-d649-4d52-81c0-550d499537eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:42:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:42:33 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[035a1dd3-2c91-49d5-9301-9c7c2548a167]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:42:33 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1825e8-236d-49d8-8fe8-a88e974f1d85]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:42:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:42:33 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:42:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:42:33 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:42:33 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c029e79c-b44a-46e3-9fc0-943deb57a9ee]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:42:33 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:42:33 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:42:33 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:42:33 user nova-compute[74805]: DEBUG os_brick.utils [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:42:33 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Updating existing volume attachment record: c8406fc5-cbdc-4fa2-a3b3-09b681280276 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:42:33 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:42:34 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:42:34 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:42:35 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:42:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG nova.compute.manager [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:42:37 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Creating image(s)
Nov 15 04:42:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Did not create local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Ensure instance console log exists: /opt/stack/data/nova/instances/c64c5066-6594-44fd-82ec-eff57feedc0d/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Start _get_guest_xml network_info=[{"id": "211e7ebe-80a2-499b-9822-3c4619139037", "address": "fa:16:3e:6b:b6:b7", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211e7ebe-80", "ovs_interfaceid": "211e7ebe-80a2-499b-9822-3c4619139037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-15T04:42:22Z,direct_url=<?>,disk_format='qcow2',id=7c31a6f4-fc7c-4eff-bf57-0edf61b23cc5,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-696861397',owner='2744859f249a4326ab6d268319a34b7f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-15T04:42:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdwOBfjN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c64c5066-6594-44fd-82ec-eff57feedc0d', 'attached_at': '', 'detached_at': '', 'volume_id': 'c6ed82df-52f0-47e1-aca2-19d1e72b53dc', 'serial': 'c6ed82df-52f0-47e1-aca2-19d1e72b53dc'}, 'delete_on_termination': True, 'attachment_id': 'c8406fc5-cbdc-4fa2-a3b3-09b681280276', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:42:37 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:42:37 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:42:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-15T04:42:22Z,direct_url=<?>,disk_format='qcow2',id=7c31a6f4-fc7c-4eff-bf57-0edf61b23cc5,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-696861397',owner='2744859f249a4326ab6d268319a34b7f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-15T04:42:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdwOBfjN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:42:37 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:42:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:42:37 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:42:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:42:37 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:42:37 user nova-compute[74805]: INFO nova.compute.claims [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Claim successful on node user
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2ac7c0-ac61-4fb1-8ea9-084efdeecb59]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:42:37 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c0f2ab-592e-42f7-b869-7711d425b866]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc] added
Nov 15 04:42:37 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1dc85a1-bb35-43ae-a423-a53050b435f9]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[190adb90-9fb3-477b-9bec-0732b7330356]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KdwOBfjN {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KdwOBfjN" returned: 0 in 0.031s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2e6ef7-21ba-4117-8e03-31667ab4fa18]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KdwOBfjN'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1648cfac-81a8-4e72-b8d8-4534e47bd5c8]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[08948c6a-d00e-4841-a170-4047e496340d]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:42:37 user nova-compute[74805]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)
Nov 15 04:42:37 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:42:37 user nova-compute[74805]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)
Nov 15 04:42:37 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[293e9f7a-b18a-4387-9bd8-a030bd191ec0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc, portal: 172.16.0.220,3260]
Nov 15 04:42:37 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc, portal: 172.16.0.220,3260] successful.
Nov 15 04:42:37 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:42:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba9fd43-bc4b-4dd6-aaf6-b01a00b0613a]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f224f6e7-5f99-4ebe-9bef-fd025243deed]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:42:38 user nova-compute[74805]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)
Nov 15 04:42:38 user nova-compute[74805]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc (non-flash)
Nov 15 04:42:38 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:42:38 user nova-compute[74805]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)
Nov 15 04:42:38 user nova-compute[74805]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc (non-flash)
Nov 15 04:42:38 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cb2cb0-5c76-4cfd-83fe-c4b50c5d1143]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdwOBfjN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.374s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:42:38 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:42:38 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG nova.policy [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6da72213d3ae446088876b3a3c34f976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fc455c6c7049d79a5c64451c126d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:42:38 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Creating image(s)
Nov 15 04:42:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "/opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "/opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.166s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk 1073741824" returned: 0 in 0.052s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.187s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:42:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23339613139633662', 'path': '/dev/sdb'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339613139633662', 'path': '/dev/sdb'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:42:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-802479977',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-802479977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-802479977',id=48,image_ref='7c31a6f4-fc7c-4eff-bf57-0edf61b23cc5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBr9uMtr/vygLvW5Fi1RrYR0BALxftcdSowpTZ8MuBTskWK1ZpPi+ds/wTmIyLb3VSAcn2mitXPiY0T+dbAIcf6I3Denkd4U4ErHyl3HHzD5sb1JMtwQNWGH/hId60+iw==',key_name='tempest-keypair-1827736396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2744859f249a4326ab6d268319a34b7f',ramdisk_id='',reservation_id='r-th2e9bpn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2043506637',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2043506637-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2043506637',owner_user_name='tempest-TestVolumeBootPattern-2043506637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:42:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bd96ecd9d404779ad64456c6517591f',uuid=c64c5066-6594-44fd-82ec-eff57feedc0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "211e7ebe-80a2-499b-9822-3c4619139037", "address": "fa:16:3e:6b:b6:b7", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211e7ebe-80", "ovs_interfaceid": "211e7ebe-80a2-499b-9822-3c4619139037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converting VIF {"id": "211e7ebe-80a2-499b-9822-3c4619139037", "address": "fa:16:3e:6b:b6:b7", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211e7ebe-80", "ovs_interfaceid": "211e7ebe-80a2-499b-9822-3c4619139037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:b6:b7,bridge_name='br-int',has_traffic_filtering=True,id=211e7ebe-80a2-499b-9822-3c4619139037,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap211e7ebe-80') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG nova.objects.instance [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lazy-loading 'pci_devices' on Instance uuid c64c5066-6594-44fd-82ec-eff57feedc0d {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:42:39 user nova-compute[74805]:   <uuid>c64c5066-6594-44fd-82ec-eff57feedc0d</uuid>
Nov 15 04:42:39 user nova-compute[74805]:   <name>instance-00000030</name>
Nov 15 04:42:39 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:42:39 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:42:39 user nova-compute[74805]:   <metadata>
Nov 15 04:42:39 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:42:39 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:42:39 user nova-compute[74805]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-802479977</nova:name>
Nov 15 04:42:39 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:42:37</nova:creationTime>
Nov 15 04:42:39 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:42:39 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:42:39 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:42:39 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:42:39 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:42:39 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:42:39 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:42:39 user nova-compute[74805]:       <nova:owner>
Nov 15 04:42:39 user nova-compute[74805]:         <nova:user uuid="0bd96ecd9d404779ad64456c6517591f">tempest-TestVolumeBootPattern-2043506637-project-member</nova:user>
Nov 15 04:42:39 user nova-compute[74805]:         <nova:project uuid="2744859f249a4326ab6d268319a34b7f">tempest-TestVolumeBootPattern-2043506637</nova:project>
Nov 15 04:42:39 user nova-compute[74805]:       </nova:owner>
Nov 15 04:42:39 user nova-compute[74805]:       <nova:root type="image" uuid="7c31a6f4-fc7c-4eff-bf57-0edf61b23cc5"/>
Nov 15 04:42:39 user nova-compute[74805]:       <nova:ports>
Nov 15 04:42:39 user nova-compute[74805]:         <nova:port uuid="211e7ebe-80a2-499b-9822-3c4619139037">
Nov 15 04:42:39 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 04:42:39 user nova-compute[74805]:         </nova:port>
Nov 15 04:42:39 user nova-compute[74805]:       </nova:ports>
Nov 15 04:42:39 user nova-compute[74805]:     </nova:instance>
Nov 15 04:42:39 user nova-compute[74805]:   </metadata>
Nov 15 04:42:39 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:42:39 user nova-compute[74805]:     <system>
Nov 15 04:42:39 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:42:39 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:42:39 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:42:39 user nova-compute[74805]:       <entry name="serial">c64c5066-6594-44fd-82ec-eff57feedc0d</entry>
Nov 15 04:42:39 user nova-compute[74805]:       <entry name="uuid">c64c5066-6594-44fd-82ec-eff57feedc0d</entry>
Nov 15 04:42:39 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:42:39 user nova-compute[74805]:     </system>
Nov 15 04:42:39 user nova-compute[74805]:   </sysinfo>
Nov 15 04:42:39 user nova-compute[74805]:   <os>
Nov 15 04:42:39 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:42:39 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:42:39 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:42:39 user nova-compute[74805]:   </os>
Nov 15 04:42:39 user nova-compute[74805]:   <features>
Nov 15 04:42:39 user nova-compute[74805]:     <acpi/>
Nov 15 04:42:39 user nova-compute[74805]:     <apic/>
Nov 15 04:42:39 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:42:39 user nova-compute[74805]:   </features>
Nov 15 04:42:39 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:42:39 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:42:39 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:42:39 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:42:39 user nova-compute[74805]:   </clock>
Nov 15 04:42:39 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:42:39 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:42:39 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:42:39 user nova-compute[74805]:   </cpu>
Nov 15 04:42:39 user nova-compute[74805]:   <devices>
Nov 15 04:42:39 user nova-compute[74805]:     <disk type="block" device="disk">
Nov 15 04:42:39 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:42:39 user nova-compute[74805]:       <source dev="/dev/sdb"/>
Nov 15 04:42:39 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:42:39 user nova-compute[74805]:       <serial>c6ed82df-52f0-47e1-aca2-19d1e72b53dc</serial>
Nov 15 04:42:39 user nova-compute[74805]:     </disk>
Nov 15 04:42:39 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:42:39 user nova-compute[74805]:       <mac address="fa:16:3e:6b:b6:b7"/>
Nov 15 04:42:39 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:42:39 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:42:39 user nova-compute[74805]:       <target dev="tap211e7ebe-80"/>
Nov 15 04:42:39 user nova-compute[74805]:     </interface>
Nov 15 04:42:39 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:42:39 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/c64c5066-6594-44fd-82ec-eff57feedc0d/console.log" append="off"/>
Nov 15 04:42:39 user nova-compute[74805]:     </serial>
Nov 15 04:42:39 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:42:39 user nova-compute[74805]:     <video>
Nov 15 04:42:39 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:42:39 user nova-compute[74805]:     </video>
Nov 15 04:42:39 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:42:39 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:42:39 user nova-compute[74805]:     </rng>
Nov 15 04:42:39 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:42:39 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:42:39 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:42:39 user nova-compute[74805]:     </memballoon>
Nov 15 04:42:39 user nova-compute[74805]:   </devices>
Nov 15 04:42:39 user nova-compute[74805]: </domain>
Nov 15 04:42:39 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:42:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-802479977',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-802479977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-802479977',id=48,image_ref='7c31a6f4-fc7c-4eff-bf57-0edf61b23cc5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBr9uMtr/vygLvW5Fi1RrYR0BALxftcdSowpTZ8MuBTskWK1ZpPi+ds/wTmIyLb3VSAcn2mitXPiY0T+dbAIcf6I3Denkd4U4ErHyl3HHzD5sb1JMtwQNWGH/hId60+iw==',key_name='tempest-keypair-1827736396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2744859f249a4326ab6d268319a34b7f',ramdisk_id='',reservation_id='r-th2e9bpn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2043506637',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2043506637-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2043506637',owner_user_name='tempest-TestVolumeBootPattern-2043506637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:42:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bd96ecd9d404779ad64456c6517591f',uuid=c64c5066-6594-44fd-82ec-eff57feedc0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "211e7ebe-80a2-499b-9822-3c4619139037", "address": "fa:16:3e:6b:b6:b7", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211e7ebe-80", "ovs_interfaceid": "211e7ebe-80a2-499b-9822-3c4619139037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converting VIF {"id": "211e7ebe-80a2-499b-9822-3c4619139037", "address": "fa:16:3e:6b:b6:b7", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211e7ebe-80", "ovs_interfaceid": "211e7ebe-80a2-499b-9822-3c4619139037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:b6:b7,bridge_name='br-int',has_traffic_filtering=True,id=211e7ebe-80a2-499b-9822-3c4619139037,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap211e7ebe-80') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG os_vif [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:b6:b7,bridge_name='br-int',has_traffic_filtering=True,id=211e7ebe-80a2-499b-9822-3c4619139037,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap211e7ebe-80') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c48a9780-b04e-5009-8e32-075a486e8880', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap211e7ebe-80, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap211e7ebe-80, col_values=(('qos', UUID('c97c46c9-3d2f-4eb0-9743-84e96c9fbc3e')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap211e7ebe-80, col_values=(('external_ids', {'iface-id': '211e7ebe-80a2-499b-9822-3c4619139037', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:b6:b7', 'vm-uuid': 'c64c5066-6594-44fd-82ec-eff57feedc0d'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Cannot resize image /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Ensure instance console log exists: /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:39 user nova-compute[74805]: INFO os_vif [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:b6:b7,bridge_name='br-int',has_traffic_filtering=True,id=211e7ebe-80a2-499b-9822-3c4619139037,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap211e7ebe-80')
Nov 15 04:42:39 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Successfully created port: 375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] No VIF found with MAC fa:16:3e:6b:b6:b7, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Successfully updated port: 375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "refresh_cache-0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquired lock "refresh_cache-0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG nova.compute.manager [req-5de8e90c-0b47-4fb5-9800-5144f85ddb78 req-0a19adf1-7faa-43d4-b858-41036ffbff6f service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Received event network-changed-375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG nova.compute.manager [req-5de8e90c-0b47-4fb5-9800-5144f85ddb78 req-0a19adf1-7faa-43d4-b858-41036ffbff6f service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Refreshing instance network info cache due to event network-changed-375372d2-cb40-4701-be3c-528d0ad92cbf. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5de8e90c-0b47-4fb5-9800-5144f85ddb78 req-0a19adf1-7faa-43d4-b858-41036ffbff6f service nova] Acquiring lock "refresh_cache-0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:42:39 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Updating instance_info_cache with network_info: [{"id": "375372d2-cb40-4701-be3c-528d0ad92cbf", "address": "fa:16:3e:7f:bb:a8", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375372d2-cb", "ovs_interfaceid": "375372d2-cb40-4701-be3c-528d0ad92cbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Releasing lock "refresh_cache-0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Instance network_info: |[{"id": "375372d2-cb40-4701-be3c-528d0ad92cbf", "address": "fa:16:3e:7f:bb:a8", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375372d2-cb", "ovs_interfaceid": "375372d2-cb40-4701-be3c-528d0ad92cbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5de8e90c-0b47-4fb5-9800-5144f85ddb78 req-0a19adf1-7faa-43d4-b858-41036ffbff6f service nova] Acquired lock "refresh_cache-0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.network.neutron [req-5de8e90c-0b47-4fb5-9800-5144f85ddb78 req-0a19adf1-7faa-43d4-b858-41036ffbff6f service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Refreshing network info cache for port 375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Start _get_guest_xml network_info=[{"id": "375372d2-cb40-4701-be3c-528d0ad92cbf", "address": "fa:16:3e:7f:bb:a8", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375372d2-cb", "ovs_interfaceid": "375372d2-cb40-4701-be3c-528d0ad92cbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:42:40 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:42:40 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:42:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-110684096',display_name='tempest-ServerRescueNegativeTestJSON-server-110684096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-110684096',id=49,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAE5HhFJvy8VlNmzAMWl5yLE8KHtHwo8pYN0mzub8KKzLvnwz/uE4chZeNvhObq9OQiWhpYdTL50hYgSBIfWHvwLTHnzCowptfiEBuZgeCebgJdzx9BVq8KB7C1akdYcEA==',key_name='tempest-keypair-1055932374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66fc455c6c7049d79a5c64451c126d56',ramdisk_id='',reservation_id='r-2sky0upa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-370335706',owner_user_name='tempest-ServerRescueNegativeTestJSON-370335706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:42:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6da72213d3ae446088876b3a3c34f976',uuid=0ab0bf04-d54a-4656-85cd-a20bdbf92ba9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "375372d2-cb40-4701-be3c-528d0ad92cbf", "address": "fa:16:3e:7f:bb:a8", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375372d2-cb", "ovs_interfaceid": "375372d2-cb40-4701-be3c-528d0ad92cbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Converting VIF {"id": "375372d2-cb40-4701-be3c-528d0ad92cbf", "address": "fa:16:3e:7f:bb:a8", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375372d2-cb", "ovs_interfaceid": "375372d2-cb40-4701-be3c-528d0ad92cbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:bb:a8,bridge_name='br-int',has_traffic_filtering=True,id=375372d2-cb40-4701-be3c-528d0ad92cbf,network=Network(98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap375372d2-cb') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.objects.instance [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:42:40 user nova-compute[74805]:   <uuid>0ab0bf04-d54a-4656-85cd-a20bdbf92ba9</uuid>
Nov 15 04:42:40 user nova-compute[74805]:   <name>instance-00000031</name>
Nov 15 04:42:40 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:42:40 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:42:40 user nova-compute[74805]:   <metadata>
Nov 15 04:42:40 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:42:40 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:42:40 user nova-compute[74805]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-110684096</nova:name>
Nov 15 04:42:40 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:42:40</nova:creationTime>
Nov 15 04:42:40 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:42:40 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:42:40 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:42:40 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:42:40 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:42:40 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:42:40 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:42:40 user nova-compute[74805]:       <nova:owner>
Nov 15 04:42:40 user nova-compute[74805]:         <nova:user uuid="6da72213d3ae446088876b3a3c34f976">tempest-ServerRescueNegativeTestJSON-370335706-project-member</nova:user>
Nov 15 04:42:40 user nova-compute[74805]:         <nova:project uuid="66fc455c6c7049d79a5c64451c126d56">tempest-ServerRescueNegativeTestJSON-370335706</nova:project>
Nov 15 04:42:40 user nova-compute[74805]:       </nova:owner>
Nov 15 04:42:40 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:42:40 user nova-compute[74805]:       <nova:ports>
Nov 15 04:42:40 user nova-compute[74805]:         <nova:port uuid="375372d2-cb40-4701-be3c-528d0ad92cbf">
Nov 15 04:42:40 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 04:42:40 user nova-compute[74805]:         </nova:port>
Nov 15 04:42:40 user nova-compute[74805]:       </nova:ports>
Nov 15 04:42:40 user nova-compute[74805]:     </nova:instance>
Nov 15 04:42:40 user nova-compute[74805]:   </metadata>
Nov 15 04:42:40 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:42:40 user nova-compute[74805]:     <system>
Nov 15 04:42:40 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:42:40 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:42:40 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:42:40 user nova-compute[74805]:       <entry name="serial">0ab0bf04-d54a-4656-85cd-a20bdbf92ba9</entry>
Nov 15 04:42:40 user nova-compute[74805]:       <entry name="uuid">0ab0bf04-d54a-4656-85cd-a20bdbf92ba9</entry>
Nov 15 04:42:40 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:42:40 user nova-compute[74805]:     </system>
Nov 15 04:42:40 user nova-compute[74805]:   </sysinfo>
Nov 15 04:42:40 user nova-compute[74805]:   <os>
Nov 15 04:42:40 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:42:40 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:42:40 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:42:40 user nova-compute[74805]:   </os>
Nov 15 04:42:40 user nova-compute[74805]:   <features>
Nov 15 04:42:40 user nova-compute[74805]:     <acpi/>
Nov 15 04:42:40 user nova-compute[74805]:     <apic/>
Nov 15 04:42:40 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:42:40 user nova-compute[74805]:   </features>
Nov 15 04:42:40 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:42:40 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:42:40 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:42:40 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:42:40 user nova-compute[74805]:   </clock>
Nov 15 04:42:40 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:42:40 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:42:40 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:42:40 user nova-compute[74805]:   </cpu>
Nov 15 04:42:40 user nova-compute[74805]:   <devices>
Nov 15 04:42:40 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:42:40 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:42:40 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk"/>
Nov 15 04:42:40 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:42:40 user nova-compute[74805]:     </disk>
Nov 15 04:42:40 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:42:40 user nova-compute[74805]:       <mac address="fa:16:3e:7f:bb:a8"/>
Nov 15 04:42:40 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:42:40 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:42:40 user nova-compute[74805]:       <target dev="tap375372d2-cb"/>
Nov 15 04:42:40 user nova-compute[74805]:     </interface>
Nov 15 04:42:40 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:42:40 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/console.log" append="off"/>
Nov 15 04:42:40 user nova-compute[74805]:     </serial>
Nov 15 04:42:40 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:42:40 user nova-compute[74805]:     <video>
Nov 15 04:42:40 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:42:40 user nova-compute[74805]:     </video>
Nov 15 04:42:40 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:42:40 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:42:40 user nova-compute[74805]:     </rng>
Nov 15 04:42:40 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:42:40 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:42:40 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:42:40 user nova-compute[74805]:     </memballoon>
Nov 15 04:42:40 user nova-compute[74805]:   </devices>
Nov 15 04:42:40 user nova-compute[74805]: </domain>
Nov 15 04:42:40 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:42:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-110684096',display_name='tempest-ServerRescueNegativeTestJSON-server-110684096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-110684096',id=49,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAE5HhFJvy8VlNmzAMWl5yLE8KHtHwo8pYN0mzub8KKzLvnwz/uE4chZeNvhObq9OQiWhpYdTL50hYgSBIfWHvwLTHnzCowptfiEBuZgeCebgJdzx9BVq8KB7C1akdYcEA==',key_name='tempest-keypair-1055932374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66fc455c6c7049d79a5c64451c126d56',ramdisk_id='',reservation_id='r-2sky0upa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-370335706',owner_user_name='tempest-ServerRescueNegativeTestJSON-370335706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:42:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6da72213d3ae446088876b3a3c34f976',uuid=0ab0bf04-d54a-4656-85cd-a20bdbf92ba9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "375372d2-cb40-4701-be3c-528d0ad92cbf", "address": "fa:16:3e:7f:bb:a8", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375372d2-cb", "ovs_interfaceid": "375372d2-cb40-4701-be3c-528d0ad92cbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Converting VIF {"id": "375372d2-cb40-4701-be3c-528d0ad92cbf", "address": "fa:16:3e:7f:bb:a8", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375372d2-cb", "ovs_interfaceid": "375372d2-cb40-4701-be3c-528d0ad92cbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:bb:a8,bridge_name='br-int',has_traffic_filtering=True,id=375372d2-cb40-4701-be3c-528d0ad92cbf,network=Network(98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap375372d2-cb') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG os_vif [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:bb:a8,bridge_name='br-int',has_traffic_filtering=True,id=375372d2-cb40-4701-be3c-528d0ad92cbf,network=Network(98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap375372d2-cb') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e5e3d244-7185-579e-b234-8fef5158884a', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap375372d2-cb, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap375372d2-cb, col_values=(('qos', UUID('9b433e04-6da7-4b05-847a-2159c6364890')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap375372d2-cb, col_values=(('external_ids', {'iface-id': '375372d2-cb40-4701-be3c-528d0ad92cbf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:bb:a8', 'vm-uuid': '0ab0bf04-d54a-4656-85cd-a20bdbf92ba9'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:40 user nova-compute[74805]: INFO os_vif [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:bb:a8,bridge_name='br-int',has_traffic_filtering=True,id=375372d2-cb40-4701-be3c-528d0ad92cbf,network=Network(98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap375372d2-cb')
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] No VIF found with MAC fa:16:3e:7f:bb:a8, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d7ada54e-a243-4d4b-9494-1e4f72f3c3d4 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "288a5e5c-f8e9-4507-b29c-93e7595922ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d7ada54e-a243-4d4b-9494-1e4f72f3c3d4 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "288a5e5c-f8e9-4507-b29c-93e7595922ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d7ada54e-a243-4d4b-9494-1e4f72f3c3d4 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "288a5e5c-f8e9-4507-b29c-93e7595922ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d7ada54e-a243-4d4b-9494-1e4f72f3c3d4 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "288a5e5c-f8e9-4507-b29c-93e7595922ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d7ada54e-a243-4d4b-9494-1e4f72f3c3d4 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "288a5e5c-f8e9-4507-b29c-93e7595922ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:42:40 user nova-compute[74805]: INFO nova.compute.manager [None req-d7ada54e-a243-4d4b-9494-1e4f72f3c3d4 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Terminating instance
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d7ada54e-a243-4d4b-9494-1e4f72f3c3d4 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.compute.manager [req-226b68d8-3813-4719-9463-e5e129a60851 req-fef04064-cdd3-4276-acc9-92c82c2d914c service nova] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Received event network-vif-unplugged-e0bce47a-8a77-465f-806c-8d4e9b38ca63 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-226b68d8-3813-4719-9463-e5e129a60851 req-fef04064-cdd3-4276-acc9-92c82c2d914c service nova] Acquiring lock "288a5e5c-f8e9-4507-b29c-93e7595922ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-226b68d8-3813-4719-9463-e5e129a60851 req-fef04064-cdd3-4276-acc9-92c82c2d914c service nova] Lock "288a5e5c-f8e9-4507-b29c-93e7595922ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-226b68d8-3813-4719-9463-e5e129a60851 req-fef04064-cdd3-4276-acc9-92c82c2d914c service nova] Lock "288a5e5c-f8e9-4507-b29c-93e7595922ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.compute.manager [req-226b68d8-3813-4719-9463-e5e129a60851 req-fef04064-cdd3-4276-acc9-92c82c2d914c service nova] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] No waiting events found dispatching network-vif-unplugged-e0bce47a-8a77-465f-806c-8d4e9b38ca63 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.compute.manager [req-226b68d8-3813-4719-9463-e5e129a60851 req-fef04064-cdd3-4276-acc9-92c82c2d914c service nova] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Received event network-vif-unplugged-e0bce47a-8a77-465f-806c-8d4e9b38ca63 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.network.neutron [req-5de8e90c-0b47-4fb5-9800-5144f85ddb78 req-0a19adf1-7faa-43d4-b858-41036ffbff6f service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Updated VIF entry in instance network info cache for port 375372d2-cb40-4701-be3c-528d0ad92cbf. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.network.neutron [req-5de8e90c-0b47-4fb5-9800-5144f85ddb78 req-0a19adf1-7faa-43d4-b858-41036ffbff6f service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Updating instance_info_cache with network_info: [{"id": "375372d2-cb40-4701-be3c-528d0ad92cbf", "address": "fa:16:3e:7f:bb:a8", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375372d2-cb", "ovs_interfaceid": "375372d2-cb40-4701-be3c-528d0ad92cbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-5de8e90c-0b47-4fb5-9800-5144f85ddb78 req-0a19adf1-7faa-43d4-b858-41036ffbff6f service nova] Releasing lock "refresh_cache-0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.compute.manager [req-00ec8cdd-7026-49bd-ad5e-c408dc24d9e2 req-c4bb1efe-f9f8-4acd-97c1-0e641021b688 service nova] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Received event network-vif-plugged-211e7ebe-80a2-499b-9822-3c4619139037 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-00ec8cdd-7026-49bd-ad5e-c408dc24d9e2 req-c4bb1efe-f9f8-4acd-97c1-0e641021b688 service nova] Acquiring lock "c64c5066-6594-44fd-82ec-eff57feedc0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-00ec8cdd-7026-49bd-ad5e-c408dc24d9e2 req-c4bb1efe-f9f8-4acd-97c1-0e641021b688 service nova] Lock "c64c5066-6594-44fd-82ec-eff57feedc0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-00ec8cdd-7026-49bd-ad5e-c408dc24d9e2 req-c4bb1efe-f9f8-4acd-97c1-0e641021b688 service nova] Lock "c64c5066-6594-44fd-82ec-eff57feedc0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:42:40 user nova-compute[74805]: DEBUG nova.compute.manager [req-00ec8cdd-7026-49bd-ad5e-c408dc24d9e2 req-c4bb1efe-f9f8-4acd-97c1-0e641021b688 service nova] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] No waiting events found dispatching network-vif-plugged-211e7ebe-80a2-499b-9822-3c4619139037 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:42:40 user nova-compute[74805]: WARNING nova.compute.manager [req-00ec8cdd-7026-49bd-ad5e-c408dc24d9e2 req-c4bb1efe-f9f8-4acd-97c1-0e641021b688 service nova] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Received unexpected event network-vif-plugged-211e7ebe-80a2-499b-9822-3c4619139037 for instance with vm_state building and task_state spawning.
Nov 15 04:42:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:41 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Instance destroyed successfully.
Nov 15 04:42:41 user nova-compute[74805]: DEBUG nova.objects.instance [None req-d7ada54e-a243-4d4b-9494-1e4f72f3c3d4 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lazy-loading 'resources' on Instance uuid 288a5e5c-f8e9-4507-b29c-93e7595922ac {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:42:41 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-d7ada54e-a243-4d4b-9494-1e4f72f3c3d4 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:32:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1748075818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1748075818',id=39,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:32:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d11645073d58476491d101b9f3ee4052',ramdisk_id='',reservation_id='r-rvscidhn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1297861260',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:34:25Z,user_data=None,user_id='8cba9273daa1478fa6cc8274443b4f40',uuid=288a5e5c-f8e9-4507-b29c-93e7595922ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0bce47a-8a77-465f-806c-8d4e9b38ca63", "address": "fa:16:3e:23:45:c9", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bce47a-8a", "ovs_interfaceid": "e0bce47a-8a77-465f-806c-8d4e9b38ca63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:42:41 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-d7ada54e-a243-4d4b-9494-1e4f72f3c3d4 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Converting VIF {"id": "e0bce47a-8a77-465f-806c-8d4e9b38ca63", "address": "fa:16:3e:23:45:c9", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bce47a-8a", "ovs_interfaceid": "e0bce47a-8a77-465f-806c-8d4e9b38ca63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:42:41 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-d7ada54e-a243-4d4b-9494-1e4f72f3c3d4 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:45:c9,bridge_name='br-int',has_traffic_filtering=True,id=e0bce47a-8a77-465f-806c-8d4e9b38ca63,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0bce47a-8a') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:42:41 user nova-compute[74805]: DEBUG os_vif [None req-d7ada54e-a243-4d4b-9494-1e4f72f3c3d4 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:45:c9,bridge_name='br-int',has_traffic_filtering=True,id=e0bce47a-8a77-465f-806c-8d4e9b38ca63,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0bce47a-8a') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:42:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0bce47a-8a, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:42:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:42:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e58d72ea-cf4a-45f0-be1a-a23b8fe7a403) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:42:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:42:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:41 user nova-compute[74805]: INFO os_vif [None req-d7ada54e-a243-4d4b-9494-1e4f72f3c3d4 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:45:c9,bridge_name='br-int',has_traffic_filtering=True,id=e0bce47a-8a77-465f-806c-8d4e9b38ca63,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0bce47a-8a')
Nov 15 04:42:41 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-d7ada54e-a243-4d4b-9494-1e4f72f3c3d4 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Deleting instance files /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac_del
Nov 15 04:42:41 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-d7ada54e-a243-4d4b-9494-1e4f72f3c3d4 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Deletion of /opt/stack/data/nova/instances/288a5e5c-f8e9-4507-b29c-93e7595922ac_del complete
Nov 15 04:42:41 user nova-compute[74805]: INFO nova.compute.manager [None req-d7ada54e-a243-4d4b-9494-1e4f72f3c3d4 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Took 1.42 seconds to destroy the instance on the hypervisor.
Nov 15 04:42:41 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-d7ada54e-a243-4d4b-9494-1e4f72f3c3d4 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:42:41 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:42:41 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:42:42 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:42:42 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Took 0.38 seconds to deallocate network for instance.
Nov 15 04:42:42 user nova-compute[74805]: DEBUG nova.compute.manager [req-e8fd92c8-80d8-4efd-b511-1f776cecd232 req-fa4c8d1a-c98e-4d09-a93d-1f2d7badebc9 service nova] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Received event network-vif-deleted-e0bce47a-8a77-465f-806c-8d4e9b38ca63 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:42:42 user nova-compute[74805]: INFO nova.compute.manager [req-e8fd92c8-80d8-4efd-b511-1f776cecd232 req-fa4c8d1a-c98e-4d09-a93d-1f2d7badebc9 service nova] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Neutron deleted interface e0bce47a-8a77-465f-806c-8d4e9b38ca63; detaching it from the instance and deleting it from the info cache
Nov 15 04:42:42 user nova-compute[74805]: DEBUG nova.network.neutron [req-e8fd92c8-80d8-4efd-b511-1f776cecd232 req-fa4c8d1a-c98e-4d09-a93d-1f2d7badebc9 service nova] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:42:42 user nova-compute[74805]: DEBUG nova.compute.manager [req-e8fd92c8-80d8-4efd-b511-1f776cecd232 req-fa4c8d1a-c98e-4d09-a93d-1f2d7badebc9 service nova] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Detach interface failed, port_id=e0bce47a-8a77-465f-806c-8d4e9b38ca63, reason: Instance 288a5e5c-f8e9-4507-b29c-93e7595922ac could not be found. {{(pid=74805) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 04:42:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d7ada54e-a243-4d4b-9494-1e4f72f3c3d4 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:42:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d7ada54e-a243-4d4b-9494-1e4f72f3c3d4 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:42:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:42 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-d7ada54e-a243-4d4b-9494-1e4f72f3c3d4 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:42:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:42 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-d7ada54e-a243-4d4b-9494-1e4f72f3c3d4 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:42:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d7ada54e-a243-4d4b-9494-1e4f72f3c3d4 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:42:42 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-d7ada54e-a243-4d4b-9494-1e4f72f3c3d4 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Deleted allocations for instance 288a5e5c-f8e9-4507-b29c-93e7595922ac
Nov 15 04:42:42 user nova-compute[74805]: DEBUG nova.compute.manager [req-4609d1ac-9ec9-42ff-857f-e66020bc9336 req-702a7b44-547e-4985-886e-5d3a20ea9a7a service nova] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Received event network-vif-plugged-e0bce47a-8a77-465f-806c-8d4e9b38ca63 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:42:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-4609d1ac-9ec9-42ff-857f-e66020bc9336 req-702a7b44-547e-4985-886e-5d3a20ea9a7a service nova] Acquiring lock "288a5e5c-f8e9-4507-b29c-93e7595922ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:42:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-4609d1ac-9ec9-42ff-857f-e66020bc9336 req-702a7b44-547e-4985-886e-5d3a20ea9a7a service nova] Lock "288a5e5c-f8e9-4507-b29c-93e7595922ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:42:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-4609d1ac-9ec9-42ff-857f-e66020bc9336 req-702a7b44-547e-4985-886e-5d3a20ea9a7a service nova] Lock "288a5e5c-f8e9-4507-b29c-93e7595922ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:42:42 user nova-compute[74805]: DEBUG nova.compute.manager [req-4609d1ac-9ec9-42ff-857f-e66020bc9336 req-702a7b44-547e-4985-886e-5d3a20ea9a7a service nova] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] No waiting events found dispatching network-vif-plugged-e0bce47a-8a77-465f-806c-8d4e9b38ca63 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:42:42 user nova-compute[74805]: WARNING nova.compute.manager [req-4609d1ac-9ec9-42ff-857f-e66020bc9336 req-702a7b44-547e-4985-886e-5d3a20ea9a7a service nova] [instance: 288a5e5c-f8e9-4507-b29c-93e7595922ac] Received unexpected event network-vif-plugged-e0bce47a-8a77-465f-806c-8d4e9b38ca63 for instance with vm_state deleted and task_state None.
Nov 15 04:42:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d7ada54e-a243-4d4b-9494-1e4f72f3c3d4 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "288a5e5c-f8e9-4507-b29c-93e7595922ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.416s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:42:42 user nova-compute[74805]: DEBUG nova.compute.manager [req-f9eb408e-d8b1-45e8-8dd3-f017e6f66f4e req-01a3fee1-d6dd-4048-a9b8-f6182db670a1 service nova] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Received event network-vif-plugged-211e7ebe-80a2-499b-9822-3c4619139037 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:42:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f9eb408e-d8b1-45e8-8dd3-f017e6f66f4e req-01a3fee1-d6dd-4048-a9b8-f6182db670a1 service nova] Acquiring lock "c64c5066-6594-44fd-82ec-eff57feedc0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:42:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f9eb408e-d8b1-45e8-8dd3-f017e6f66f4e req-01a3fee1-d6dd-4048-a9b8-f6182db670a1 service nova] Lock "c64c5066-6594-44fd-82ec-eff57feedc0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:42:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f9eb408e-d8b1-45e8-8dd3-f017e6f66f4e req-01a3fee1-d6dd-4048-a9b8-f6182db670a1 service nova] Lock "c64c5066-6594-44fd-82ec-eff57feedc0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:42:42 user nova-compute[74805]: DEBUG nova.compute.manager [req-f9eb408e-d8b1-45e8-8dd3-f017e6f66f4e req-01a3fee1-d6dd-4048-a9b8-f6182db670a1 service nova] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] No waiting events found dispatching network-vif-plugged-211e7ebe-80a2-499b-9822-3c4619139037 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:42:42 user nova-compute[74805]: WARNING nova.compute.manager [req-f9eb408e-d8b1-45e8-8dd3-f017e6f66f4e req-01a3fee1-d6dd-4048-a9b8-f6182db670a1 service nova] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Received unexpected event network-vif-plugged-211e7ebe-80a2-499b-9822-3c4619139037 for instance with vm_state building and task_state spawning.
Nov 15 04:42:44 user nova-compute[74805]: DEBUG nova.compute.manager [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:42:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:42:44 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Instance spawned successfully.
Nov 15 04:42:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:42:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:42:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:42:44 user nova-compute[74805]: INFO nova.compute.manager [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Took 6.49 seconds to spawn the instance on the hypervisor.
Nov 15 04:42:44 user nova-compute[74805]: DEBUG nova.compute.manager [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:42:44 user nova-compute[74805]: DEBUG nova.compute.manager [req-0401b149-5ea7-4856-9450-adca3baa0291 req-974a7fa3-2f80-49f6-85ae-1010b850134a service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Received event network-vif-plugged-375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:42:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0401b149-5ea7-4856-9450-adca3baa0291 req-974a7fa3-2f80-49f6-85ae-1010b850134a service nova] Acquiring lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:42:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0401b149-5ea7-4856-9450-adca3baa0291 req-974a7fa3-2f80-49f6-85ae-1010b850134a service nova] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:42:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0401b149-5ea7-4856-9450-adca3baa0291 req-974a7fa3-2f80-49f6-85ae-1010b850134a service nova] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:42:44 user nova-compute[74805]: DEBUG nova.compute.manager [req-0401b149-5ea7-4856-9450-adca3baa0291 req-974a7fa3-2f80-49f6-85ae-1010b850134a service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] No waiting events found dispatching network-vif-plugged-375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:42:44 user nova-compute[74805]: WARNING nova.compute.manager [req-0401b149-5ea7-4856-9450-adca3baa0291 req-974a7fa3-2f80-49f6-85ae-1010b850134a service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Received unexpected event network-vif-plugged-375372d2-cb40-4701-be3c-528d0ad92cbf for instance with vm_state building and task_state spawning.
Nov 15 04:42:44 user nova-compute[74805]: DEBUG nova.compute.manager [req-0401b149-5ea7-4856-9450-adca3baa0291 req-974a7fa3-2f80-49f6-85ae-1010b850134a service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Received event network-vif-plugged-375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:42:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0401b149-5ea7-4856-9450-adca3baa0291 req-974a7fa3-2f80-49f6-85ae-1010b850134a service nova] Acquiring lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:42:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0401b149-5ea7-4856-9450-adca3baa0291 req-974a7fa3-2f80-49f6-85ae-1010b850134a service nova] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:42:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-0401b149-5ea7-4856-9450-adca3baa0291 req-974a7fa3-2f80-49f6-85ae-1010b850134a service nova] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:42:44 user nova-compute[74805]: DEBUG nova.compute.manager [req-0401b149-5ea7-4856-9450-adca3baa0291 req-974a7fa3-2f80-49f6-85ae-1010b850134a service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] No waiting events found dispatching network-vif-plugged-375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:42:44 user nova-compute[74805]: WARNING nova.compute.manager [req-0401b149-5ea7-4856-9450-adca3baa0291 req-974a7fa3-2f80-49f6-85ae-1010b850134a service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Received unexpected event network-vif-plugged-375372d2-cb40-4701-be3c-528d0ad92cbf for instance with vm_state building and task_state spawning.
Nov 15 04:42:44 user nova-compute[74805]: INFO nova.compute.manager [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Took 17.58 seconds to build instance.
Nov 15 04:42:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-67fd041f-f7c0-4200-aec0-e053b9e6201a tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "c64c5066-6594-44fd-82ec-eff57feedc0d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.682s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:42:44 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:42:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:42:44 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Instance spawned successfully.
Nov 15 04:42:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:42:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:42:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:42:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:42:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:42:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:42:44 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:42:44 user nova-compute[74805]: INFO nova.compute.manager [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Took 6.30 seconds to spawn the instance on the hypervisor.
Nov 15 04:42:44 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:42:44 user nova-compute[74805]: INFO nova.compute.manager [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Took 7.08 seconds to build instance.
Nov 15 04:42:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d2160105-4fda-4167-8492-9d2f68788066 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.176s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:42:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:42:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:43:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:43:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:43:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:43:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:43:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:43:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:43:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:43:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:43:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:43:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:43:21 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:43:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:43:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:43:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:43:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:43:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:43:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:43:25 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:43:25 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:43:26 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:43:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:43:27 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:43:28 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:43:28 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:43:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-75731a3d-3c78-4014-a8dc-f38c3d7b3305" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:43:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-75731a3d-3c78-4014-a8dc-f38c3d7b3305" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:43:28 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:43:28 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Updating instance_info_cache with network_info: [{"id": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "address": "fa:16:3e:8f:e3:f6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39aa6c19-c3", "ovs_interfaceid": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:43:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-75731a3d-3c78-4014-a8dc-f38c3d7b3305" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:43:28 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:43:30 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:43:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:43:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:43:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:43:30 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:43:30 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:43:30 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:43:30 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:43:30 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:43:30 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:43:30 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:43:30 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:43:30 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:43:30 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:43:30 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:43:30 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "38196606-a9c9-4604-ad21-2ec7511a8b28" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:43:31 user nova-compute[74805]: INFO nova.compute.manager [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Terminating instance
Nov 15 04:43:31 user nova-compute[74805]: DEBUG nova.compute.manager [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG nova.compute.manager [req-70ca7b70-996e-4fc9-8a44-d6a09c2530b0 req-1bb6091c-50c6-4cdd-b851-8adc1e8002b1 service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Received event network-vif-unplugged-23517101-97ec-4772-ab6b-6f626a6547bc {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-70ca7b70-996e-4fc9-8a44-d6a09c2530b0 req-1bb6091c-50c6-4cdd-b851-8adc1e8002b1 service nova] Acquiring lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-70ca7b70-996e-4fc9-8a44-d6a09c2530b0 req-1bb6091c-50c6-4cdd-b851-8adc1e8002b1 service nova] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-70ca7b70-996e-4fc9-8a44-d6a09c2530b0 req-1bb6091c-50c6-4cdd-b851-8adc1e8002b1 service nova] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG nova.compute.manager [req-70ca7b70-996e-4fc9-8a44-d6a09c2530b0 req-1bb6091c-50c6-4cdd-b851-8adc1e8002b1 service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] No waiting events found dispatching network-vif-unplugged-23517101-97ec-4772-ab6b-6f626a6547bc {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG nova.compute.manager [req-70ca7b70-996e-4fc9-8a44-d6a09c2530b0 req-1bb6091c-50c6-4cdd-b851-8adc1e8002b1 service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Received event network-vif-unplugged-23517101-97ec-4772-ab6b-6f626a6547bc for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:43:31 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Instance destroyed successfully.
Nov 15 04:43:31 user nova-compute[74805]: DEBUG nova.objects.instance [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lazy-loading 'resources' on Instance uuid 38196606-a9c9-4604-ad21-2ec7511a8b28 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:26:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-839976471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-839976471',id=33,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:28:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d11645073d58476491d101b9f3ee4052',ramdisk_id='',reservation_id='r-vt73w83j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1297861260',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:30:40Z,user_data=None,user_id='8cba9273daa1478fa6cc8274443b4f40',uuid=38196606-a9c9-4604-ad21-2ec7511a8b28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23517101-97ec-4772-ab6b-6f626a6547bc", "address": "fa:16:3e:da:ef:08", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23517101-97", "ovs_interfaceid": "23517101-97ec-4772-ab6b-6f626a6547bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Converting VIF {"id": "23517101-97ec-4772-ab6b-6f626a6547bc", "address": "fa:16:3e:da:ef:08", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23517101-97", "ovs_interfaceid": "23517101-97ec-4772-ab6b-6f626a6547bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:ef:08,bridge_name='br-int',has_traffic_filtering=True,id=23517101-97ec-4772-ab6b-6f626a6547bc,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23517101-97') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG os_vif [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:ef:08,bridge_name='br-int',has_traffic_filtering=True,id=23517101-97ec-4772-ab6b-6f626a6547bc,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23517101-97') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23517101-97, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9c2b23b7-3fb4-4ee6-8f06-50451a77fff7) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:43:31 user nova-compute[74805]: INFO os_vif [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:ef:08,bridge_name='br-int',has_traffic_filtering=True,id=23517101-97ec-4772-ab6b-6f626a6547bc,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23517101-97')
Nov 15 04:43:31 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qbpwgdVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:43:31 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:43:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3248ddb0-7337-4438-a60f-00c1d63ead04]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:43:31 user nova-compute[74805]: No targets found.
Nov 15 04:43:31 user nova-compute[74805]: iSNS:
Nov 15 04:43:31 user nova-compute[74805]: No targets found.
Nov 15 04:43:31 user nova-compute[74805]: STATIC:
Nov 15 04:43:31 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc
Nov 15 04:43:31 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:43:31 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:43:31 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f
Nov 15 04:43:31 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:43:31 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:43:31 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea
Nov 15 04:43:31 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:43:31 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:43:31 user nova-compute[74805]: FIRMWARE:
Nov 15 04:43:31 user nova-compute[74805]: No targets found.
Nov 15 04:43:31 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:43:31 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:43:31 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:43:31 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7c9032-976b-4d40-85eb-0c4d27d6cb29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[695a8b4c-3364-4170-bb82-82f80b5566c7]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:43:32 user nova-compute[74805]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)
Nov 15 04:43:32 user nova-compute[74805]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc (non-flash)
Nov 15 04:43:32 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f (non-flash)
Nov 15 04:43:32 user nova-compute[74805]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)
Nov 15 04:43:32 user nova-compute[74805]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc (non-flash)
Nov 15 04:43:32 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c766b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f'): ({'sdh'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Removing single pathed devices sdh {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[830721c3-44d9-4e04-8b05-98dc6da5fb74]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb4809c-4c24-42b8-8dcf-c6fa33ff018c]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Flushing IO for device /dev/sdh {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[daafc7a7-1b12-410c-936a-88b2ee62464f]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.047s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5781050f-e793-45ee-949b-1b600a38b6b6]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] SCSI volumes sdh have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d05b70-d799-43f1-a4cc-3644552dbeb1]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a09d7b-4230-4d48-9b07-0b9e170b05dd]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f, portal: 172.16.0.220,3260]
Nov 15 04:43:32 user nova-compute[74805]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f, portal: 172.16.0.220,3260] successful.
Nov 15 04:43:32 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf8cdd86-a2fb-4387-a1e6-0e354edafa6f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[884126f0-07d2-49a8-b6ec-603c1334ac01]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] <== disconnect_volume: return (329ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:43:32 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Deleting instance files /opt/stack/data/nova/instances/38196606-a9c9-4604-ad21-2ec7511a8b28_del
Nov 15 04:43:32 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Deletion of /opt/stack/data/nova/instances/38196606-a9c9-4604-ad21-2ec7511a8b28_del complete
Nov 15 04:43:32 user nova-compute[74805]: INFO nova.compute.manager [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Took 1.53 seconds to destroy the instance on the hypervisor.
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:43:32 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:43:32 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:43:32 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=8297MB free_disk=24.90384292602539GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 9f267864-0b72-431d-9b0d-c63436002a4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 38196606-a9c9-4604-ad21-2ec7511a8b28 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 75731a3d-3c78-4014-a8dc-f38c3d7b3305 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance fc2f6bf9-8d88-4e9b-afd3-98e747430e6c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance c64c5066-6594-44fd-82ec-eff57feedc0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:43:32 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:43:33 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:43:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.372s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:43:33 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:43:33 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Took 0.75 seconds to deallocate network for instance.
Nov 15 04:43:33 user nova-compute[74805]: DEBUG nova.compute.manager [req-09a46f97-c076-4116-bdf6-c671eb52c395 req-549129dc-934e-430c-b12d-8e9e8dc178a2 service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Received event network-vif-deleted-23517101-97ec-4772-ab6b-6f626a6547bc {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:43:33 user nova-compute[74805]: INFO nova.compute.manager [req-09a46f97-c076-4116-bdf6-c671eb52c395 req-549129dc-934e-430c-b12d-8e9e8dc178a2 service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Neutron deleted interface 23517101-97ec-4772-ab6b-6f626a6547bc; detaching it from the instance and deleting it from the info cache
Nov 15 04:43:33 user nova-compute[74805]: DEBUG nova.network.neutron [req-09a46f97-c076-4116-bdf6-c671eb52c395 req-549129dc-934e-430c-b12d-8e9e8dc178a2 service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:43:33 user nova-compute[74805]: DEBUG nova.compute.manager [req-81bfcf30-7dcf-4a50-a8c1-218042a4a132 req-c71d88eb-2fa3-4209-9bc3-af3b130329da service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Received event network-vif-plugged-23517101-97ec-4772-ab6b-6f626a6547bc {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:43:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-81bfcf30-7dcf-4a50-a8c1-218042a4a132 req-c71d88eb-2fa3-4209-9bc3-af3b130329da service nova] Acquiring lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:43:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-81bfcf30-7dcf-4a50-a8c1-218042a4a132 req-c71d88eb-2fa3-4209-9bc3-af3b130329da service nova] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:43:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-81bfcf30-7dcf-4a50-a8c1-218042a4a132 req-c71d88eb-2fa3-4209-9bc3-af3b130329da service nova] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:43:33 user nova-compute[74805]: DEBUG nova.compute.manager [req-81bfcf30-7dcf-4a50-a8c1-218042a4a132 req-c71d88eb-2fa3-4209-9bc3-af3b130329da service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] No waiting events found dispatching network-vif-plugged-23517101-97ec-4772-ab6b-6f626a6547bc {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:43:33 user nova-compute[74805]: WARNING nova.compute.manager [req-81bfcf30-7dcf-4a50-a8c1-218042a4a132 req-c71d88eb-2fa3-4209-9bc3-af3b130329da service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Received unexpected event network-vif-plugged-23517101-97ec-4772-ab6b-6f626a6547bc for instance with vm_state active and task_state deleting.
Nov 15 04:43:33 user nova-compute[74805]: DEBUG nova.compute.manager [req-09a46f97-c076-4116-bdf6-c671eb52c395 req-549129dc-934e-430c-b12d-8e9e8dc178a2 service nova] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Detach interface failed, port_id=23517101-97ec-4772-ab6b-6f626a6547bc, reason: Instance 38196606-a9c9-4604-ad21-2ec7511a8b28 could not be found. {{(pid=74805) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 04:43:34 user nova-compute[74805]: INFO nova.compute.manager [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 38196606-a9c9-4604-ad21-2ec7511a8b28] Took 0.74 seconds to detach 1 volumes for instance.
Nov 15 04:43:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:43:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:43:34 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:43:34 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:43:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:43:34 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Deleted allocations for instance 38196606-a9c9-4604-ad21-2ec7511a8b28
Nov 15 04:43:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3688dc12-9b7d-4b18-8304-bf959d4d0472 tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "38196606-a9c9-4604-ad21-2ec7511a8b28" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.530s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:43:35 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:43:36 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:43:36 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:43:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:43:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:43:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:43:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:43:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:44:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:44:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:44:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:44:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:17 user nova-compute[74805]: DEBUG nova.compute.manager [req-eccb7df1-c95b-44e6-bb96-9c080a05f9c9 req-df01528e-9fd1-4c4f-8cf9-d64c0f3d6c52 service nova] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Received event network-changed-211e7ebe-80a2-499b-9822-3c4619139037 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:44:17 user nova-compute[74805]: DEBUG nova.compute.manager [req-eccb7df1-c95b-44e6-bb96-9c080a05f9c9 req-df01528e-9fd1-4c4f-8cf9-d64c0f3d6c52 service nova] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Refreshing instance network info cache due to event network-changed-211e7ebe-80a2-499b-9822-3c4619139037. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:44:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-eccb7df1-c95b-44e6-bb96-9c080a05f9c9 req-df01528e-9fd1-4c4f-8cf9-d64c0f3d6c52 service nova] Acquiring lock "refresh_cache-c64c5066-6594-44fd-82ec-eff57feedc0d" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:44:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-eccb7df1-c95b-44e6-bb96-9c080a05f9c9 req-df01528e-9fd1-4c4f-8cf9-d64c0f3d6c52 service nova] Acquired lock "refresh_cache-c64c5066-6594-44fd-82ec-eff57feedc0d" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:44:17 user nova-compute[74805]: DEBUG nova.network.neutron [req-eccb7df1-c95b-44e6-bb96-9c080a05f9c9 req-df01528e-9fd1-4c4f-8cf9-d64c0f3d6c52 service nova] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Refreshing network info cache for port 211e7ebe-80a2-499b-9822-3c4619139037 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:44:18 user nova-compute[74805]: DEBUG nova.network.neutron [req-eccb7df1-c95b-44e6-bb96-9c080a05f9c9 req-df01528e-9fd1-4c4f-8cf9-d64c0f3d6c52 service nova] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Updated VIF entry in instance network info cache for port 211e7ebe-80a2-499b-9822-3c4619139037. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:44:18 user nova-compute[74805]: DEBUG nova.network.neutron [req-eccb7df1-c95b-44e6-bb96-9c080a05f9c9 req-df01528e-9fd1-4c4f-8cf9-d64c0f3d6c52 service nova] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Updating instance_info_cache with network_info: [{"id": "211e7ebe-80a2-499b-9822-3c4619139037", "address": "fa:16:3e:6b:b6:b7", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211e7ebe-80", "ovs_interfaceid": "211e7ebe-80a2-499b-9822-3c4619139037", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:44:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-eccb7df1-c95b-44e6-bb96-9c080a05f9c9 req-df01528e-9fd1-4c4f-8cf9-d64c0f3d6c52 service nova] Releasing lock "refresh_cache-c64c5066-6594-44fd-82ec-eff57feedc0d" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:44:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "c64c5066-6594-44fd-82ec-eff57feedc0d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:44:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "c64c5066-6594-44fd-82ec-eff57feedc0d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:44:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "c64c5066-6594-44fd-82ec-eff57feedc0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:44:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "c64c5066-6594-44fd-82ec-eff57feedc0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:44:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "c64c5066-6594-44fd-82ec-eff57feedc0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:44:18 user nova-compute[74805]: INFO nova.compute.manager [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Terminating instance
Nov 15 04:44:18 user nova-compute[74805]: DEBUG nova.compute.manager [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:44:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:18 user nova-compute[74805]: DEBUG nova.compute.manager [req-dc875f6a-cc12-4f59-ad5f-f393b2d58550 req-fd605cd0-ebdf-489a-92a6-a83298a2eec2 service nova] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Received event network-vif-unplugged-211e7ebe-80a2-499b-9822-3c4619139037 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:44:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-dc875f6a-cc12-4f59-ad5f-f393b2d58550 req-fd605cd0-ebdf-489a-92a6-a83298a2eec2 service nova] Acquiring lock "c64c5066-6594-44fd-82ec-eff57feedc0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:44:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-dc875f6a-cc12-4f59-ad5f-f393b2d58550 req-fd605cd0-ebdf-489a-92a6-a83298a2eec2 service nova] Lock "c64c5066-6594-44fd-82ec-eff57feedc0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:44:18 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-dc875f6a-cc12-4f59-ad5f-f393b2d58550 req-fd605cd0-ebdf-489a-92a6-a83298a2eec2 service nova] Lock "c64c5066-6594-44fd-82ec-eff57feedc0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:44:18 user nova-compute[74805]: DEBUG nova.compute.manager [req-dc875f6a-cc12-4f59-ad5f-f393b2d58550 req-fd605cd0-ebdf-489a-92a6-a83298a2eec2 service nova] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] No waiting events found dispatching network-vif-unplugged-211e7ebe-80a2-499b-9822-3c4619139037 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:44:18 user nova-compute[74805]: DEBUG nova.compute.manager [req-dc875f6a-cc12-4f59-ad5f-f393b2d58550 req-fd605cd0-ebdf-489a-92a6-a83298a2eec2 service nova] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Received event network-vif-unplugged-211e7ebe-80a2-499b-9822-3c4619139037 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:44:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:19 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Instance destroyed successfully.
Nov 15 04:44:19 user nova-compute[74805]: DEBUG nova.objects.instance [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lazy-loading 'resources' on Instance uuid c64c5066-6594-44fd-82ec-eff57feedc0d {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:42:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-802479977',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-802479977',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-802479977',id=48,image_ref='7c31a6f4-fc7c-4eff-bf57-0edf61b23cc5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBr9uMtr/vygLvW5Fi1RrYR0BALxftcdSowpTZ8MuBTskWK1ZpPi+ds/wTmIyLb3VSAcn2mitXPiY0T+dbAIcf6I3Denkd4U4ErHyl3HHzD5sb1JMtwQNWGH/hId60+iw==',key_name='tempest-keypair-1827736396',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:42:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2744859f249a4326ab6d268319a34b7f',ramdisk_id='',reservation_id='r-th2e9bpn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2043506637',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2043506637-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-2043506637',owner_user_name='tempest-TestVolumeBootPattern-2043506637-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:42:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bd96ecd9d404779ad64456c6517591f',uuid=c64c5066-6594-44fd-82ec-eff57feedc0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "211e7ebe-80a2-499b-9822-3c4619139037", "address": "fa:16:3e:6b:b6:b7", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211e7ebe-80", "ovs_interfaceid": "211e7ebe-80a2-499b-9822-3c4619139037", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converting VIF {"id": "211e7ebe-80a2-499b-9822-3c4619139037", "address": "fa:16:3e:6b:b6:b7", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211e7ebe-80", "ovs_interfaceid": "211e7ebe-80a2-499b-9822-3c4619139037", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:b6:b7,bridge_name='br-int',has_traffic_filtering=True,id=211e7ebe-80a2-499b-9822-3c4619139037,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap211e7ebe-80') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG os_vif [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:b6:b7,bridge_name='br-int',has_traffic_filtering=True,id=211e7ebe-80a2-499b-9822-3c4619139037,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap211e7ebe-80') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap211e7ebe-80, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c97c46c9-3d2f-4eb0-9743-84e96c9fbc3e) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:44:19 user nova-compute[74805]: INFO os_vif [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:b6:b7,bridge_name='br-int',has_traffic_filtering=True,id=211e7ebe-80a2-499b-9822-3c4619139037,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap211e7ebe-80')
Nov 15 04:44:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdwOBfjN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:44:19 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:44:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[26247ebd-189c-4dc7-a200-b68cc893dd7c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:44:19 user nova-compute[74805]: No targets found.
Nov 15 04:44:19 user nova-compute[74805]: iSNS:
Nov 15 04:44:19 user nova-compute[74805]: No targets found.
Nov 15 04:44:19 user nova-compute[74805]: STATIC:
Nov 15 04:44:19 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc
Nov 15 04:44:19 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:44:19 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:44:19 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea
Nov 15 04:44:19 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:44:19 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:44:19 user nova-compute[74805]: FIRMWARE:
Nov 15 04:44:19 user nova-compute[74805]: No targets found.
Nov 15 04:44:19 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:44:19 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:44:19 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc0c548-64d2-44fb-89b4-c67dfc6055d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0da988a-ca66-44a0-8185-14af2ec3191e]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)
Nov 15 04:44:19 user nova-compute[74805]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc (non-flash)
Nov 15 04:44:19 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)
Nov 15 04:44:19 user nova-compute[74805]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc (non-flash)
Nov 15 04:44:19 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c673c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc'): ({'sdb'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Removing single pathed devices sdb {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[79430163-bbea-4e0f-a604-4e19f01ebe03]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c7cf3a-607a-4f69-8c0b-f0d6511dcef7]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Flushing IO for device /dev/sdb {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff2516e-ac7a-490e-8acc-8c994812f8aa]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c771ab61-db77-4c67-87e5-d4cf6ddd677e]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_a6be652b', '/dev/disk/by-id/scsi-23339613139633662', '/dev/disk/by-id/scsi-1SCST_BIOa6be652b-39a19c6be4aeaae8') {{(pid=85029) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3f1060-87c0-446a-9b67-804290a882de]: (4, None) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dea3810-dba2-488e-a122-b2a82b7166c5]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f12312d-dab3-44cc-8357-4acf69d3150d]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc, portal: 172.16.0.220,3260]
Nov 15 04:44:19 user nova-compute[74805]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc, portal: 172.16.0.220,3260] successful.
Nov 15 04:44:19 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6ed82df-52f0-47e1-aca2-19d1e72b53dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbd33fb-e857-4486-acde-30c7d12e8ea7]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] <== disconnect_volume: return (344ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:44:19 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Deleting instance files /opt/stack/data/nova/instances/c64c5066-6594-44fd-82ec-eff57feedc0d_del
Nov 15 04:44:19 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Deletion of /opt/stack/data/nova/instances/c64c5066-6594-44fd-82ec-eff57feedc0d_del complete
Nov 15 04:44:19 user nova-compute[74805]: INFO nova.compute.manager [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 15 04:44:19 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:44:19 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:44:20 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:44:20 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Took 1.08 seconds to deallocate network for instance.
Nov 15 04:44:20 user nova-compute[74805]: DEBUG nova.compute.manager [req-19c8e211-77c4-40fd-9959-4c4a5ff35d3a req-cb51c346-3789-468e-9c5f-3f1a191b088d service nova] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Received event network-vif-plugged-211e7ebe-80a2-499b-9822-3c4619139037 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:44:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-19c8e211-77c4-40fd-9959-4c4a5ff35d3a req-cb51c346-3789-468e-9c5f-3f1a191b088d service nova] Acquiring lock "c64c5066-6594-44fd-82ec-eff57feedc0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:44:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-19c8e211-77c4-40fd-9959-4c4a5ff35d3a req-cb51c346-3789-468e-9c5f-3f1a191b088d service nova] Lock "c64c5066-6594-44fd-82ec-eff57feedc0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:44:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-19c8e211-77c4-40fd-9959-4c4a5ff35d3a req-cb51c346-3789-468e-9c5f-3f1a191b088d service nova] Lock "c64c5066-6594-44fd-82ec-eff57feedc0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:44:20 user nova-compute[74805]: DEBUG nova.compute.manager [req-19c8e211-77c4-40fd-9959-4c4a5ff35d3a req-cb51c346-3789-468e-9c5f-3f1a191b088d service nova] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] No waiting events found dispatching network-vif-plugged-211e7ebe-80a2-499b-9822-3c4619139037 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:44:20 user nova-compute[74805]: WARNING nova.compute.manager [req-19c8e211-77c4-40fd-9959-4c4a5ff35d3a req-cb51c346-3789-468e-9c5f-3f1a191b088d service nova] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Received unexpected event network-vif-plugged-211e7ebe-80a2-499b-9822-3c4619139037 for instance with vm_state active and task_state deleting.
Nov 15 04:44:20 user nova-compute[74805]: DEBUG nova.compute.manager [req-94143ca1-7399-4771-af58-b2ac83ebf077 req-053d0098-bd79-4df7-91ca-3eb1ff5df1b0 service nova] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Received event network-vif-deleted-211e7ebe-80a2-499b-9822-3c4619139037 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:44:20 user nova-compute[74805]: INFO nova.compute.manager [req-94143ca1-7399-4771-af58-b2ac83ebf077 req-053d0098-bd79-4df7-91ca-3eb1ff5df1b0 service nova] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Neutron deleted interface 211e7ebe-80a2-499b-9822-3c4619139037; detaching it from the instance and deleting it from the info cache
Nov 15 04:44:20 user nova-compute[74805]: DEBUG nova.network.neutron [req-94143ca1-7399-4771-af58-b2ac83ebf077 req-053d0098-bd79-4df7-91ca-3eb1ff5df1b0 service nova] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:44:20 user nova-compute[74805]: DEBUG nova.compute.manager [req-94143ca1-7399-4771-af58-b2ac83ebf077 req-053d0098-bd79-4df7-91ca-3eb1ff5df1b0 service nova] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Detach interface failed, port_id=211e7ebe-80a2-499b-9822-3c4619139037, reason: Instance c64c5066-6594-44fd-82ec-eff57feedc0d could not be found. {{(pid=74805) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 04:44:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:21 user nova-compute[74805]: INFO nova.compute.manager [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Took 0.84 seconds to detach 1 volumes for instance.
Nov 15 04:44:21 user nova-compute[74805]: DEBUG nova.compute.manager [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: c64c5066-6594-44fd-82ec-eff57feedc0d] Deleting volume: c6ed82df-52f0-47e1-aca2-19d1e72b53dc {{(pid=74805) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 04:44:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:44:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:44:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2f65e2ac-84ca-4333-82e6-e0eca380a20a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "9f267864-0b72-431d-9b0d-c63436002a4c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:44:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2f65e2ac-84ca-4333-82e6-e0eca380a20a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "9f267864-0b72-431d-9b0d-c63436002a4c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:44:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2f65e2ac-84ca-4333-82e6-e0eca380a20a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "9f267864-0b72-431d-9b0d-c63436002a4c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:44:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2f65e2ac-84ca-4333-82e6-e0eca380a20a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "9f267864-0b72-431d-9b0d-c63436002a4c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:44:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2f65e2ac-84ca-4333-82e6-e0eca380a20a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "9f267864-0b72-431d-9b0d-c63436002a4c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:44:21 user nova-compute[74805]: INFO nova.compute.manager [None req-2f65e2ac-84ca-4333-82e6-e0eca380a20a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Terminating instance
Nov 15 04:44:21 user nova-compute[74805]: DEBUG nova.compute.manager [None req-2f65e2ac-84ca-4333-82e6-e0eca380a20a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:44:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:21 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:44:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:21 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:44:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:44:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:22 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Deleted allocations for instance c64c5066-6594-44fd-82ec-eff57feedc0d
Nov 15 04:44:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3a86f7b1-3c80-41af-85ec-294bd89b28cf tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "c64c5066-6594-44fd-82ec-eff57feedc0d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.621s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:22 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Instance destroyed successfully.
Nov 15 04:44:22 user nova-compute[74805]: DEBUG nova.objects.instance [None req-2f65e2ac-84ca-4333-82e6-e0eca380a20a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lazy-loading 'resources' on Instance uuid 9f267864-0b72-431d-9b0d-c63436002a4c {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-2f65e2ac-84ca-4333-82e6-e0eca380a20a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1546015785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1546015785',id=27,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:24:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d11645073d58476491d101b9f3ee4052',ramdisk_id='',reservation_id='r-7nc6syzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1297861260',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:25:51Z,user_data=None,user_id='8cba9273daa1478fa6cc8274443b4f40',uuid=9f267864-0b72-431d-9b0d-c63436002a4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd5458e6-03d9-4fab-bbfb-23989a82c193", "address": "fa:16:3e:86:87:bc", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5458e6-03", "ovs_interfaceid": "bd5458e6-03d9-4fab-bbfb-23989a82c193", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-2f65e2ac-84ca-4333-82e6-e0eca380a20a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Converting VIF {"id": "bd5458e6-03d9-4fab-bbfb-23989a82c193", "address": "fa:16:3e:86:87:bc", "network": {"id": "9c781567-dfc1-47d8-b3c9-1c3071b907cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-583957231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d11645073d58476491d101b9f3ee4052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5458e6-03", "ovs_interfaceid": "bd5458e6-03d9-4fab-bbfb-23989a82c193", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-2f65e2ac-84ca-4333-82e6-e0eca380a20a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:87:bc,bridge_name='br-int',has_traffic_filtering=True,id=bd5458e6-03d9-4fab-bbfb-23989a82c193,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd5458e6-03') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG os_vif [None req-2f65e2ac-84ca-4333-82e6-e0eca380a20a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:87:bc,bridge_name='br-int',has_traffic_filtering=True,id=bd5458e6-03d9-4fab-bbfb-23989a82c193,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd5458e6-03') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd5458e6-03, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3e3b8458-270c-4f49-8e01-34caf7c1b665) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:22 user nova-compute[74805]: INFO os_vif [None req-2f65e2ac-84ca-4333-82e6-e0eca380a20a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:87:bc,bridge_name='br-int',has_traffic_filtering=True,id=bd5458e6-03d9-4fab-bbfb-23989a82c193,network=Network(9c781567-dfc1-47d8-b3c9-1c3071b907cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd5458e6-03')
Nov 15 04:44:22 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-2f65e2ac-84ca-4333-82e6-e0eca380a20a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Deleting instance files /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c_del
Nov 15 04:44:22 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-2f65e2ac-84ca-4333-82e6-e0eca380a20a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Deletion of /opt/stack/data/nova/instances/9f267864-0b72-431d-9b0d-c63436002a4c_del complete
Nov 15 04:44:22 user nova-compute[74805]: INFO nova.compute.manager [None req-2f65e2ac-84ca-4333-82e6-e0eca380a20a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 15 04:44:22 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-2f65e2ac-84ca-4333-82e6-e0eca380a20a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-01c7263c-c9bb-45ab-9426-cf2264f2aaed req-1f1cc139-babd-4f0b-9ad0-9b6c020c6c55 service nova] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Received event network-vif-unplugged-bd5458e6-03d9-4fab-bbfb-23989a82c193 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-01c7263c-c9bb-45ab-9426-cf2264f2aaed req-1f1cc139-babd-4f0b-9ad0-9b6c020c6c55 service nova] Acquiring lock "9f267864-0b72-431d-9b0d-c63436002a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-01c7263c-c9bb-45ab-9426-cf2264f2aaed req-1f1cc139-babd-4f0b-9ad0-9b6c020c6c55 service nova] Lock "9f267864-0b72-431d-9b0d-c63436002a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-01c7263c-c9bb-45ab-9426-cf2264f2aaed req-1f1cc139-babd-4f0b-9ad0-9b6c020c6c55 service nova] Lock "9f267864-0b72-431d-9b0d-c63436002a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-01c7263c-c9bb-45ab-9426-cf2264f2aaed req-1f1cc139-babd-4f0b-9ad0-9b6c020c6c55 service nova] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] No waiting events found dispatching network-vif-unplugged-bd5458e6-03d9-4fab-bbfb-23989a82c193 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-01c7263c-c9bb-45ab-9426-cf2264f2aaed req-1f1cc139-babd-4f0b-9ad0-9b6c020c6c55 service nova] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Received event network-vif-unplugged-bd5458e6-03d9-4fab-bbfb-23989a82c193 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-01c7263c-c9bb-45ab-9426-cf2264f2aaed req-1f1cc139-babd-4f0b-9ad0-9b6c020c6c55 service nova] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Received event network-vif-plugged-bd5458e6-03d9-4fab-bbfb-23989a82c193 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-01c7263c-c9bb-45ab-9426-cf2264f2aaed req-1f1cc139-babd-4f0b-9ad0-9b6c020c6c55 service nova] Acquiring lock "9f267864-0b72-431d-9b0d-c63436002a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-01c7263c-c9bb-45ab-9426-cf2264f2aaed req-1f1cc139-babd-4f0b-9ad0-9b6c020c6c55 service nova] Lock "9f267864-0b72-431d-9b0d-c63436002a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-01c7263c-c9bb-45ab-9426-cf2264f2aaed req-1f1cc139-babd-4f0b-9ad0-9b6c020c6c55 service nova] Lock "9f267864-0b72-431d-9b0d-c63436002a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-01c7263c-c9bb-45ab-9426-cf2264f2aaed req-1f1cc139-babd-4f0b-9ad0-9b6c020c6c55 service nova] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] No waiting events found dispatching network-vif-plugged-bd5458e6-03d9-4fab-bbfb-23989a82c193 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:44:22 user nova-compute[74805]: WARNING nova.compute.manager [req-01c7263c-c9bb-45ab-9426-cf2264f2aaed req-1f1cc139-babd-4f0b-9ad0-9b6c020c6c55 service nova] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Received unexpected event network-vif-plugged-bd5458e6-03d9-4fab-bbfb-23989a82c193 for instance with vm_state active and task_state deleting.
Nov 15 04:44:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-01c7263c-c9bb-45ab-9426-cf2264f2aaed req-1f1cc139-babd-4f0b-9ad0-9b6c020c6c55 service nova] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Received event network-vif-plugged-bd5458e6-03d9-4fab-bbfb-23989a82c193 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-01c7263c-c9bb-45ab-9426-cf2264f2aaed req-1f1cc139-babd-4f0b-9ad0-9b6c020c6c55 service nova] Acquiring lock "9f267864-0b72-431d-9b0d-c63436002a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-01c7263c-c9bb-45ab-9426-cf2264f2aaed req-1f1cc139-babd-4f0b-9ad0-9b6c020c6c55 service nova] Lock "9f267864-0b72-431d-9b0d-c63436002a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-01c7263c-c9bb-45ab-9426-cf2264f2aaed req-1f1cc139-babd-4f0b-9ad0-9b6c020c6c55 service nova] Lock "9f267864-0b72-431d-9b0d-c63436002a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:44:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-01c7263c-c9bb-45ab-9426-cf2264f2aaed req-1f1cc139-babd-4f0b-9ad0-9b6c020c6c55 service nova] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] No waiting events found dispatching network-vif-plugged-bd5458e6-03d9-4fab-bbfb-23989a82c193 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:44:22 user nova-compute[74805]: WARNING nova.compute.manager [req-01c7263c-c9bb-45ab-9426-cf2264f2aaed req-1f1cc139-babd-4f0b-9ad0-9b6c020c6c55 service nova] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Received unexpected event network-vif-plugged-bd5458e6-03d9-4fab-bbfb-23989a82c193 for instance with vm_state active and task_state deleting.
Nov 15 04:44:23 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:44:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:23 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:44:23 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Took 0.65 seconds to deallocate network for instance.
Nov 15 04:44:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2f65e2ac-84ca-4333-82e6-e0eca380a20a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:44:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2f65e2ac-84ca-4333-82e6-e0eca380a20a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:44:23 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-2f65e2ac-84ca-4333-82e6-e0eca380a20a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:44:23 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-2f65e2ac-84ca-4333-82e6-e0eca380a20a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:44:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2f65e2ac-84ca-4333-82e6-e0eca380a20a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:44:23 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-2f65e2ac-84ca-4333-82e6-e0eca380a20a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Deleted allocations for instance 9f267864-0b72-431d-9b0d-c63436002a4c
Nov 15 04:44:23 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-2f65e2ac-84ca-4333-82e6-e0eca380a20a tempest-ServerBootFromVolumeStableRescueTest-1297861260 tempest-ServerBootFromVolumeStableRescueTest-1297861260-project-member] Lock "9f267864-0b72-431d-9b0d-c63436002a4c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.996s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:44:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-ccbe8261-ce60-404e-b58c-9b837a2f0dcb req-3747a2aa-83cf-4de1-b6ed-cd335bd09150 service nova] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Received event network-vif-plugged-bd5458e6-03d9-4fab-bbfb-23989a82c193 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:44:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ccbe8261-ce60-404e-b58c-9b837a2f0dcb req-3747a2aa-83cf-4de1-b6ed-cd335bd09150 service nova] Acquiring lock "9f267864-0b72-431d-9b0d-c63436002a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:44:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ccbe8261-ce60-404e-b58c-9b837a2f0dcb req-3747a2aa-83cf-4de1-b6ed-cd335bd09150 service nova] Lock "9f267864-0b72-431d-9b0d-c63436002a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:44:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ccbe8261-ce60-404e-b58c-9b837a2f0dcb req-3747a2aa-83cf-4de1-b6ed-cd335bd09150 service nova] Lock "9f267864-0b72-431d-9b0d-c63436002a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:44:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-ccbe8261-ce60-404e-b58c-9b837a2f0dcb req-3747a2aa-83cf-4de1-b6ed-cd335bd09150 service nova] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] No waiting events found dispatching network-vif-plugged-bd5458e6-03d9-4fab-bbfb-23989a82c193 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:44:24 user nova-compute[74805]: WARNING nova.compute.manager [req-ccbe8261-ce60-404e-b58c-9b837a2f0dcb req-3747a2aa-83cf-4de1-b6ed-cd335bd09150 service nova] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Received unexpected event network-vif-plugged-bd5458e6-03d9-4fab-bbfb-23989a82c193 for instance with vm_state deleted and task_state None.
Nov 15 04:44:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-ccbe8261-ce60-404e-b58c-9b837a2f0dcb req-3747a2aa-83cf-4de1-b6ed-cd335bd09150 service nova] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Received event network-vif-deleted-bd5458e6-03d9-4fab-bbfb-23989a82c193 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:44:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-ccbe8261-ce60-404e-b58c-9b837a2f0dcb req-3747a2aa-83cf-4de1-b6ed-cd335bd09150 service nova] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Received event network-vif-plugged-bd5458e6-03d9-4fab-bbfb-23989a82c193 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:44:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ccbe8261-ce60-404e-b58c-9b837a2f0dcb req-3747a2aa-83cf-4de1-b6ed-cd335bd09150 service nova] Acquiring lock "9f267864-0b72-431d-9b0d-c63436002a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:44:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ccbe8261-ce60-404e-b58c-9b837a2f0dcb req-3747a2aa-83cf-4de1-b6ed-cd335bd09150 service nova] Lock "9f267864-0b72-431d-9b0d-c63436002a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:44:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ccbe8261-ce60-404e-b58c-9b837a2f0dcb req-3747a2aa-83cf-4de1-b6ed-cd335bd09150 service nova] Lock "9f267864-0b72-431d-9b0d-c63436002a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:44:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-ccbe8261-ce60-404e-b58c-9b837a2f0dcb req-3747a2aa-83cf-4de1-b6ed-cd335bd09150 service nova] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] No waiting events found dispatching network-vif-plugged-bd5458e6-03d9-4fab-bbfb-23989a82c193 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:44:24 user nova-compute[74805]: WARNING nova.compute.manager [req-ccbe8261-ce60-404e-b58c-9b837a2f0dcb req-3747a2aa-83cf-4de1-b6ed-cd335bd09150 service nova] [instance: 9f267864-0b72-431d-9b0d-c63436002a4c] Received unexpected event network-vif-plugged-bd5458e6-03d9-4fab-bbfb-23989a82c193 for instance with vm_state deleted and task_state None.
Nov 15 04:44:25 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:44:25 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:44:26 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:44:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:28 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:44:28 user nova-compute[74805]: DEBUG nova.compute.manager [req-d04bb99f-3dca-45ce-a1f1-ae146e607b18 req-4ac3c259-3a41-425e-8443-6db0228d7304 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Received event network-changed-375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:44:28 user nova-compute[74805]: DEBUG nova.compute.manager [req-d04bb99f-3dca-45ce-a1f1-ae146e607b18 req-4ac3c259-3a41-425e-8443-6db0228d7304 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Refreshing instance network info cache due to event network-changed-375372d2-cb40-4701-be3c-528d0ad92cbf. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:44:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d04bb99f-3dca-45ce-a1f1-ae146e607b18 req-4ac3c259-3a41-425e-8443-6db0228d7304 service nova] Acquiring lock "refresh_cache-0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:44:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d04bb99f-3dca-45ce-a1f1-ae146e607b18 req-4ac3c259-3a41-425e-8443-6db0228d7304 service nova] Acquired lock "refresh_cache-0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:44:28 user nova-compute[74805]: DEBUG nova.network.neutron [req-d04bb99f-3dca-45ce-a1f1-ae146e607b18 req-4ac3c259-3a41-425e-8443-6db0228d7304 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Refreshing network info cache for port 375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:44:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:44:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:44:28 user nova-compute[74805]: DEBUG nova.objects.instance [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lazy-loading 'flavor' on Instance uuid 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:44:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:44:28 user nova-compute[74805]: DEBUG nova.network.neutron [req-d04bb99f-3dca-45ce-a1f1-ae146e607b18 req-4ac3c259-3a41-425e-8443-6db0228d7304 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Updated VIF entry in instance network info cache for port 375372d2-cb40-4701-be3c-528d0ad92cbf. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:44:28 user nova-compute[74805]: DEBUG nova.network.neutron [req-d04bb99f-3dca-45ce-a1f1-ae146e607b18 req-4ac3c259-3a41-425e-8443-6db0228d7304 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Updating instance_info_cache with network_info: [{"id": "375372d2-cb40-4701-be3c-528d0ad92cbf", "address": "fa:16:3e:7f:bb:a8", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375372d2-cb", "ovs_interfaceid": "375372d2-cb40-4701-be3c-528d0ad92cbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:44:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d04bb99f-3dca-45ce-a1f1-ae146e607b18 req-4ac3c259-3a41-425e-8443-6db0228d7304 service nova] Releasing lock "refresh_cache-0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:44:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:44:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:44:29 user nova-compute[74805]: INFO nova.compute.manager [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Attaching volume 2a40ae0b-4251-4fd8-8d7e-04f8b40364fb to /dev/vdb
Nov 15 04:44:29 user nova-compute[74805]: DEBUG os_brick.utils [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:44:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:29 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[088c2a06-46c8-4835-8f72-768cdd0b0f12]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:44:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:29 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4e3353-2769-40d8-951f-d7939a056e24]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:44:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:29 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a779f62-4407-42df-a161-7c5ede8f6639]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:44:29 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfd42c3-a524-424f-8972-d3b393d3bc1f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:44:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:44:29 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:44:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:29 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:44:29 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:44:29 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9b9811-dcff-4235-b0c2-97a7f6fd2279]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:44:29 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:44:29 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:44:29 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:44:29 user nova-compute[74805]: DEBUG os_brick.utils [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:44:29 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Updating existing volume attachment record: f90d4165-8b77-4626-b731-456488045c98 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:44:30 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:44:30 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:44:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:44:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:44:30 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:44:30 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Updating instance_info_cache with network_info: [{"id": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "address": "fa:16:3e:c6:13:c6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9bd2e9-b1", "ovs_interfaceid": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:44:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:44:30 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:44:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:32 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:44:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:44:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:44:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:44:32 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:44:32 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:44:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:32 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ywKPUnYD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:44:33 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:44:33 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:44:33 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:44:33 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:44:33 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:44:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ed3550-0822-43d1-a0aa-4dcc88c43163]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:44:33 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[db081963-4fe5-49f9-9e1d-76c966d616f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb] added
Nov 15 04:44:33 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb328e1b-b092-44c6-b437-2ae42f6afe5f]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1d8a85-608f-497c-ae80-80f80705b8c3]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ywKPUnYD {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ywKPUnYD" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ad332c-08d2-4fad-a255-09e6572da3e7]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ywKPUnYD'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59b18e6-3609-4a09-ac06-7e82b8169673]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[339fd8be-9414-4bb6-810d-9bafbf9f99a8]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)
Nov 15 04:44:33 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)
Nov 15 04:44:33 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:44:33 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a9d7f8-808e-4491-bb85-625df2ea57f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb, portal: 172.16.0.220,3260]
Nov 15 04:44:34 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb, portal: 172.16.0.220,3260] successful.
Nov 15 04:44:34 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:34 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:44:34 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:44:34 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=8560MB free_disk=25.02759552001953GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6372a68a-36d6-44cf-b000-79ab69dffdb9]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f52952-7d53-4337-ad06-48a1398673a9]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)
Nov 15 04:44:34 user nova-compute[74805]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb (non-flash)
Nov 15 04:44:34 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)
Nov 15 04:44:34 user nova-compute[74805]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb (non-flash)
Nov 15 04:44:34 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.546s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8895f7e0-d811-4bbc-9416-a488b8f923d6]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ywKPUnYD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 75731a3d-3c78-4014-a8dc-f38c3d7b3305 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance fc2f6bf9-8d88-4e9b-afd3-98e747430e6c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:44:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:44:35 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.588s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:44:35 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] <== connect_volume: return (1591ms) {'type': 'block', 'scsi_wwn': '23434666634346561', 'path': '/dev/sdb'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:44:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434666634346561', 'path': '/dev/sdb'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:44:35 user nova-compute[74805]: DEBUG nova.objects.instance [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lazy-loading 'flavor' on Instance uuid 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:44:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:44:35 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:44:35 user nova-compute[74805]:   <source dev="/dev/sdb"/>
Nov 15 04:44:35 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:44:35 user nova-compute[74805]:   <serial>2a40ae0b-4251-4fd8-8d7e-04f8b40364fb</serial>
Nov 15 04:44:35 user nova-compute[74805]: </disk>
Nov 15 04:44:35 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:44:35 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:44:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:44:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:44:35 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] No VIF found with MAC fa:16:3e:7f:bb:a8, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:44:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-27a3ba3a-4563-443f-bbbc-1683e0478373 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.679s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:44:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:36 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:44:36 user nova-compute[74805]: INFO nova.compute.manager [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Rescuing
Nov 15 04:44:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "refresh_cache-0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:44:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquired lock "refresh_cache-0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:44:36 user nova-compute[74805]: DEBUG nova.network.neutron [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:44:37 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:44:37 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:44:37 user nova-compute[74805]: DEBUG nova.network.neutron [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Updating instance_info_cache with network_info: [{"id": "375372d2-cb40-4701-be3c-528d0ad92cbf", "address": "fa:16:3e:7f:bb:a8", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375372d2-cb", "ovs_interfaceid": "375372d2-cb40-4701-be3c-528d0ad92cbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:44:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Releasing lock "refresh_cache-0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:44:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:37 user nova-compute[74805]: DEBUG nova.compute.manager [req-15315200-b301-4762-8d55-d9093731c939 req-f5b98841-75a4-4a7d-be40-54e1d08b73ba service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Received event network-vif-unplugged-375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:44:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-15315200-b301-4762-8d55-d9093731c939 req-f5b98841-75a4-4a7d-be40-54e1d08b73ba service nova] Acquiring lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:44:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-15315200-b301-4762-8d55-d9093731c939 req-f5b98841-75a4-4a7d-be40-54e1d08b73ba service nova] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:44:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-15315200-b301-4762-8d55-d9093731c939 req-f5b98841-75a4-4a7d-be40-54e1d08b73ba service nova] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:44:37 user nova-compute[74805]: DEBUG nova.compute.manager [req-15315200-b301-4762-8d55-d9093731c939 req-f5b98841-75a4-4a7d-be40-54e1d08b73ba service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] No waiting events found dispatching network-vif-unplugged-375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:44:37 user nova-compute[74805]: WARNING nova.compute.manager [req-15315200-b301-4762-8d55-d9093731c939 req-f5b98841-75a4-4a7d-be40-54e1d08b73ba service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Received unexpected event network-vif-unplugged-375372d2-cb40-4701-be3c-528d0ad92cbf for instance with vm_state active and task_state rescuing.
Nov 15 04:44:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:37 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Instance destroyed successfully.
Nov 15 04:44:37 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Attempting rescue
Nov 15 04:44:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74805) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 04:44:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Instance directory exists: not creating {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 04:44:37 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Creating image(s)
Nov 15 04:44:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:44:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "/opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:44:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "/opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:44:37 user nova-compute[74805]: DEBUG nova.objects.instance [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:44:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:44:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:44:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.175s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk.rescue {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk.rescue" returned: 0 in 0.075s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.objects.instance [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lazy-loading 'migration_context' on Instance uuid 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.objects.base [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Object Instance<0ab0bf04-d54a-4656-85cd-a20bdbf92ba9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Start _get_guest_xml network_info=[{"id": "375372d2-cb40-4701-be3c-528d0ad92cbf", "address": "fa:16:3e:7f:bb:a8", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "vif_mac": "fa:16:3e:7f:bb:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375372d2-cb", "ovs_interfaceid": "375372d2-cb40-4701-be3c-528d0ad92cbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.objects.instance [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lazy-loading 'resources' on Instance uuid 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.objects.base [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Object Instance<0ab0bf04-d54a-4656-85cd-a20bdbf92ba9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.objects.instance [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lazy-loading 'numa_topology' on Instance uuid 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.objects.base [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Object Instance<0ab0bf04-d54a-4656-85cd-a20bdbf92ba9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:44:38 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:44:38 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.objects.instance [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.objects.base [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Object Instance<0ab0bf04-d54a-4656-85cd-a20bdbf92ba9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:42:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-110684096',display_name='tempest-ServerRescueNegativeTestJSON-server-110684096',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-110684096',id=49,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAE5HhFJvy8VlNmzAMWl5yLE8KHtHwo8pYN0mzub8KKzLvnwz/uE4chZeNvhObq9OQiWhpYdTL50hYgSBIfWHvwLTHnzCowptfiEBuZgeCebgJdzx9BVq8KB7C1akdYcEA==',key_name='tempest-keypair-1055932374',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:42:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66fc455c6c7049d79a5c64451c126d56',ramdisk_id='',reservation_id='r-2sky0upa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-370335706',owner_user_name='tempest-ServerRescueNegativeTestJSON-370335706-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:42:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6da72213d3ae446088876b3a3c34f976',uuid=0ab0bf04-d54a-4656-85cd-a20bdbf92ba9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "375372d2-cb40-4701-be3c-528d0ad92cbf", "address": "fa:16:3e:7f:bb:a8", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "vif_mac": "fa:16:3e:7f:bb:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375372d2-cb", "ovs_interfaceid": "375372d2-cb40-4701-be3c-528d0ad92cbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Converting VIF {"id": "375372d2-cb40-4701-be3c-528d0ad92cbf", "address": "fa:16:3e:7f:bb:a8", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "vif_mac": "fa:16:3e:7f:bb:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375372d2-cb", "ovs_interfaceid": "375372d2-cb40-4701-be3c-528d0ad92cbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:bb:a8,bridge_name='br-int',has_traffic_filtering=True,id=375372d2-cb40-4701-be3c-528d0ad92cbf,network=Network(98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap375372d2-cb') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.objects.instance [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.objects.base [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Object Instance<0ab0bf04-d54a-4656-85cd-a20bdbf92ba9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74805) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:44:38 user nova-compute[74805]:   <uuid>0ab0bf04-d54a-4656-85cd-a20bdbf92ba9</uuid>
Nov 15 04:44:38 user nova-compute[74805]:   <name>instance-00000031</name>
Nov 15 04:44:38 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:44:38 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:44:38 user nova-compute[74805]:   <metadata>
Nov 15 04:44:38 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:44:38 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:44:38 user nova-compute[74805]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-110684096</nova:name>
Nov 15 04:44:38 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:44:38</nova:creationTime>
Nov 15 04:44:38 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:44:38 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:44:38 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:44:38 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:44:38 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:44:38 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:44:38 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:44:38 user nova-compute[74805]:       <nova:owner>
Nov 15 04:44:38 user nova-compute[74805]:         <nova:user uuid="6da72213d3ae446088876b3a3c34f976">tempest-ServerRescueNegativeTestJSON-370335706-project-member</nova:user>
Nov 15 04:44:38 user nova-compute[74805]:         <nova:project uuid="66fc455c6c7049d79a5c64451c126d56">tempest-ServerRescueNegativeTestJSON-370335706</nova:project>
Nov 15 04:44:38 user nova-compute[74805]:       </nova:owner>
Nov 15 04:44:38 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:44:38 user nova-compute[74805]:       <nova:ports>
Nov 15 04:44:38 user nova-compute[74805]:         <nova:port uuid="375372d2-cb40-4701-be3c-528d0ad92cbf">
Nov 15 04:44:38 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 04:44:38 user nova-compute[74805]:         </nova:port>
Nov 15 04:44:38 user nova-compute[74805]:       </nova:ports>
Nov 15 04:44:38 user nova-compute[74805]:     </nova:instance>
Nov 15 04:44:38 user nova-compute[74805]:   </metadata>
Nov 15 04:44:38 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:44:38 user nova-compute[74805]:     <system>
Nov 15 04:44:38 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:44:38 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:44:38 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:44:38 user nova-compute[74805]:       <entry name="serial">0ab0bf04-d54a-4656-85cd-a20bdbf92ba9</entry>
Nov 15 04:44:38 user nova-compute[74805]:       <entry name="uuid">0ab0bf04-d54a-4656-85cd-a20bdbf92ba9</entry>
Nov 15 04:44:38 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:44:38 user nova-compute[74805]:     </system>
Nov 15 04:44:38 user nova-compute[74805]:   </sysinfo>
Nov 15 04:44:38 user nova-compute[74805]:   <os>
Nov 15 04:44:38 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:44:38 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:44:38 user nova-compute[74805]:   </os>
Nov 15 04:44:38 user nova-compute[74805]:   <features>
Nov 15 04:44:38 user nova-compute[74805]:     <acpi/>
Nov 15 04:44:38 user nova-compute[74805]:     <apic/>
Nov 15 04:44:38 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:44:38 user nova-compute[74805]:   </features>
Nov 15 04:44:38 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:44:38 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:44:38 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:44:38 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:44:38 user nova-compute[74805]:   </clock>
Nov 15 04:44:38 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:44:38 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:44:38 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:44:38 user nova-compute[74805]:   </cpu>
Nov 15 04:44:38 user nova-compute[74805]:   <devices>
Nov 15 04:44:38 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:44:38 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:44:38 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk.rescue"/>
Nov 15 04:44:38 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:44:38 user nova-compute[74805]:     </disk>
Nov 15 04:44:38 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:44:38 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:44:38 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk"/>
Nov 15 04:44:38 user nova-compute[74805]:       <target dev="vdb" bus="virtio"/>
Nov 15 04:44:38 user nova-compute[74805]:     </disk>
Nov 15 04:44:38 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:44:38 user nova-compute[74805]:       <mac address="fa:16:3e:7f:bb:a8"/>
Nov 15 04:44:38 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:44:38 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:44:38 user nova-compute[74805]:       <target dev="tap375372d2-cb"/>
Nov 15 04:44:38 user nova-compute[74805]:     </interface>
Nov 15 04:44:38 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:44:38 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/console.log" append="off"/>
Nov 15 04:44:38 user nova-compute[74805]:     </serial>
Nov 15 04:44:38 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:44:38 user nova-compute[74805]:     <video>
Nov 15 04:44:38 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:44:38 user nova-compute[74805]:     </video>
Nov 15 04:44:38 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:44:38 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:44:38 user nova-compute[74805]:     </rng>
Nov 15 04:44:38 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:44:38 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:44:38 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:44:38 user nova-compute[74805]:     </memballoon>
Nov 15 04:44:38 user nova-compute[74805]:   </devices>
Nov 15 04:44:38 user nova-compute[74805]: </domain>
Nov 15 04:44:38 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:44:38 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Instance destroyed successfully.
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:44:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] No VIF found with MAC fa:16:3e:7f:bb:a8, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:44:39 user nova-compute[74805]: DEBUG nova.compute.manager [req-922500ac-4754-496c-9e63-bc34cc9916db req-585041c3-a35e-4cf4-ad58-84e6b42aaa61 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Received event network-vif-plugged-375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:44:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-922500ac-4754-496c-9e63-bc34cc9916db req-585041c3-a35e-4cf4-ad58-84e6b42aaa61 service nova] Acquiring lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:44:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-922500ac-4754-496c-9e63-bc34cc9916db req-585041c3-a35e-4cf4-ad58-84e6b42aaa61 service nova] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:44:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-922500ac-4754-496c-9e63-bc34cc9916db req-585041c3-a35e-4cf4-ad58-84e6b42aaa61 service nova] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:44:39 user nova-compute[74805]: DEBUG nova.compute.manager [req-922500ac-4754-496c-9e63-bc34cc9916db req-585041c3-a35e-4cf4-ad58-84e6b42aaa61 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] No waiting events found dispatching network-vif-plugged-375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:44:39 user nova-compute[74805]: WARNING nova.compute.manager [req-922500ac-4754-496c-9e63-bc34cc9916db req-585041c3-a35e-4cf4-ad58-84e6b42aaa61 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Received unexpected event network-vif-plugged-375372d2-cb40-4701-be3c-528d0ad92cbf for instance with vm_state active and task_state rescuing.
Nov 15 04:44:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:41 user nova-compute[74805]: DEBUG nova.compute.manager [req-ec967c68-c5b0-4890-90c9-aa1a240240d9 req-7c03db45-b324-4d7b-8a2a-9a7ffc8c13b5 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Received event network-vif-plugged-375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:44:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ec967c68-c5b0-4890-90c9-aa1a240240d9 req-7c03db45-b324-4d7b-8a2a-9a7ffc8c13b5 service nova] Acquiring lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:44:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ec967c68-c5b0-4890-90c9-aa1a240240d9 req-7c03db45-b324-4d7b-8a2a-9a7ffc8c13b5 service nova] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:44:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ec967c68-c5b0-4890-90c9-aa1a240240d9 req-7c03db45-b324-4d7b-8a2a-9a7ffc8c13b5 service nova] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:44:41 user nova-compute[74805]: DEBUG nova.compute.manager [req-ec967c68-c5b0-4890-90c9-aa1a240240d9 req-7c03db45-b324-4d7b-8a2a-9a7ffc8c13b5 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] No waiting events found dispatching network-vif-plugged-375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:44:41 user nova-compute[74805]: WARNING nova.compute.manager [req-ec967c68-c5b0-4890-90c9-aa1a240240d9 req-7c03db45-b324-4d7b-8a2a-9a7ffc8c13b5 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Received unexpected event network-vif-plugged-375372d2-cb40-4701-be3c-528d0ad92cbf for instance with vm_state active and task_state rescuing.
Nov 15 04:44:41 user nova-compute[74805]: DEBUG nova.compute.manager [req-ec967c68-c5b0-4890-90c9-aa1a240240d9 req-7c03db45-b324-4d7b-8a2a-9a7ffc8c13b5 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Received event network-vif-plugged-375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:44:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ec967c68-c5b0-4890-90c9-aa1a240240d9 req-7c03db45-b324-4d7b-8a2a-9a7ffc8c13b5 service nova] Acquiring lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:44:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ec967c68-c5b0-4890-90c9-aa1a240240d9 req-7c03db45-b324-4d7b-8a2a-9a7ffc8c13b5 service nova] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:44:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ec967c68-c5b0-4890-90c9-aa1a240240d9 req-7c03db45-b324-4d7b-8a2a-9a7ffc8c13b5 service nova] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:44:41 user nova-compute[74805]: DEBUG nova.compute.manager [req-ec967c68-c5b0-4890-90c9-aa1a240240d9 req-7c03db45-b324-4d7b-8a2a-9a7ffc8c13b5 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] No waiting events found dispatching network-vif-plugged-375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:44:41 user nova-compute[74805]: WARNING nova.compute.manager [req-ec967c68-c5b0-4890-90c9-aa1a240240d9 req-7c03db45-b324-4d7b-8a2a-9a7ffc8c13b5 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Received unexpected event network-vif-plugged-375372d2-cb40-4701-be3c-528d0ad92cbf for instance with vm_state active and task_state rescuing.
Nov 15 04:44:41 user nova-compute[74805]: DEBUG nova.compute.manager [None req-11874b9b-8174-4615-8b23-58e4185de4f3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:44:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:44:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:44:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:45:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:45:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:45:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:45:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "fc2f6bf9-8d88-4e9b-afd3-98e747430e6c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "fc2f6bf9-8d88-4e9b-afd3-98e747430e6c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "fc2f6bf9-8d88-4e9b-afd3-98e747430e6c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "fc2f6bf9-8d88-4e9b-afd3-98e747430e6c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "fc2f6bf9-8d88-4e9b-afd3-98e747430e6c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:45:11 user nova-compute[74805]: INFO nova.compute.manager [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Terminating instance
Nov 15 04:45:11 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG nova.compute.manager [req-f8a1e42b-58ce-45aa-8a15-2fcf374655d7 req-742b8a04-1a75-4df8-acde-766f48125834 service nova] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Received event network-vif-unplugged-e0bd84d5-354d-4e71-a2d9-a1ce442dc1df {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f8a1e42b-58ce-45aa-8a15-2fcf374655d7 req-742b8a04-1a75-4df8-acde-766f48125834 service nova] Acquiring lock "fc2f6bf9-8d88-4e9b-afd3-98e747430e6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f8a1e42b-58ce-45aa-8a15-2fcf374655d7 req-742b8a04-1a75-4df8-acde-766f48125834 service nova] Lock "fc2f6bf9-8d88-4e9b-afd3-98e747430e6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f8a1e42b-58ce-45aa-8a15-2fcf374655d7 req-742b8a04-1a75-4df8-acde-766f48125834 service nova] Lock "fc2f6bf9-8d88-4e9b-afd3-98e747430e6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG nova.compute.manager [req-f8a1e42b-58ce-45aa-8a15-2fcf374655d7 req-742b8a04-1a75-4df8-acde-766f48125834 service nova] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] No waiting events found dispatching network-vif-unplugged-e0bd84d5-354d-4e71-a2d9-a1ce442dc1df {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG nova.compute.manager [req-f8a1e42b-58ce-45aa-8a15-2fcf374655d7 req-742b8a04-1a75-4df8-acde-766f48125834 service nova] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Received event network-vif-unplugged-e0bd84d5-354d-4e71-a2d9-a1ce442dc1df for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:45:11 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Instance destroyed successfully.
Nov 15 04:45:11 user nova-compute[74805]: DEBUG nova.objects.instance [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lazy-loading 'resources' on Instance uuid fc2f6bf9-8d88-4e9b-afd3-98e747430e6c {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:40:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1368588530',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1368588530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1368588530',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPVhaJRbx/KF2fraGUFym8TuSHMCm+vr08sQSUwQYIBIb1+EFD3I6MyH1WfQ5L2pKwKyLMV17sD92SFso34OMbCx9xYOq37NycVpD4suFLRe0spFwbkj2cB2nj7NN+NAg==',key_name='tempest-keypair-1367394065',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:40:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2744859f249a4326ab6d268319a34b7f',ramdisk_id='',reservation_id='r-zu081ob5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2043506637',owner_user_name='tempest-TestVolumeBootPattern-2043506637-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:40:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bd96ecd9d404779ad64456c6517591f',uuid=fc2f6bf9-8d88-4e9b-afd3-98e747430e6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0bd84d5-354d-4e71-a2d9-a1ce442dc1df", "address": "fa:16:3e:41:71:15", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bd84d5-35", "ovs_interfaceid": "e0bd84d5-354d-4e71-a2d9-a1ce442dc1df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converting VIF {"id": "e0bd84d5-354d-4e71-a2d9-a1ce442dc1df", "address": "fa:16:3e:41:71:15", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bd84d5-35", "ovs_interfaceid": "e0bd84d5-354d-4e71-a2d9-a1ce442dc1df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:71:15,bridge_name='br-int',has_traffic_filtering=True,id=e0bd84d5-354d-4e71-a2d9-a1ce442dc1df,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0bd84d5-35') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG os_vif [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:71:15,bridge_name='br-int',has_traffic_filtering=True,id=e0bd84d5-354d-4e71-a2d9-a1ce442dc1df,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0bd84d5-35') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0bd84d5-35, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=74a31e8c-90a7-47d9-974f-14bc0ea7c22e) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:45:11 user nova-compute[74805]: INFO os_vif [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:71:15,bridge_name='br-int',has_traffic_filtering=True,id=e0bd84d5-354d-4e71-a2d9-a1ce442dc1df,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0bd84d5-35')
Nov 15 04:45:11 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dUVxyRcC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:45:11 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:45:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c0c700-3a6d-4b0c-8d8a-ec8d3d6fb77f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:45:11 user nova-compute[74805]: No targets found.
Nov 15 04:45:11 user nova-compute[74805]: iSNS:
Nov 15 04:45:11 user nova-compute[74805]: No targets found.
Nov 15 04:45:11 user nova-compute[74805]: STATIC:
Nov 15 04:45:11 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea
Nov 15 04:45:11 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:45:11 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:45:11 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb
Nov 15 04:45:11 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:45:11 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:45:11 user nova-compute[74805]: FIRMWARE:
Nov 15 04:45:11 user nova-compute[74805]: No targets found.
Nov 15 04:45:11 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:45:11 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:45:11 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3dc9e9-b629-4c62-8e98-3fef6ecce4b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbce3e56-5e21-46ca-9468-80141bc041c0]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)
Nov 15 04:45:11 user nova-compute[74805]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb (non-flash)
Nov 15 04:45:11 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea (non-flash)
Nov 15 04:45:11 user nova-compute[74805]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb (non-flash)
Nov 15 04:45:11 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c119ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea'): ({'sdc'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Removing single pathed devices sdc {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a33ad36-04d2-47f6-a010-fee273f6c579]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:45:11 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e1d80a-df6f-478b-b6b3-879cb48c6d8f]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Flushing IO for device /dev/sdc {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf44555-fc43-4a82-a045-e6c0ae71e4cb]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5f448c-f6bf-414b-ba03-2d467b7b64f6]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23163356463636637', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6961795a', '/dev/disk/by-id/scsi-1SCST_BIO6961795a-1c5dccf778c4d895') {{(pid=85029) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfd40e5-a023-474b-b0f1-7d072ccbc9ce]: (4, None) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e700dea-813d-421c-bfb7-295030d33df3]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55982c4-052c-4aed-8aea-d3344a7e43f0]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea, portal: 172.16.0.220,3260]
Nov 15 04:45:12 user nova-compute[74805]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea, portal: 172.16.0.220,3260] successful.
Nov 15 04:45:12 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83075b96-5275-42b0-b5b3-5bb801112eea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1ecc8d-8710-48be-a5de-29ec6dba91e8]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] <== disconnect_volume: return (307ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:45:12 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Deleting instance files /opt/stack/data/nova/instances/fc2f6bf9-8d88-4e9b-afd3-98e747430e6c_del
Nov 15 04:45:12 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Deletion of /opt/stack/data/nova/instances/fc2f6bf9-8d88-4e9b-afd3-98e747430e6c_del complete
Nov 15 04:45:12 user nova-compute[74805]: INFO nova.compute.manager [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 15 04:45:12 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:45:12 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:45:13 user nova-compute[74805]: DEBUG nova.compute.manager [req-f81e499f-0017-4b4f-9e46-92b335550aa4 req-39071688-f760-4df3-8ce5-726e9d800910 service nova] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Received event network-vif-plugged-e0bd84d5-354d-4e71-a2d9-a1ce442dc1df {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:45:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f81e499f-0017-4b4f-9e46-92b335550aa4 req-39071688-f760-4df3-8ce5-726e9d800910 service nova] Acquiring lock "fc2f6bf9-8d88-4e9b-afd3-98e747430e6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:45:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f81e499f-0017-4b4f-9e46-92b335550aa4 req-39071688-f760-4df3-8ce5-726e9d800910 service nova] Lock "fc2f6bf9-8d88-4e9b-afd3-98e747430e6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:45:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-f81e499f-0017-4b4f-9e46-92b335550aa4 req-39071688-f760-4df3-8ce5-726e9d800910 service nova] Lock "fc2f6bf9-8d88-4e9b-afd3-98e747430e6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:45:13 user nova-compute[74805]: DEBUG nova.compute.manager [req-f81e499f-0017-4b4f-9e46-92b335550aa4 req-39071688-f760-4df3-8ce5-726e9d800910 service nova] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] No waiting events found dispatching network-vif-plugged-e0bd84d5-354d-4e71-a2d9-a1ce442dc1df {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:45:13 user nova-compute[74805]: WARNING nova.compute.manager [req-f81e499f-0017-4b4f-9e46-92b335550aa4 req-39071688-f760-4df3-8ce5-726e9d800910 service nova] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Received unexpected event network-vif-plugged-e0bd84d5-354d-4e71-a2d9-a1ce442dc1df for instance with vm_state active and task_state deleting.
Nov 15 04:45:13 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:45:13 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Took 1.49 seconds to deallocate network for instance.
Nov 15 04:45:13 user nova-compute[74805]: DEBUG nova.compute.manager [req-0f15a15a-214d-4972-ab14-ede706048ec5 req-8ad7caab-435e-461b-9f9d-77bc6f6163c1 service nova] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Received event network-vif-deleted-e0bd84d5-354d-4e71-a2d9-a1ce442dc1df {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:45:14 user nova-compute[74805]: INFO nova.compute.manager [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Took 0.72 seconds to detach 1 volumes for instance.
Nov 15 04:45:14 user nova-compute[74805]: DEBUG nova.compute.manager [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: fc2f6bf9-8d88-4e9b-afd3-98e747430e6c] Deleting volume: 83075b96-5275-42b0-b5b3-5bb801112eea {{(pid=74805) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 04:45:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:45:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:45:14 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:45:14 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:45:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.226s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:45:14 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Deleted allocations for instance fc2f6bf9-8d88-4e9b-afd3-98e747430e6c
Nov 15 04:45:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b42eef03-ef67-4636-9a81-fb9fda26578d tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "fc2f6bf9-8d88-4e9b-afd3-98e747430e6c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.864s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:45:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:45:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:45:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:45:22 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:45:22 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74805) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 04:45:25 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:45:26 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:45:26 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:45:26 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:45:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:45:27 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:45:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Cleaning up deleted instances {{(pid=74805) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 04:45:27 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] There are 0 instances to clean {{(pid=74805) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 04:45:30 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:45:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:45:32 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:45:32 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:45:32 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Didn't find any instances for network info cache update. {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 04:45:34 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:45:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:45:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:45:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:45:34 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:45:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:45:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:45:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:45:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:45:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk (vdb) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:45:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:45:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:45:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:45:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:45:34 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:45:35 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:45:35 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:45:35 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:45:35 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:45:35 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:45:35 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:45:35 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:45:36 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:45:36 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:45:36 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=8689MB free_disk=25.02437973022461GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:45:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:45:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:45:36 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 75731a3d-3c78-4014-a8dc-f38c3d7b3305 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:45:36 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:45:36 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:45:36 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:45:36 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:45:36 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:45:36 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:45:36 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:45:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:45:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:45:37 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:45:37 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:45:37 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:45:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:45:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:45:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:45:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:02 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:46:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "57f04f4b-b452-447f-a1dd-9244f08e9f35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:46:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "57f04f4b-b452-447f-a1dd-9244f08e9f35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:46:08 user nova-compute[74805]: DEBUG nova.compute.manager [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:46:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:46:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:46:08 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:46:08 user nova-compute[74805]: INFO nova.compute.claims [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Claim successful on node user
Nov 15 04:46:09 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:46:09 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:46:09 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.268s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:46:09 user nova-compute[74805]: DEBUG nova.compute.manager [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:46:09 user nova-compute[74805]: DEBUG nova.compute.manager [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:46:09 user nova-compute[74805]: DEBUG nova.network.neutron [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:46:09 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:46:09 user nova-compute[74805]: DEBUG nova.compute.manager [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:46:09 user nova-compute[74805]: DEBUG nova.policy [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bd96ecd9d404779ad64456c6517591f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2744859f249a4326ab6d268319a34b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:46:09 user nova-compute[74805]: INFO nova.virt.block_device [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Booting with volume ddff8d6c-cbbb-45d2-8883-a5cd5db9478f at /dev/vda
Nov 15 04:46:09 user nova-compute[74805]: DEBUG os_brick.utils [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:46:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:46:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:46:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64d463c-397a-421f-b652-5ae3e029cfc3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:46:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:46:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:46:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dd07a6-6cf4-4771-a6ab-6127b5c60252]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:46:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:46:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:46:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b830f1ae-f88d-4686-911f-2d3750fcd442]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:46:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7d8732-cc91-4a8b-9db1-cd0f81d0f55f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:46:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:46:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:46:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:46:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:46:09 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:46:09 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:46:09 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fec5a6-26e3-462d-91b6-37d608965a2d]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:46:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:46:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:46:09 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:46:09 user nova-compute[74805]: DEBUG os_brick.utils [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:46:09 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Updating existing volume attachment record: 3a9cef7e-6370-4de6-bfbe-a1d2d970a03d {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:46:10 user nova-compute[74805]: DEBUG nova.network.neutron [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Successfully created port: 809c4c39-ae65-4461-8631-3244606f1db8 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:46:10 user nova-compute[74805]: DEBUG nova.network.neutron [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Successfully updated port: 809c4c39-ae65-4461-8631-3244606f1db8 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:46:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "refresh_cache-57f04f4b-b452-447f-a1dd-9244f08e9f35" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:46:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquired lock "refresh_cache-57f04f4b-b452-447f-a1dd-9244f08e9f35" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:46:10 user nova-compute[74805]: DEBUG nova.network.neutron [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:46:10 user nova-compute[74805]: DEBUG nova.network.neutron [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:46:10 user nova-compute[74805]: DEBUG nova.compute.manager [req-733585f7-81ff-4d62-9135-5bcb5d121e72 req-61147a91-ca85-475e-ae5a-fe660a34df73 service nova] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Received event network-changed-809c4c39-ae65-4461-8631-3244606f1db8 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:46:10 user nova-compute[74805]: DEBUG nova.compute.manager [req-733585f7-81ff-4d62-9135-5bcb5d121e72 req-61147a91-ca85-475e-ae5a-fe660a34df73 service nova] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Refreshing instance network info cache due to event network-changed-809c4c39-ae65-4461-8631-3244606f1db8. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:46:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-733585f7-81ff-4d62-9135-5bcb5d121e72 req-61147a91-ca85-475e-ae5a-fe660a34df73 service nova] Acquiring lock "refresh_cache-57f04f4b-b452-447f-a1dd-9244f08e9f35" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:46:11 user nova-compute[74805]: DEBUG nova.network.neutron [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Updating instance_info_cache with network_info: [{"id": "809c4c39-ae65-4461-8631-3244606f1db8", "address": "fa:16:3e:5b:05:fa", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809c4c39-ae", "ovs_interfaceid": "809c4c39-ae65-4461-8631-3244606f1db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:46:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Releasing lock "refresh_cache-57f04f4b-b452-447f-a1dd-9244f08e9f35" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:46:11 user nova-compute[74805]: DEBUG nova.compute.manager [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Instance network_info: |[{"id": "809c4c39-ae65-4461-8631-3244606f1db8", "address": "fa:16:3e:5b:05:fa", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809c4c39-ae", "ovs_interfaceid": "809c4c39-ae65-4461-8631-3244606f1db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:46:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-733585f7-81ff-4d62-9135-5bcb5d121e72 req-61147a91-ca85-475e-ae5a-fe660a34df73 service nova] Acquired lock "refresh_cache-57f04f4b-b452-447f-a1dd-9244f08e9f35" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:46:11 user nova-compute[74805]: DEBUG nova.network.neutron [req-733585f7-81ff-4d62-9135-5bcb5d121e72 req-61147a91-ca85-475e-ae5a-fe660a34df73 service nova] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Refreshing network info cache for port 809c4c39-ae65-4461-8631-3244606f1db8 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:46:11 user nova-compute[74805]: DEBUG nova.network.neutron [req-733585f7-81ff-4d62-9135-5bcb5d121e72 req-61147a91-ca85-475e-ae5a-fe660a34df73 service nova] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Updated VIF entry in instance network info cache for port 809c4c39-ae65-4461-8631-3244606f1db8. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:46:11 user nova-compute[74805]: DEBUG nova.network.neutron [req-733585f7-81ff-4d62-9135-5bcb5d121e72 req-61147a91-ca85-475e-ae5a-fe660a34df73 service nova] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Updating instance_info_cache with network_info: [{"id": "809c4c39-ae65-4461-8631-3244606f1db8", "address": "fa:16:3e:5b:05:fa", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809c4c39-ae", "ovs_interfaceid": "809c4c39-ae65-4461-8631-3244606f1db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:46:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-733585f7-81ff-4d62-9135-5bcb5d121e72 req-61147a91-ca85-475e-ae5a-fe660a34df73 service nova] Releasing lock "refresh_cache-57f04f4b-b452-447f-a1dd-9244f08e9f35" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:46:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG nova.compute.manager [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:46:14 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Creating image(s)
Nov 15 04:46:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Did not create local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Ensure instance console log exists: /opt/stack/data/nova/instances/57f04f4b-b452-447f-a1dd-9244f08e9f35/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Start _get_guest_xml network_info=[{"id": "809c4c39-ae65-4461-8631-3244606f1db8", "address": "fa:16:3e:5b:05:fa", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809c4c39-ae", "ovs_interfaceid": "809c4c39-ae65-4461-8631-3244606f1db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WziNdebE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '57f04f4b-b452-447f-a1dd-9244f08e9f35', 'attached_at': '', 'detached_at': '', 'volume_id': 'ddff8d6c-cbbb-45d2-8883-a5cd5db9478f', 'serial': 'ddff8d6c-cbbb-45d2-8883-a5cd5db9478f'}, 'delete_on_termination': False, 'attachment_id': '3a9cef7e-6370-4de6-bfbe-a1d2d970a03d', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:46:14 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:46:14 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:46:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WziNdebE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:46:14 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:46:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:46:14 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:46:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:46:14 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31e6066-741f-43ec-a133-54debc24dfb9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:46:14 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6bab46-f486-4280-bfc1-1dd7e8452299]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f] added
Nov 15 04:46:14 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5019314f-463b-43ce-ac36-62f32dbf16aa]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[05821a3a-2e34-445e-b3f3-a7cd754602a8]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WziNdebE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WziNdebE" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f239836-3a58-4876-945d-8e0cbb12d89f]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WziNdebE'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9068228a-577d-4b31-81e6-d217c68dfd65]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[94811431-1082-4426-ad24-2a0fd30437ef]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb (non-flash)
Nov 15 04:46:14 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb (non-flash)
Nov 15 04:46:14 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5d4bca-fb69-4c39-85fe-1873ed941518]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f, portal: 172.16.0.220,3260]
Nov 15 04:46:14 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f, portal: 172.16.0.220,3260] successful.
Nov 15 04:46:14 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0ec9e2-f28f-425f-92b6-971872cb5793]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d42217-061d-4df4-a319-68c4814a2574]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb (non-flash)
Nov 15 04:46:14 user nova-compute[74805]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f (non-flash)
Nov 15 04:46:14 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb (non-flash)
Nov 15 04:46:14 user nova-compute[74805]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f (non-flash)
Nov 15 04:46:14 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07ba19e-8f9a-4e2d-9938-b69669e8e4fe]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:46:14 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WziNdebE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:46:15 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:46:15 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26130306136366536', 'path': '/dev/sdc'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:46:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130306136366536', 'path': '/dev/sdc'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:46:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:46:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-632470684',display_name='tempest-TestVolumeBootPattern-server-632470684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-632470684',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPSZsjBao2IiCSH6iNxCBnd9/tVkNXbrNJpEOjeMrEDWwanT/XX2Dcm8vpngfLnbfGhydqc2p2DnAgn/CCrGmL8T0FuaHg/KrFgmSAIbSmou7lS7rh9h9Z85pHvQBKirA==',key_name='tempest-TestVolumeBootPattern-1567239913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2744859f249a4326ab6d268319a34b7f',ramdisk_id='',reservation_id='r-47w1ai5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2043506637',owner_user_name='tempest-TestVolumeBootPattern-2043506637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:46:09Z,user_data=None,user_id='0bd96ecd9d404779ad64456c6517591f',uuid=57f04f4b-b452-447f-a1dd-9244f08e9f35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "809c4c39-ae65-4461-8631-3244606f1db8", "address": "fa:16:3e:5b:05:fa", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809c4c39-ae", "ovs_interfaceid": "809c4c39-ae65-4461-8631-3244606f1db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:46:15 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converting VIF {"id": "809c4c39-ae65-4461-8631-3244606f1db8", "address": "fa:16:3e:5b:05:fa", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809c4c39-ae", "ovs_interfaceid": "809c4c39-ae65-4461-8631-3244606f1db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:46:15 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:05:fa,bridge_name='br-int',has_traffic_filtering=True,id=809c4c39-ae65-4461-8631-3244606f1db8,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809c4c39-ae') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:46:15 user nova-compute[74805]: DEBUG nova.objects.instance [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lazy-loading 'pci_devices' on Instance uuid 57f04f4b-b452-447f-a1dd-9244f08e9f35 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:46:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:46:15 user nova-compute[74805]:   <uuid>57f04f4b-b452-447f-a1dd-9244f08e9f35</uuid>
Nov 15 04:46:15 user nova-compute[74805]:   <name>instance-00000032</name>
Nov 15 04:46:15 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:46:15 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:46:15 user nova-compute[74805]:   <metadata>
Nov 15 04:46:15 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:46:15 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:46:15 user nova-compute[74805]:       <nova:name>tempest-TestVolumeBootPattern-server-632470684</nova:name>
Nov 15 04:46:15 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:46:14</nova:creationTime>
Nov 15 04:46:15 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:46:15 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:46:15 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:46:15 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:46:15 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:46:15 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:46:15 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:46:15 user nova-compute[74805]:       <nova:owner>
Nov 15 04:46:15 user nova-compute[74805]:         <nova:user uuid="0bd96ecd9d404779ad64456c6517591f">tempest-TestVolumeBootPattern-2043506637-project-member</nova:user>
Nov 15 04:46:15 user nova-compute[74805]:         <nova:project uuid="2744859f249a4326ab6d268319a34b7f">tempest-TestVolumeBootPattern-2043506637</nova:project>
Nov 15 04:46:15 user nova-compute[74805]:       </nova:owner>
Nov 15 04:46:15 user nova-compute[74805]:       <nova:ports>
Nov 15 04:46:15 user nova-compute[74805]:         <nova:port uuid="809c4c39-ae65-4461-8631-3244606f1db8">
Nov 15 04:46:15 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 04:46:15 user nova-compute[74805]:         </nova:port>
Nov 15 04:46:15 user nova-compute[74805]:       </nova:ports>
Nov 15 04:46:15 user nova-compute[74805]:     </nova:instance>
Nov 15 04:46:15 user nova-compute[74805]:   </metadata>
Nov 15 04:46:15 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:46:15 user nova-compute[74805]:     <system>
Nov 15 04:46:15 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:46:15 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:46:15 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:46:15 user nova-compute[74805]:       <entry name="serial">57f04f4b-b452-447f-a1dd-9244f08e9f35</entry>
Nov 15 04:46:15 user nova-compute[74805]:       <entry name="uuid">57f04f4b-b452-447f-a1dd-9244f08e9f35</entry>
Nov 15 04:46:15 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:46:15 user nova-compute[74805]:     </system>
Nov 15 04:46:15 user nova-compute[74805]:   </sysinfo>
Nov 15 04:46:15 user nova-compute[74805]:   <os>
Nov 15 04:46:15 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:46:15 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:46:15 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:46:15 user nova-compute[74805]:   </os>
Nov 15 04:46:15 user nova-compute[74805]:   <features>
Nov 15 04:46:15 user nova-compute[74805]:     <acpi/>
Nov 15 04:46:15 user nova-compute[74805]:     <apic/>
Nov 15 04:46:15 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:46:15 user nova-compute[74805]:   </features>
Nov 15 04:46:15 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:46:15 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:46:15 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:46:15 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:46:15 user nova-compute[74805]:   </clock>
Nov 15 04:46:15 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:46:15 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:46:15 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:46:15 user nova-compute[74805]:   </cpu>
Nov 15 04:46:15 user nova-compute[74805]:   <devices>
Nov 15 04:46:15 user nova-compute[74805]:     <disk type="block" device="disk">
Nov 15 04:46:15 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:46:15 user nova-compute[74805]:       <source dev="/dev/sdc"/>
Nov 15 04:46:15 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:46:15 user nova-compute[74805]:       <serial>ddff8d6c-cbbb-45d2-8883-a5cd5db9478f</serial>
Nov 15 04:46:15 user nova-compute[74805]:     </disk>
Nov 15 04:46:15 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:46:15 user nova-compute[74805]:       <mac address="fa:16:3e:5b:05:fa"/>
Nov 15 04:46:15 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:46:15 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:46:15 user nova-compute[74805]:       <target dev="tap809c4c39-ae"/>
Nov 15 04:46:15 user nova-compute[74805]:     </interface>
Nov 15 04:46:15 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:46:15 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/57f04f4b-b452-447f-a1dd-9244f08e9f35/console.log" append="off"/>
Nov 15 04:46:15 user nova-compute[74805]:     </serial>
Nov 15 04:46:15 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:46:15 user nova-compute[74805]:     <video>
Nov 15 04:46:15 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:46:15 user nova-compute[74805]:     </video>
Nov 15 04:46:15 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:46:15 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:46:15 user nova-compute[74805]:     </rng>
Nov 15 04:46:15 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:46:15 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:46:15 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:46:15 user nova-compute[74805]:     </memballoon>
Nov 15 04:46:15 user nova-compute[74805]:   </devices>
Nov 15 04:46:15 user nova-compute[74805]: </domain>
Nov 15 04:46:15 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:46:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:46:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-632470684',display_name='tempest-TestVolumeBootPattern-server-632470684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-632470684',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPSZsjBao2IiCSH6iNxCBnd9/tVkNXbrNJpEOjeMrEDWwanT/XX2Dcm8vpngfLnbfGhydqc2p2DnAgn/CCrGmL8T0FuaHg/KrFgmSAIbSmou7lS7rh9h9Z85pHvQBKirA==',key_name='tempest-TestVolumeBootPattern-1567239913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2744859f249a4326ab6d268319a34b7f',ramdisk_id='',reservation_id='r-47w1ai5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2043506637',owner_user_name='tempest-TestVolumeBootPattern-2043506637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:46:09Z,user_data=None,user_id='0bd96ecd9d404779ad64456c6517591f',uuid=57f04f4b-b452-447f-a1dd-9244f08e9f35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "809c4c39-ae65-4461-8631-3244606f1db8", "address": "fa:16:3e:5b:05:fa", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809c4c39-ae", "ovs_interfaceid": "809c4c39-ae65-4461-8631-3244606f1db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:46:15 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converting VIF {"id": "809c4c39-ae65-4461-8631-3244606f1db8", "address": "fa:16:3e:5b:05:fa", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809c4c39-ae", "ovs_interfaceid": "809c4c39-ae65-4461-8631-3244606f1db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:46:15 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:05:fa,bridge_name='br-int',has_traffic_filtering=True,id=809c4c39-ae65-4461-8631-3244606f1db8,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809c4c39-ae') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:46:15 user nova-compute[74805]: DEBUG os_vif [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:05:fa,bridge_name='br-int',has_traffic_filtering=True,id=809c4c39-ae65-4461-8631-3244606f1db8,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809c4c39-ae') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:46:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:46:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:46:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd4a7b402-1191-56d2-a80b-8d9b17e6c97b', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:46:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:46:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap809c4c39-ae, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:46:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap809c4c39-ae, col_values=(('qos', UUID('1630d13f-888a-4c59-9ce9-aa05ac2819a9')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:46:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap809c4c39-ae, col_values=(('external_ids', {'iface-id': '809c4c39-ae65-4461-8631-3244606f1db8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:05:fa', 'vm-uuid': '57f04f4b-b452-447f-a1dd-9244f08e9f35'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:46:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:46:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:15 user nova-compute[74805]: INFO os_vif [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:05:fa,bridge_name='br-int',has_traffic_filtering=True,id=809c4c39-ae65-4461-8631-3244606f1db8,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809c4c39-ae')
Nov 15 04:46:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:46:15 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] No VIF found with MAC fa:16:3e:5b:05:fa, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:46:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:17 user nova-compute[74805]: DEBUG nova.compute.manager [req-dc93a9eb-813c-4019-9aee-a3be74a51e5e req-1df4e524-cb8f-4123-88e0-d101cf624182 service nova] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Received event network-vif-plugged-809c4c39-ae65-4461-8631-3244606f1db8 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:46:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-dc93a9eb-813c-4019-9aee-a3be74a51e5e req-1df4e524-cb8f-4123-88e0-d101cf624182 service nova] Acquiring lock "57f04f4b-b452-447f-a1dd-9244f08e9f35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:46:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-dc93a9eb-813c-4019-9aee-a3be74a51e5e req-1df4e524-cb8f-4123-88e0-d101cf624182 service nova] Lock "57f04f4b-b452-447f-a1dd-9244f08e9f35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:46:17 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-dc93a9eb-813c-4019-9aee-a3be74a51e5e req-1df4e524-cb8f-4123-88e0-d101cf624182 service nova] Lock "57f04f4b-b452-447f-a1dd-9244f08e9f35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:46:17 user nova-compute[74805]: DEBUG nova.compute.manager [req-dc93a9eb-813c-4019-9aee-a3be74a51e5e req-1df4e524-cb8f-4123-88e0-d101cf624182 service nova] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] No waiting events found dispatching network-vif-plugged-809c4c39-ae65-4461-8631-3244606f1db8 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:46:17 user nova-compute[74805]: WARNING nova.compute.manager [req-dc93a9eb-813c-4019-9aee-a3be74a51e5e req-1df4e524-cb8f-4123-88e0-d101cf624182 service nova] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Received unexpected event network-vif-plugged-809c4c39-ae65-4461-8631-3244606f1db8 for instance with vm_state building and task_state spawning.
Nov 15 04:46:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:19 user nova-compute[74805]: DEBUG nova.compute.manager [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:46:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:46:19 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Instance spawned successfully.
Nov 15 04:46:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:46:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:46:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:46:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:46:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:46:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:46:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:46:19 user nova-compute[74805]: INFO nova.compute.manager [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Took 5.12 seconds to spawn the instance on the hypervisor.
Nov 15 04:46:19 user nova-compute[74805]: DEBUG nova.compute.manager [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:46:19 user nova-compute[74805]: DEBUG nova.compute.manager [req-768df923-e93b-440f-8681-f92e1b9c390f req-47020ddf-b3c9-4075-a9e4-3b7beb850ea8 service nova] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Received event network-vif-plugged-809c4c39-ae65-4461-8631-3244606f1db8 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:46:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-768df923-e93b-440f-8681-f92e1b9c390f req-47020ddf-b3c9-4075-a9e4-3b7beb850ea8 service nova] Acquiring lock "57f04f4b-b452-447f-a1dd-9244f08e9f35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:46:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-768df923-e93b-440f-8681-f92e1b9c390f req-47020ddf-b3c9-4075-a9e4-3b7beb850ea8 service nova] Lock "57f04f4b-b452-447f-a1dd-9244f08e9f35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:46:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-768df923-e93b-440f-8681-f92e1b9c390f req-47020ddf-b3c9-4075-a9e4-3b7beb850ea8 service nova] Lock "57f04f4b-b452-447f-a1dd-9244f08e9f35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:46:19 user nova-compute[74805]: DEBUG nova.compute.manager [req-768df923-e93b-440f-8681-f92e1b9c390f req-47020ddf-b3c9-4075-a9e4-3b7beb850ea8 service nova] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] No waiting events found dispatching network-vif-plugged-809c4c39-ae65-4461-8631-3244606f1db8 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:46:19 user nova-compute[74805]: WARNING nova.compute.manager [req-768df923-e93b-440f-8681-f92e1b9c390f req-47020ddf-b3c9-4075-a9e4-3b7beb850ea8 service nova] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Received unexpected event network-vif-plugged-809c4c39-ae65-4461-8631-3244606f1db8 for instance with vm_state building and task_state spawning.
Nov 15 04:46:19 user nova-compute[74805]: INFO nova.compute.manager [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Took 10.52 seconds to build instance.
Nov 15 04:46:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-01446e17-02ba-4890-9385-0c1959087a99 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "57f04f4b-b452-447f-a1dd-9244f08e9f35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.689s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:46:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:26 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:46:27 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:46:27 user nova-compute[74805]: INFO nova.compute.manager [None req-8ed692d7-1bc8-4e78-8d9d-6f80572bc729 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Unrescuing
Nov 15 04:46:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8ed692d7-1bc8-4e78-8d9d-6f80572bc729 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "refresh_cache-0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:46:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8ed692d7-1bc8-4e78-8d9d-6f80572bc729 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquired lock "refresh_cache-0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:46:27 user nova-compute[74805]: DEBUG nova.network.neutron [None req-8ed692d7-1bc8-4e78-8d9d-6f80572bc729 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:46:28 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:46:28 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:46:28 user nova-compute[74805]: DEBUG nova.network.neutron [None req-8ed692d7-1bc8-4e78-8d9d-6f80572bc729 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Updating instance_info_cache with network_info: [{"id": "375372d2-cb40-4701-be3c-528d0ad92cbf", "address": "fa:16:3e:7f:bb:a8", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375372d2-cb", "ovs_interfaceid": "375372d2-cb40-4701-be3c-528d0ad92cbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:46:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8ed692d7-1bc8-4e78-8d9d-6f80572bc729 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Releasing lock "refresh_cache-0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:46:28 user nova-compute[74805]: DEBUG nova.objects.instance [None req-8ed692d7-1bc8-4e78-8d9d-6f80572bc729 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lazy-loading 'flavor' on Instance uuid 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:46:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:28 user nova-compute[74805]: DEBUG nova.compute.manager [req-c0ddbefa-005c-4fed-b47e-edc890f1ea62 req-d5a14a56-9976-498c-a1ad-950533a7197e service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Received event network-vif-unplugged-375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:46:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c0ddbefa-005c-4fed-b47e-edc890f1ea62 req-d5a14a56-9976-498c-a1ad-950533a7197e service nova] Acquiring lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:46:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c0ddbefa-005c-4fed-b47e-edc890f1ea62 req-d5a14a56-9976-498c-a1ad-950533a7197e service nova] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:46:28 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-c0ddbefa-005c-4fed-b47e-edc890f1ea62 req-d5a14a56-9976-498c-a1ad-950533a7197e service nova] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:46:28 user nova-compute[74805]: DEBUG nova.compute.manager [req-c0ddbefa-005c-4fed-b47e-edc890f1ea62 req-d5a14a56-9976-498c-a1ad-950533a7197e service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] No waiting events found dispatching network-vif-unplugged-375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:46:28 user nova-compute[74805]: WARNING nova.compute.manager [req-c0ddbefa-005c-4fed-b47e-edc890f1ea62 req-d5a14a56-9976-498c-a1ad-950533a7197e service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Received unexpected event network-vif-unplugged-375372d2-cb40-4701-be3c-528d0ad92cbf for instance with vm_state rescued and task_state unrescuing.
Nov 15 04:46:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:28 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Instance destroyed successfully.
Nov 15 04:46:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:30 user nova-compute[74805]: DEBUG nova.compute.manager [req-9e89dbb0-fdef-47b6-9ff9-9a0a59942f85 req-30c52464-ba6e-47c6-ace7-094f637bc106 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Received event network-vif-plugged-375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:46:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9e89dbb0-fdef-47b6-9ff9-9a0a59942f85 req-30c52464-ba6e-47c6-ace7-094f637bc106 service nova] Acquiring lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:46:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9e89dbb0-fdef-47b6-9ff9-9a0a59942f85 req-30c52464-ba6e-47c6-ace7-094f637bc106 service nova] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:46:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9e89dbb0-fdef-47b6-9ff9-9a0a59942f85 req-30c52464-ba6e-47c6-ace7-094f637bc106 service nova] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:46:30 user nova-compute[74805]: DEBUG nova.compute.manager [req-9e89dbb0-fdef-47b6-9ff9-9a0a59942f85 req-30c52464-ba6e-47c6-ace7-094f637bc106 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] No waiting events found dispatching network-vif-plugged-375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:46:30 user nova-compute[74805]: WARNING nova.compute.manager [req-9e89dbb0-fdef-47b6-9ff9-9a0a59942f85 req-30c52464-ba6e-47c6-ace7-094f637bc106 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Received unexpected event network-vif-plugged-375372d2-cb40-4701-be3c-528d0ad92cbf for instance with vm_state rescued and task_state unrescuing.
Nov 15 04:46:30 user nova-compute[74805]: DEBUG nova.compute.manager [req-9e89dbb0-fdef-47b6-9ff9-9a0a59942f85 req-30c52464-ba6e-47c6-ace7-094f637bc106 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Received event network-vif-plugged-375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:46:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9e89dbb0-fdef-47b6-9ff9-9a0a59942f85 req-30c52464-ba6e-47c6-ace7-094f637bc106 service nova] Acquiring lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:46:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9e89dbb0-fdef-47b6-9ff9-9a0a59942f85 req-30c52464-ba6e-47c6-ace7-094f637bc106 service nova] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:46:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9e89dbb0-fdef-47b6-9ff9-9a0a59942f85 req-30c52464-ba6e-47c6-ace7-094f637bc106 service nova] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:46:30 user nova-compute[74805]: DEBUG nova.compute.manager [req-9e89dbb0-fdef-47b6-9ff9-9a0a59942f85 req-30c52464-ba6e-47c6-ace7-094f637bc106 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] No waiting events found dispatching network-vif-plugged-375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:46:30 user nova-compute[74805]: WARNING nova.compute.manager [req-9e89dbb0-fdef-47b6-9ff9-9a0a59942f85 req-30c52464-ba6e-47c6-ace7-094f637bc106 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Received unexpected event network-vif-plugged-375372d2-cb40-4701-be3c-528d0ad92cbf for instance with vm_state rescued and task_state unrescuing.
Nov 15 04:46:30 user nova-compute[74805]: DEBUG nova.compute.manager [req-9e89dbb0-fdef-47b6-9ff9-9a0a59942f85 req-30c52464-ba6e-47c6-ace7-094f637bc106 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Received event network-vif-plugged-375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:46:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9e89dbb0-fdef-47b6-9ff9-9a0a59942f85 req-30c52464-ba6e-47c6-ace7-094f637bc106 service nova] Acquiring lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:46:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9e89dbb0-fdef-47b6-9ff9-9a0a59942f85 req-30c52464-ba6e-47c6-ace7-094f637bc106 service nova] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:46:30 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9e89dbb0-fdef-47b6-9ff9-9a0a59942f85 req-30c52464-ba6e-47c6-ace7-094f637bc106 service nova] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:46:30 user nova-compute[74805]: DEBUG nova.compute.manager [req-9e89dbb0-fdef-47b6-9ff9-9a0a59942f85 req-30c52464-ba6e-47c6-ace7-094f637bc106 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] No waiting events found dispatching network-vif-plugged-375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:46:30 user nova-compute[74805]: WARNING nova.compute.manager [req-9e89dbb0-fdef-47b6-9ff9-9a0a59942f85 req-30c52464-ba6e-47c6-ace7-094f637bc106 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Received unexpected event network-vif-plugged-375372d2-cb40-4701-be3c-528d0ad92cbf for instance with vm_state rescued and task_state unrescuing.
Nov 15 04:46:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:32 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:46:32 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:46:32 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Rebuilding the list of instances to heal {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 04:46:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-75731a3d-3c78-4014-a8dc-f38c3d7b3305" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:46:32 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-75731a3d-3c78-4014-a8dc-f38c3d7b3305" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:46:32 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:46:32 user nova-compute[74805]: DEBUG nova.objects.instance [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lazy-loading 'info_cache' on Instance uuid 75731a3d-3c78-4014-a8dc-f38c3d7b3305 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:46:32 user nova-compute[74805]: DEBUG nova.compute.manager [None req-8ed692d7-1bc8-4e78-8d9d-6f80572bc729 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:46:33 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Updating instance_info_cache with network_info: [{"id": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "address": "fa:16:3e:8f:e3:f6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39aa6c19-c3", "ovs_interfaceid": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:46:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-75731a3d-3c78-4014-a8dc-f38c3d7b3305" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:46:33 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:46:33 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:46:35 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:46:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:36 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:46:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:46:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:46:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:46:36 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:46:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:46:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:46:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:46:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:46:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:46:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:46:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:46:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:46:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:46:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:46:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:46:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:46:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:46:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:46:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:46:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:46:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:46:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:46:38 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:46:38 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:46:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=8594MB free_disk=25.01300048828125GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:46:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:46:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:46:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 75731a3d-3c78-4014-a8dc-f38c3d7b3305 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:46:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:46:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:46:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 57f04f4b-b452-447f-a1dd-9244f08e9f35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:46:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:46:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:46:38 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Refreshing inventories for resource provider ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 04:46:38 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Updating ProviderTree inventory for provider ada87504-5552-4a33-b754-f9a54c67fe39 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 04:46:38 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Updating inventory in ProviderTree for provider ada87504-5552-4a33-b754-f9a54c67fe39 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 04:46:38 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Refreshing aggregate associations for resource provider ada87504-5552-4a33-b754-f9a54c67fe39, aggregates: None {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 04:46:38 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Refreshing trait associations for resource provider ada87504-5552-4a33-b754-f9a54c67fe39, traits: COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 04:46:38 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:46:38 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:46:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:46:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.525s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:46:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:41 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:46:41 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:46:41 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:46:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:46:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:47:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:47:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:47:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:47:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:47:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:47:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:47:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:47:27 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:47:28 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:47:29 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:47:29 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:47:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:47:32 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:47:34 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:47:34 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:47:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:47:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:47:34 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:47:34 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Updating instance_info_cache with network_info: [{"id": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "address": "fa:16:3e:c6:13:c6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9bd2e9-b1", "ovs_interfaceid": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:47:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:47:34 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:47:35 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:47:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:47:36 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:47:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:47:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:47:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:47:36 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:47:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:47:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:47:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:47:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:47:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:47:36 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:47:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:47:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:47:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:47:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:47:36 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:47:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:47:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:47:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:47:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:47:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:47:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:47:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:47:38 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:47:38 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:47:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=8627MB free_disk=25.012123107910156GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:47:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:47:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:47:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 75731a3d-3c78-4014-a8dc-f38c3d7b3305 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:47:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:47:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:47:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 57f04f4b-b452-447f-a1dd-9244f08e9f35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:47:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:47:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:47:38 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:47:38 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:47:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:47:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:47:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:47:41 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:47:41 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:47:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:47:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:47:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:47:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:48:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:48:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-bc757542-6b11-40ea-90cd-fa5cecff9750 req-fac2c88f-10c9-4aa7-bce5-e052149815d1 service nova] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Received event network-changed-809c4c39-ae65-4461-8631-3244606f1db8 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:48:00 user nova-compute[74805]: DEBUG nova.compute.manager [req-bc757542-6b11-40ea-90cd-fa5cecff9750 req-fac2c88f-10c9-4aa7-bce5-e052149815d1 service nova] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Refreshing instance network info cache due to event network-changed-809c4c39-ae65-4461-8631-3244606f1db8. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:48:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bc757542-6b11-40ea-90cd-fa5cecff9750 req-fac2c88f-10c9-4aa7-bce5-e052149815d1 service nova] Acquiring lock "refresh_cache-57f04f4b-b452-447f-a1dd-9244f08e9f35" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:48:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bc757542-6b11-40ea-90cd-fa5cecff9750 req-fac2c88f-10c9-4aa7-bce5-e052149815d1 service nova] Acquired lock "refresh_cache-57f04f4b-b452-447f-a1dd-9244f08e9f35" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:48:00 user nova-compute[74805]: DEBUG nova.network.neutron [req-bc757542-6b11-40ea-90cd-fa5cecff9750 req-fac2c88f-10c9-4aa7-bce5-e052149815d1 service nova] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Refreshing network info cache for port 809c4c39-ae65-4461-8631-3244606f1db8 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:48:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:48:01 user nova-compute[74805]: DEBUG nova.network.neutron [req-bc757542-6b11-40ea-90cd-fa5cecff9750 req-fac2c88f-10c9-4aa7-bce5-e052149815d1 service nova] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Updated VIF entry in instance network info cache for port 809c4c39-ae65-4461-8631-3244606f1db8. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:48:01 user nova-compute[74805]: DEBUG nova.network.neutron [req-bc757542-6b11-40ea-90cd-fa5cecff9750 req-fac2c88f-10c9-4aa7-bce5-e052149815d1 service nova] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Updating instance_info_cache with network_info: [{"id": "809c4c39-ae65-4461-8631-3244606f1db8", "address": "fa:16:3e:5b:05:fa", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809c4c39-ae", "ovs_interfaceid": "809c4c39-ae65-4461-8631-3244606f1db8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:48:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bc757542-6b11-40ea-90cd-fa5cecff9750 req-fac2c88f-10c9-4aa7-bce5-e052149815d1 service nova] Releasing lock "refresh_cache-57f04f4b-b452-447f-a1dd-9244f08e9f35" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:48:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "57f04f4b-b452-447f-a1dd-9244f08e9f35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:48:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "57f04f4b-b452-447f-a1dd-9244f08e9f35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:48:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "57f04f4b-b452-447f-a1dd-9244f08e9f35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:48:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "57f04f4b-b452-447f-a1dd-9244f08e9f35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:48:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "57f04f4b-b452-447f-a1dd-9244f08e9f35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:48:01 user nova-compute[74805]: INFO nova.compute.manager [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Terminating instance
Nov 15 04:48:01 user nova-compute[74805]: DEBUG nova.compute.manager [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:48:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:48:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:48:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:48:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:48:01 user nova-compute[74805]: DEBUG nova.compute.manager [req-40055733-0b3f-4e53-b55c-62293b136dd8 req-70116ad0-2490-4871-ba4c-bcbfb07b30bf service nova] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Received event network-vif-unplugged-809c4c39-ae65-4461-8631-3244606f1db8 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:48:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-40055733-0b3f-4e53-b55c-62293b136dd8 req-70116ad0-2490-4871-ba4c-bcbfb07b30bf service nova] Acquiring lock "57f04f4b-b452-447f-a1dd-9244f08e9f35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:48:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-40055733-0b3f-4e53-b55c-62293b136dd8 req-70116ad0-2490-4871-ba4c-bcbfb07b30bf service nova] Lock "57f04f4b-b452-447f-a1dd-9244f08e9f35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:48:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-40055733-0b3f-4e53-b55c-62293b136dd8 req-70116ad0-2490-4871-ba4c-bcbfb07b30bf service nova] Lock "57f04f4b-b452-447f-a1dd-9244f08e9f35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:48:01 user nova-compute[74805]: DEBUG nova.compute.manager [req-40055733-0b3f-4e53-b55c-62293b136dd8 req-70116ad0-2490-4871-ba4c-bcbfb07b30bf service nova] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] No waiting events found dispatching network-vif-unplugged-809c4c39-ae65-4461-8631-3244606f1db8 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:48:01 user nova-compute[74805]: DEBUG nova.compute.manager [req-40055733-0b3f-4e53-b55c-62293b136dd8 req-70116ad0-2490-4871-ba4c-bcbfb07b30bf service nova] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Received event network-vif-unplugged-809c4c39-ae65-4461-8631-3244606f1db8 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:48:02 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Instance destroyed successfully.
Nov 15 04:48:02 user nova-compute[74805]: DEBUG nova.objects.instance [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lazy-loading 'resources' on Instance uuid 57f04f4b-b452-447f-a1dd-9244f08e9f35 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:46:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-632470684',display_name='tempest-TestVolumeBootPattern-server-632470684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-632470684',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPSZsjBao2IiCSH6iNxCBnd9/tVkNXbrNJpEOjeMrEDWwanT/XX2Dcm8vpngfLnbfGhydqc2p2DnAgn/CCrGmL8T0FuaHg/KrFgmSAIbSmou7lS7rh9h9Z85pHvQBKirA==',key_name='tempest-TestVolumeBootPattern-1567239913',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:46:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2744859f249a4326ab6d268319a34b7f',ramdisk_id='',reservation_id='r-47w1ai5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2043506637',owner_user_name='tempest-TestVolumeBootPattern-2043506637-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:46:19Z,user_data=None,user_id='0bd96ecd9d404779ad64456c6517591f',uuid=57f04f4b-b452-447f-a1dd-9244f08e9f35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "809c4c39-ae65-4461-8631-3244606f1db8", "address": "fa:16:3e:5b:05:fa", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809c4c39-ae", "ovs_interfaceid": "809c4c39-ae65-4461-8631-3244606f1db8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converting VIF {"id": "809c4c39-ae65-4461-8631-3244606f1db8", "address": "fa:16:3e:5b:05:fa", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809c4c39-ae", "ovs_interfaceid": "809c4c39-ae65-4461-8631-3244606f1db8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:05:fa,bridge_name='br-int',has_traffic_filtering=True,id=809c4c39-ae65-4461-8631-3244606f1db8,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809c4c39-ae') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG os_vif [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:05:fa,bridge_name='br-int',has_traffic_filtering=True,id=809c4c39-ae65-4461-8631-3244606f1db8,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809c4c39-ae') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap809c4c39-ae, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1630d13f-888a-4c59-9ce9-aa05ac2819a9) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:48:02 user nova-compute[74805]: INFO os_vif [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:05:fa,bridge_name='br-int',has_traffic_filtering=True,id=809c4c39-ae65-4461-8631-3244606f1db8,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809c4c39-ae')
Nov 15 04:48:02 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WziNdebE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:48:02 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:48:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11deb63-8136-45b1-ac68-b1722f0edd90]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:48:02 user nova-compute[74805]: No targets found.
Nov 15 04:48:02 user nova-compute[74805]: iSNS:
Nov 15 04:48:02 user nova-compute[74805]: No targets found.
Nov 15 04:48:02 user nova-compute[74805]: STATIC:
Nov 15 04:48:02 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f
Nov 15 04:48:02 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:48:02 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:48:02 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb
Nov 15 04:48:02 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:48:02 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:48:02 user nova-compute[74805]: FIRMWARE:
Nov 15 04:48:02 user nova-compute[74805]: No targets found.
Nov 15 04:48:02 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:48:02 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:48:02 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d112a1f7-9b03-490b-b402-9a45490cd6f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e35ee9-a3f8-4919-a525-665bc3b46f15]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb (non-flash)
Nov 15 04:48:02 user nova-compute[74805]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f (non-flash)
Nov 15 04:48:02 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb (non-flash)
Nov 15 04:48:02 user nova-compute[74805]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f (non-flash)
Nov 15 04:48:02 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c1320e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f'): ({'sdc'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Removing single pathed devices sdc {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee3c6c4-5624-4e43-b8e5-25f505f6dc58]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46c42f5-f96d-4875-8222-7418566a3612]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Flushing IO for device /dev/sdc {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e785c1-2f5a-44f0-af1c-05a87156a9ca]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7230eab-3362-4dc9-be7b-3a11881f9e49]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26130306136366536', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d47a30ff', '/dev/disk/by-id/scsi-1SCST_BIOd47a30ff-a00a66e6c2999b16') {{(pid=85029) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fe9ece-c795-4ab6-93ee-5e1b38d7bf76]: (4, None) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1496e03-53d9-4154-97e0-25ef4392c034]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf6d503-17aa-4a4f-86c2-166da0026f07]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f, portal: 172.16.0.220,3260]
Nov 15 04:48:02 user nova-compute[74805]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f, portal: 172.16.0.220,3260] successful.
Nov 15 04:48:02 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[603321e5-3d5d-4176-9f08-667071208d3b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] <== disconnect_volume: return (316ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:48:02 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Deleting instance files /opt/stack/data/nova/instances/57f04f4b-b452-447f-a1dd-9244f08e9f35_del
Nov 15 04:48:02 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Deletion of /opt/stack/data/nova/instances/57f04f4b-b452-447f-a1dd-9244f08e9f35_del complete
Nov 15 04:48:02 user nova-compute[74805]: INFO nova.compute.manager [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 15 04:48:02 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:48:02 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:48:03 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:48:03 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Took 0.82 seconds to deallocate network for instance.
Nov 15 04:48:03 user nova-compute[74805]: DEBUG nova.compute.manager [req-022f9e15-6d96-4b65-a184-2539b92b5d61 req-b0b1db97-91be-4b66-9961-8673c51ffcf9 service nova] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Received event network-vif-deleted-809c4c39-ae65-4461-8631-3244606f1db8 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:48:03 user nova-compute[74805]: INFO nova.compute.manager [req-022f9e15-6d96-4b65-a184-2539b92b5d61 req-b0b1db97-91be-4b66-9961-8673c51ffcf9 service nova] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Neutron deleted interface 809c4c39-ae65-4461-8631-3244606f1db8; detaching it from the instance and deleting it from the info cache
Nov 15 04:48:03 user nova-compute[74805]: DEBUG nova.network.neutron [req-022f9e15-6d96-4b65-a184-2539b92b5d61 req-b0b1db97-91be-4b66-9961-8673c51ffcf9 service nova] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:48:03 user nova-compute[74805]: DEBUG nova.compute.manager [req-022f9e15-6d96-4b65-a184-2539b92b5d61 req-b0b1db97-91be-4b66-9961-8673c51ffcf9 service nova] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Detach interface failed, port_id=809c4c39-ae65-4461-8631-3244606f1db8, reason: Instance 57f04f4b-b452-447f-a1dd-9244f08e9f35 could not be found. {{(pid=74805) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 04:48:03 user nova-compute[74805]: DEBUG nova.compute.manager [req-92c860e7-f042-4f13-b4b1-4a2d0b970aee req-f6b486ee-0873-40d3-9f47-2c3f5fa44625 service nova] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Received event network-vif-plugged-809c4c39-ae65-4461-8631-3244606f1db8 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:48:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-92c860e7-f042-4f13-b4b1-4a2d0b970aee req-f6b486ee-0873-40d3-9f47-2c3f5fa44625 service nova] Acquiring lock "57f04f4b-b452-447f-a1dd-9244f08e9f35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:48:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-92c860e7-f042-4f13-b4b1-4a2d0b970aee req-f6b486ee-0873-40d3-9f47-2c3f5fa44625 service nova] Lock "57f04f4b-b452-447f-a1dd-9244f08e9f35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:48:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-92c860e7-f042-4f13-b4b1-4a2d0b970aee req-f6b486ee-0873-40d3-9f47-2c3f5fa44625 service nova] Lock "57f04f4b-b452-447f-a1dd-9244f08e9f35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:48:03 user nova-compute[74805]: DEBUG nova.compute.manager [req-92c860e7-f042-4f13-b4b1-4a2d0b970aee req-f6b486ee-0873-40d3-9f47-2c3f5fa44625 service nova] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] No waiting events found dispatching network-vif-plugged-809c4c39-ae65-4461-8631-3244606f1db8 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:48:03 user nova-compute[74805]: WARNING nova.compute.manager [req-92c860e7-f042-4f13-b4b1-4a2d0b970aee req-f6b486ee-0873-40d3-9f47-2c3f5fa44625 service nova] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Received unexpected event network-vif-plugged-809c4c39-ae65-4461-8631-3244606f1db8 for instance with vm_state active and task_state deleting.
Nov 15 04:48:04 user nova-compute[74805]: INFO nova.compute.manager [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 57f04f4b-b452-447f-a1dd-9244f08e9f35] Took 0.70 seconds to detach 1 volumes for instance.
Nov 15 04:48:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:48:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:48:04 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:48:04 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:48:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:48:04 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Deleted allocations for instance 57f04f4b-b452-447f-a1dd-9244f08e9f35
Nov 15 04:48:04 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-30413937-b8f2-4041-ab91-5f94cf146315 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "57f04f4b-b452-447f-a1dd-9244f08e9f35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.109s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:48:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:48:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:48:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:48:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:48:19 user nova-compute[74805]: DEBUG nova.compute.manager [req-844bab60-61d0-4dea-913a-4b78b70a1f3b req-50e6adf8-70fe-413a-b3f1-e05760b8ddb5 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Received event network-changed-375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:48:19 user nova-compute[74805]: DEBUG nova.compute.manager [req-844bab60-61d0-4dea-913a-4b78b70a1f3b req-50e6adf8-70fe-413a-b3f1-e05760b8ddb5 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Refreshing instance network info cache due to event network-changed-375372d2-cb40-4701-be3c-528d0ad92cbf. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:48:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-844bab60-61d0-4dea-913a-4b78b70a1f3b req-50e6adf8-70fe-413a-b3f1-e05760b8ddb5 service nova] Acquiring lock "refresh_cache-0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:48:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-844bab60-61d0-4dea-913a-4b78b70a1f3b req-50e6adf8-70fe-413a-b3f1-e05760b8ddb5 service nova] Acquired lock "refresh_cache-0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:48:19 user nova-compute[74805]: DEBUG nova.network.neutron [req-844bab60-61d0-4dea-913a-4b78b70a1f3b req-50e6adf8-70fe-413a-b3f1-e05760b8ddb5 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Refreshing network info cache for port 375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:48:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:48:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:48:19 user nova-compute[74805]: INFO nova.compute.manager [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Detaching volume 2a40ae0b-4251-4fd8-8d7e-04f8b40364fb
Nov 15 04:48:19 user nova-compute[74805]: DEBUG nova.network.neutron [req-844bab60-61d0-4dea-913a-4b78b70a1f3b req-50e6adf8-70fe-413a-b3f1-e05760b8ddb5 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Updated VIF entry in instance network info cache for port 375372d2-cb40-4701-be3c-528d0ad92cbf. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:48:19 user nova-compute[74805]: DEBUG nova.network.neutron [req-844bab60-61d0-4dea-913a-4b78b70a1f3b req-50e6adf8-70fe-413a-b3f1-e05760b8ddb5 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Updating instance_info_cache with network_info: [{"id": "375372d2-cb40-4701-be3c-528d0ad92cbf", "address": "fa:16:3e:7f:bb:a8", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375372d2-cb", "ovs_interfaceid": "375372d2-cb40-4701-be3c-528d0ad92cbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:48:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-844bab60-61d0-4dea-913a-4b78b70a1f3b req-50e6adf8-70fe-413a-b3f1-e05760b8ddb5 service nova] Releasing lock "refresh_cache-0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:48:19 user nova-compute[74805]: INFO nova.virt.block_device [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Attempting to driver detach volume 2a40ae0b-4251-4fd8-8d7e-04f8b40364fb from mountpoint /dev/vdb
Nov 15 04:48:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Attempting to detach device vdb from instance 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9 from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:48:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:48:19 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:48:19 user nova-compute[74805]:   <source dev="/dev/sdb"/>
Nov 15 04:48:19 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:48:19 user nova-compute[74805]:   <serial>2a40ae0b-4251-4fd8-8d7e-04f8b40364fb</serial>
Nov 15 04:48:19 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:48:19 user nova-compute[74805]: </disk>
Nov 15 04:48:19 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:48:19 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Successfully detached device vdb from instance 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9 from the persistent domain config.
Nov 15 04:48:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9 from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:48:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:48:19 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:48:19 user nova-compute[74805]:   <source dev="/dev/sdb"/>
Nov 15 04:48:19 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:48:19 user nova-compute[74805]:   <serial>2a40ae0b-4251-4fd8-8d7e-04f8b40364fb</serial>
Nov 15 04:48:19 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:48:19 user nova-compute[74805]: </disk>
Nov 15 04:48:19 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:48:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9 {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:48:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:48:21 user nova-compute[74805]: DEBUG nova.compute.manager [req-91e06f01-7d8a-48e9-b3df-9a0316b9f646 req-f5ff61ad-e448-4ef8-9ace-0c1bb4e170c2 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Received event network-changed-375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:48:21 user nova-compute[74805]: DEBUG nova.compute.manager [req-91e06f01-7d8a-48e9-b3df-9a0316b9f646 req-f5ff61ad-e448-4ef8-9ace-0c1bb4e170c2 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Refreshing instance network info cache due to event network-changed-375372d2-cb40-4701-be3c-528d0ad92cbf. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:48:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-91e06f01-7d8a-48e9-b3df-9a0316b9f646 req-f5ff61ad-e448-4ef8-9ace-0c1bb4e170c2 service nova] Acquiring lock "refresh_cache-0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:48:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-91e06f01-7d8a-48e9-b3df-9a0316b9f646 req-f5ff61ad-e448-4ef8-9ace-0c1bb4e170c2 service nova] Acquired lock "refresh_cache-0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:48:21 user nova-compute[74805]: DEBUG nova.network.neutron [req-91e06f01-7d8a-48e9-b3df-9a0316b9f646 req-f5ff61ad-e448-4ef8-9ace-0c1bb4e170c2 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Refreshing network info cache for port 375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:48:21 user nova-compute[74805]: DEBUG nova.network.neutron [req-91e06f01-7d8a-48e9-b3df-9a0316b9f646 req-f5ff61ad-e448-4ef8-9ace-0c1bb4e170c2 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Updated VIF entry in instance network info cache for port 375372d2-cb40-4701-be3c-528d0ad92cbf. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:48:21 user nova-compute[74805]: DEBUG nova.network.neutron [req-91e06f01-7d8a-48e9-b3df-9a0316b9f646 req-f5ff61ad-e448-4ef8-9ace-0c1bb4e170c2 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Updating instance_info_cache with network_info: [{"id": "375372d2-cb40-4701-be3c-528d0ad92cbf", "address": "fa:16:3e:7f:bb:a8", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375372d2-cb", "ovs_interfaceid": "375372d2-cb40-4701-be3c-528d0ad92cbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:48:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-91e06f01-7d8a-48e9-b3df-9a0316b9f646 req-f5ff61ad-e448-4ef8-9ace-0c1bb4e170c2 service nova] Releasing lock "refresh_cache-0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:48:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:48:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:48:28 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:48:29 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:48:29 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:48:29 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:48:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:48:34 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:48:36 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:48:36 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:48:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:48:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:48:36 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:48:36 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Updating instance_info_cache with network_info: [{"id": "375372d2-cb40-4701-be3c-528d0ad92cbf", "address": "fa:16:3e:7f:bb:a8", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375372d2-cb", "ovs_interfaceid": "375372d2-cb40-4701-be3c-528d0ad92cbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:48:36 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:48:36 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:48:36 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:48:37 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:48:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:48:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:48:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:48:37 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:48:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:48:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:38 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:48:38 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:48:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=8768MB free_disk=25.011119842529297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:48:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:48:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:48:39 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 75731a3d-3c78-4014-a8dc-f38c3d7b3305 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:48:39 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:48:39 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:48:39 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:48:39 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:48:39 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:48:39 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:48:39 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:48:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:48:40 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9 is timed out.
Nov 15 04:48:40 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Successfully detached device vdb from instance 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9 from the live domain config.
Nov 15 04:48:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ywKPUnYD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:48:40 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:48:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ab6cc6-eb97-4c5a-a806-a06496baa566]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:48:40 user nova-compute[74805]: No targets found.
Nov 15 04:48:40 user nova-compute[74805]: iSNS:
Nov 15 04:48:40 user nova-compute[74805]: No targets found.
Nov 15 04:48:40 user nova-compute[74805]: STATIC:
Nov 15 04:48:40 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb
Nov 15 04:48:40 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:48:40 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:48:40 user nova-compute[74805]: FIRMWARE:
Nov 15 04:48:40 user nova-compute[74805]: No targets found.
Nov 15 04:48:40 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:48:40 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:48:40 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c2c6be-638c-4782-aadc-891e45f40657]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[921c1b13-6c0a-4094-83cb-a2f2d0a1e995]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb (non-flash)
Nov 15 04:48:40 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb (non-flash)
Nov 15 04:48:40 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f787a7ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb'): ({'sdb'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Removing single pathed devices sdb {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c901c100-0918-4914-8228-21b3f6513251]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e2bcf4-120e-4d5e-a61b-66bf22e6134a]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Flushing IO for device /dev/sdb {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c8c42c-a0ff-4a1c-9360-a7e7653f363e]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[455ccc04-3212-4445-86df-5cdbe0480a1e]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8e4b19-2bf2-4b1f-a1dd-4c6d8d86c4c6]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3266c86-9fc6-46a4-a9ab-7a96cb965a21]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb, portal: 172.16.0.220,3260]
Nov 15 04:48:40 user nova-compute[74805]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb, portal: 172.16.0.220,3260] successful.
Nov 15 04:48:40 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ae0b-4251-4fd8-8d7e-04f8b40364fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b779410f-83fe-4207-89aa-40dfd796e837]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] <== disconnect_volume: return (267ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:48:40 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:48:41 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:48:41 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:48:41 user nova-compute[74805]: DEBUG nova.objects.instance [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lazy-loading 'flavor' on Instance uuid 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:48:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-00026fb0-b386-4317-9f6c-7ba8bf2a6e3f tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.595s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:48:42 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:48:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:48:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:48:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:48:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "f53096c2-b75c-48ca-8ca9-30cb92ee2733" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:48:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "f53096c2-b75c-48ca-8ca9-30cb92ee2733" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:48:53 user nova-compute[74805]: DEBUG nova.compute.manager [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:48:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:48:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:48:53 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:48:53 user nova-compute[74805]: INFO nova.compute.claims [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Claim successful on node user
Nov 15 04:48:53 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:48:53 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:48:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:48:53 user nova-compute[74805]: DEBUG nova.compute.manager [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:48:53 user nova-compute[74805]: DEBUG nova.compute.manager [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:48:53 user nova-compute[74805]: DEBUG nova.network.neutron [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:48:54 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:48:54 user nova-compute[74805]: DEBUG nova.compute.manager [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:48:54 user nova-compute[74805]: DEBUG nova.policy [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bd96ecd9d404779ad64456c6517591f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2744859f249a4326ab6d268319a34b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:48:54 user nova-compute[74805]: INFO nova.virt.block_device [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Booting with volume ddff8d6c-cbbb-45d2-8883-a5cd5db9478f at /dev/vda
Nov 15 04:48:54 user nova-compute[74805]: DEBUG os_brick.utils [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:48:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b1f694-4320-4702-b380-430eb4d0311e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a51e865-bcc6-40fd-8da2-b1c6693fbfa4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82e8f8a-28bc-4cfc-81ce-7134d93e816d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f694dc50-ff48-4a99-b297-c529c94372a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:48:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:48:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:48:54 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:48:54 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad86efa-a5d5-427e-94ba-f8e2ca3a341b]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:48:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:48:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:48:54 user nova-compute[74805]: DEBUG os_brick.utils [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:48:54 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Updating existing volume attachment record: b9bd3c11-ea91-40b1-9c8f-c7081707140d {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:48:54 user nova-compute[74805]: DEBUG nova.network.neutron [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Successfully created port: dcfd0e9b-4eb7-456d-a50f-2e14b1763e56 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:48:55 user nova-compute[74805]: DEBUG nova.network.neutron [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Successfully updated port: dcfd0e9b-4eb7-456d-a50f-2e14b1763e56 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:48:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "refresh_cache-f53096c2-b75c-48ca-8ca9-30cb92ee2733" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:48:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquired lock "refresh_cache-f53096c2-b75c-48ca-8ca9-30cb92ee2733" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:48:55 user nova-compute[74805]: DEBUG nova.network.neutron [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:48:55 user nova-compute[74805]: DEBUG nova.compute.manager [req-73247886-67a7-417d-998b-5faf19d1ed6a req-45b7c946-1820-482c-a1e0-bd4bc0dc6a02 service nova] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Received event network-changed-dcfd0e9b-4eb7-456d-a50f-2e14b1763e56 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:48:55 user nova-compute[74805]: DEBUG nova.compute.manager [req-73247886-67a7-417d-998b-5faf19d1ed6a req-45b7c946-1820-482c-a1e0-bd4bc0dc6a02 service nova] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Refreshing instance network info cache due to event network-changed-dcfd0e9b-4eb7-456d-a50f-2e14b1763e56. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:48:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-73247886-67a7-417d-998b-5faf19d1ed6a req-45b7c946-1820-482c-a1e0-bd4bc0dc6a02 service nova] Acquiring lock "refresh_cache-f53096c2-b75c-48ca-8ca9-30cb92ee2733" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:48:55 user nova-compute[74805]: DEBUG nova.network.neutron [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:48:55 user nova-compute[74805]: DEBUG nova.network.neutron [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Updating instance_info_cache with network_info: [{"id": "dcfd0e9b-4eb7-456d-a50f-2e14b1763e56", "address": "fa:16:3e:33:b1:4f", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfd0e9b-4e", "ovs_interfaceid": "dcfd0e9b-4eb7-456d-a50f-2e14b1763e56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:48:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Releasing lock "refresh_cache-f53096c2-b75c-48ca-8ca9-30cb92ee2733" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:48:55 user nova-compute[74805]: DEBUG nova.compute.manager [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Instance network_info: |[{"id": "dcfd0e9b-4eb7-456d-a50f-2e14b1763e56", "address": "fa:16:3e:33:b1:4f", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfd0e9b-4e", "ovs_interfaceid": "dcfd0e9b-4eb7-456d-a50f-2e14b1763e56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:48:55 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-73247886-67a7-417d-998b-5faf19d1ed6a req-45b7c946-1820-482c-a1e0-bd4bc0dc6a02 service nova] Acquired lock "refresh_cache-f53096c2-b75c-48ca-8ca9-30cb92ee2733" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:48:55 user nova-compute[74805]: DEBUG nova.network.neutron [req-73247886-67a7-417d-998b-5faf19d1ed6a req-45b7c946-1820-482c-a1e0-bd4bc0dc6a02 service nova] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Refreshing network info cache for port dcfd0e9b-4eb7-456d-a50f-2e14b1763e56 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:48:56 user nova-compute[74805]: DEBUG nova.network.neutron [req-73247886-67a7-417d-998b-5faf19d1ed6a req-45b7c946-1820-482c-a1e0-bd4bc0dc6a02 service nova] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Updated VIF entry in instance network info cache for port dcfd0e9b-4eb7-456d-a50f-2e14b1763e56. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:48:56 user nova-compute[74805]: DEBUG nova.network.neutron [req-73247886-67a7-417d-998b-5faf19d1ed6a req-45b7c946-1820-482c-a1e0-bd4bc0dc6a02 service nova] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Updating instance_info_cache with network_info: [{"id": "dcfd0e9b-4eb7-456d-a50f-2e14b1763e56", "address": "fa:16:3e:33:b1:4f", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfd0e9b-4e", "ovs_interfaceid": "dcfd0e9b-4eb7-456d-a50f-2e14b1763e56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:48:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-73247886-67a7-417d-998b-5faf19d1ed6a req-45b7c946-1820-482c-a1e0-bd4bc0dc6a02 service nova] Releasing lock "refresh_cache-f53096c2-b75c-48ca-8ca9-30cb92ee2733" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:48:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG nova.compute.manager [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:48:58 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Creating image(s)
Nov 15 04:48:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Did not create local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Ensure instance console log exists: /opt/stack/data/nova/instances/f53096c2-b75c-48ca-8ca9-30cb92ee2733/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Start _get_guest_xml network_info=[{"id": "dcfd0e9b-4eb7-456d-a50f-2e14b1763e56", "address": "fa:16:3e:33:b1:4f", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfd0e9b-4e", "ovs_interfaceid": "dcfd0e9b-4eb7-456d-a50f-2e14b1763e56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WziNdebE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f53096c2-b75c-48ca-8ca9-30cb92ee2733', 'attached_at': '', 'detached_at': '', 'volume_id': 'ddff8d6c-cbbb-45d2-8883-a5cd5db9478f', 'serial': 'ddff8d6c-cbbb-45d2-8883-a5cd5db9478f'}, 'delete_on_termination': False, 'attachment_id': 'b9bd3c11-ea91-40b1-9c8f-c7081707140d', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:48:58 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:48:58 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:48:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WziNdebE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:48:58 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:48:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:48:58 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:48:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:48:58 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:48:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2f7dc4-27ac-4ed2-a0f7-723a5b291e6a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:48:58 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37f5b92-77d2-413d-9a32-217c24d7cc4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f] added
Nov 15 04:48:58 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:48:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1990b244-69f4-43fc-86bd-3d23f1af4a90]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce9eee2-21fa-41fd-82e5-3dbb9a45f9b5]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WziNdebE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WziNdebE" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dada7d-d48c-47b7-a7fd-9ae9b759ec4a]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WziNdebE'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4858333a-66cf-40f9-af7b-5f4ca58e6697]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82982a7-6e9d-4687-a321-4c6fd5eaa609]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 04:48:59 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 04:48:59 user nova-compute[74805]:  {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:48:59 user nova-compute[74805]: WARNING os_brick.initiator.connectors.iscsi [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 04:48:59 user nova-compute[74805]: 
Nov 15 04:48:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[90225e81-6c00-44ac-a95b-fd8d9eb992ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f, portal: 172.16.0.220,3260]
Nov 15 04:48:59 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f, portal: 172.16.0.220,3260] successful.
Nov 15 04:48:59 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ae29fb-5e93-4ad9-ad3c-f0df5a5cd004]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d16786d-9567-4e45-bead-c7f64736fd3f]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f (non-flash)
Nov 15 04:48:59 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f (non-flash)
Nov 15 04:48:59 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0014199-9dda-4217-bcf9-aa9a50f9e420]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:48:59 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WziNdebE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:49:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:49:00 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26130306136366536', 'path': '/dev/sdb'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:49:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130306136366536', 'path': '/dev/sdb'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:49:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:48:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-283977774',display_name='tempest-TestVolumeBootPattern-server-283977774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-283977774',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPSZsjBao2IiCSH6iNxCBnd9/tVkNXbrNJpEOjeMrEDWwanT/XX2Dcm8vpngfLnbfGhydqc2p2DnAgn/CCrGmL8T0FuaHg/KrFgmSAIbSmou7lS7rh9h9Z85pHvQBKirA==',key_name='tempest-TestVolumeBootPattern-1567239913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2744859f249a4326ab6d268319a34b7f',ramdisk_id='',reservation_id='r-hl800ok3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2043506637',owner_user_name='tempest-TestVolumeBootPattern-2043506637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:48:54Z,user_data=None,user_id='0bd96ecd9d404779ad64456c6517591f',uuid=f53096c2-b75c-48ca-8ca9-30cb92ee2733,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcfd0e9b-4eb7-456d-a50f-2e14b1763e56", "address": "fa:16:3e:33:b1:4f", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfd0e9b-4e", "ovs_interfaceid": "dcfd0e9b-4eb7-456d-a50f-2e14b1763e56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:49:00 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converting VIF {"id": "dcfd0e9b-4eb7-456d-a50f-2e14b1763e56", "address": "fa:16:3e:33:b1:4f", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfd0e9b-4e", "ovs_interfaceid": "dcfd0e9b-4eb7-456d-a50f-2e14b1763e56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:49:00 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:b1:4f,bridge_name='br-int',has_traffic_filtering=True,id=dcfd0e9b-4eb7-456d-a50f-2e14b1763e56,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfd0e9b-4e') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:49:00 user nova-compute[74805]: DEBUG nova.objects.instance [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lazy-loading 'pci_devices' on Instance uuid f53096c2-b75c-48ca-8ca9-30cb92ee2733 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:49:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:49:00 user nova-compute[74805]:   <uuid>f53096c2-b75c-48ca-8ca9-30cb92ee2733</uuid>
Nov 15 04:49:00 user nova-compute[74805]:   <name>instance-00000033</name>
Nov 15 04:49:00 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:49:00 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:49:00 user nova-compute[74805]:   <metadata>
Nov 15 04:49:00 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:49:00 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:49:00 user nova-compute[74805]:       <nova:name>tempest-TestVolumeBootPattern-server-283977774</nova:name>
Nov 15 04:49:00 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:48:58</nova:creationTime>
Nov 15 04:49:00 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:49:00 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:49:00 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:49:00 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:49:00 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:49:00 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:49:00 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:49:00 user nova-compute[74805]:       <nova:owner>
Nov 15 04:49:00 user nova-compute[74805]:         <nova:user uuid="0bd96ecd9d404779ad64456c6517591f">tempest-TestVolumeBootPattern-2043506637-project-member</nova:user>
Nov 15 04:49:00 user nova-compute[74805]:         <nova:project uuid="2744859f249a4326ab6d268319a34b7f">tempest-TestVolumeBootPattern-2043506637</nova:project>
Nov 15 04:49:00 user nova-compute[74805]:       </nova:owner>
Nov 15 04:49:00 user nova-compute[74805]:       <nova:ports>
Nov 15 04:49:00 user nova-compute[74805]:         <nova:port uuid="dcfd0e9b-4eb7-456d-a50f-2e14b1763e56">
Nov 15 04:49:00 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 04:49:00 user nova-compute[74805]:         </nova:port>
Nov 15 04:49:00 user nova-compute[74805]:       </nova:ports>
Nov 15 04:49:00 user nova-compute[74805]:     </nova:instance>
Nov 15 04:49:00 user nova-compute[74805]:   </metadata>
Nov 15 04:49:00 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:49:00 user nova-compute[74805]:     <system>
Nov 15 04:49:00 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:49:00 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:49:00 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:49:00 user nova-compute[74805]:       <entry name="serial">f53096c2-b75c-48ca-8ca9-30cb92ee2733</entry>
Nov 15 04:49:00 user nova-compute[74805]:       <entry name="uuid">f53096c2-b75c-48ca-8ca9-30cb92ee2733</entry>
Nov 15 04:49:00 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:49:00 user nova-compute[74805]:     </system>
Nov 15 04:49:00 user nova-compute[74805]:   </sysinfo>
Nov 15 04:49:00 user nova-compute[74805]:   <os>
Nov 15 04:49:00 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:49:00 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:49:00 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:49:00 user nova-compute[74805]:   </os>
Nov 15 04:49:00 user nova-compute[74805]:   <features>
Nov 15 04:49:00 user nova-compute[74805]:     <acpi/>
Nov 15 04:49:00 user nova-compute[74805]:     <apic/>
Nov 15 04:49:00 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:49:00 user nova-compute[74805]:   </features>
Nov 15 04:49:00 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:49:00 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:49:00 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:49:00 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:49:00 user nova-compute[74805]:   </clock>
Nov 15 04:49:00 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:49:00 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:49:00 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:49:00 user nova-compute[74805]:   </cpu>
Nov 15 04:49:00 user nova-compute[74805]:   <devices>
Nov 15 04:49:00 user nova-compute[74805]:     <disk type="block" device="disk">
Nov 15 04:49:00 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:49:00 user nova-compute[74805]:       <source dev="/dev/sdb"/>
Nov 15 04:49:00 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:49:00 user nova-compute[74805]:       <serial>ddff8d6c-cbbb-45d2-8883-a5cd5db9478f</serial>
Nov 15 04:49:00 user nova-compute[74805]:     </disk>
Nov 15 04:49:00 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:49:00 user nova-compute[74805]:       <mac address="fa:16:3e:33:b1:4f"/>
Nov 15 04:49:00 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:49:00 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:49:00 user nova-compute[74805]:       <target dev="tapdcfd0e9b-4e"/>
Nov 15 04:49:00 user nova-compute[74805]:     </interface>
Nov 15 04:49:00 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:49:00 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/f53096c2-b75c-48ca-8ca9-30cb92ee2733/console.log" append="off"/>
Nov 15 04:49:00 user nova-compute[74805]:     </serial>
Nov 15 04:49:00 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:49:00 user nova-compute[74805]:     <video>
Nov 15 04:49:00 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:49:00 user nova-compute[74805]:     </video>
Nov 15 04:49:00 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:49:00 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:49:00 user nova-compute[74805]:     </rng>
Nov 15 04:49:00 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:49:00 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:49:00 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:49:00 user nova-compute[74805]:     </memballoon>
Nov 15 04:49:00 user nova-compute[74805]:   </devices>
Nov 15 04:49:00 user nova-compute[74805]: </domain>
Nov 15 04:49:00 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:49:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:48:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-283977774',display_name='tempest-TestVolumeBootPattern-server-283977774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-283977774',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPSZsjBao2IiCSH6iNxCBnd9/tVkNXbrNJpEOjeMrEDWwanT/XX2Dcm8vpngfLnbfGhydqc2p2DnAgn/CCrGmL8T0FuaHg/KrFgmSAIbSmou7lS7rh9h9Z85pHvQBKirA==',key_name='tempest-TestVolumeBootPattern-1567239913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2744859f249a4326ab6d268319a34b7f',ramdisk_id='',reservation_id='r-hl800ok3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2043506637',owner_user_name='tempest-TestVolumeBootPattern-2043506637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:48:54Z,user_data=None,user_id='0bd96ecd9d404779ad64456c6517591f',uuid=f53096c2-b75c-48ca-8ca9-30cb92ee2733,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcfd0e9b-4eb7-456d-a50f-2e14b1763e56", "address": "fa:16:3e:33:b1:4f", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfd0e9b-4e", "ovs_interfaceid": "dcfd0e9b-4eb7-456d-a50f-2e14b1763e56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:49:00 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converting VIF {"id": "dcfd0e9b-4eb7-456d-a50f-2e14b1763e56", "address": "fa:16:3e:33:b1:4f", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfd0e9b-4e", "ovs_interfaceid": "dcfd0e9b-4eb7-456d-a50f-2e14b1763e56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:49:00 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:b1:4f,bridge_name='br-int',has_traffic_filtering=True,id=dcfd0e9b-4eb7-456d-a50f-2e14b1763e56,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfd0e9b-4e') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:49:00 user nova-compute[74805]: DEBUG os_vif [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:b1:4f,bridge_name='br-int',has_traffic_filtering=True,id=dcfd0e9b-4eb7-456d-a50f-2e14b1763e56,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfd0e9b-4e') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:49:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:49:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:49:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f97a5b4-9165-5631-a6ba-fa007a032cd9', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:49:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:49:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdcfd0e9b-4e, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:49:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdcfd0e9b-4e, col_values=(('qos', UUID('2a3b5cdc-c12b-4f27-806e-b57c7a368399')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:49:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdcfd0e9b-4e, col_values=(('external_ids', {'iface-id': 'dcfd0e9b-4eb7-456d-a50f-2e14b1763e56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:b1:4f', 'vm-uuid': 'f53096c2-b75c-48ca-8ca9-30cb92ee2733'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:49:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:49:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:00 user nova-compute[74805]: INFO os_vif [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:b1:4f,bridge_name='br-int',has_traffic_filtering=True,id=dcfd0e9b-4eb7-456d-a50f-2e14b1763e56,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfd0e9b-4e')
Nov 15 04:49:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:49:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] No VIF found with MAC fa:16:3e:33:b1:4f, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:49:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:01 user nova-compute[74805]: DEBUG nova.compute.manager [req-936c3231-8bb7-4e99-a6c2-a9aca4e93cf4 req-f0b69fe5-f953-41f4-9490-ec2639414cf9 service nova] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Received event network-vif-plugged-dcfd0e9b-4eb7-456d-a50f-2e14b1763e56 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:49:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-936c3231-8bb7-4e99-a6c2-a9aca4e93cf4 req-f0b69fe5-f953-41f4-9490-ec2639414cf9 service nova] Acquiring lock "f53096c2-b75c-48ca-8ca9-30cb92ee2733-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:49:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-936c3231-8bb7-4e99-a6c2-a9aca4e93cf4 req-f0b69fe5-f953-41f4-9490-ec2639414cf9 service nova] Lock "f53096c2-b75c-48ca-8ca9-30cb92ee2733-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:49:01 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-936c3231-8bb7-4e99-a6c2-a9aca4e93cf4 req-f0b69fe5-f953-41f4-9490-ec2639414cf9 service nova] Lock "f53096c2-b75c-48ca-8ca9-30cb92ee2733-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:49:01 user nova-compute[74805]: DEBUG nova.compute.manager [req-936c3231-8bb7-4e99-a6c2-a9aca4e93cf4 req-f0b69fe5-f953-41f4-9490-ec2639414cf9 service nova] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] No waiting events found dispatching network-vif-plugged-dcfd0e9b-4eb7-456d-a50f-2e14b1763e56 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:49:01 user nova-compute[74805]: WARNING nova.compute.manager [req-936c3231-8bb7-4e99-a6c2-a9aca4e93cf4 req-f0b69fe5-f953-41f4-9490-ec2639414cf9 service nova] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Received unexpected event network-vif-plugged-dcfd0e9b-4eb7-456d-a50f-2e14b1763e56 for instance with vm_state building and task_state spawning.
Nov 15 04:49:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:03 user nova-compute[74805]: DEBUG nova.compute.manager [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:49:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:49:03 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Instance spawned successfully.
Nov 15 04:49:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:49:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:49:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:49:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:49:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:49:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:49:03 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:49:03 user nova-compute[74805]: DEBUG nova.compute.manager [req-d2007c30-e928-4323-85c2-af7fc6e87fbc req-96f80230-c011-4aa0-8274-7d39a61cbbb0 service nova] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Received event network-vif-plugged-dcfd0e9b-4eb7-456d-a50f-2e14b1763e56 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:49:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d2007c30-e928-4323-85c2-af7fc6e87fbc req-96f80230-c011-4aa0-8274-7d39a61cbbb0 service nova] Acquiring lock "f53096c2-b75c-48ca-8ca9-30cb92ee2733-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:49:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d2007c30-e928-4323-85c2-af7fc6e87fbc req-96f80230-c011-4aa0-8274-7d39a61cbbb0 service nova] Lock "f53096c2-b75c-48ca-8ca9-30cb92ee2733-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:49:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d2007c30-e928-4323-85c2-af7fc6e87fbc req-96f80230-c011-4aa0-8274-7d39a61cbbb0 service nova] Lock "f53096c2-b75c-48ca-8ca9-30cb92ee2733-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:49:03 user nova-compute[74805]: DEBUG nova.compute.manager [req-d2007c30-e928-4323-85c2-af7fc6e87fbc req-96f80230-c011-4aa0-8274-7d39a61cbbb0 service nova] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] No waiting events found dispatching network-vif-plugged-dcfd0e9b-4eb7-456d-a50f-2e14b1763e56 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:49:03 user nova-compute[74805]: WARNING nova.compute.manager [req-d2007c30-e928-4323-85c2-af7fc6e87fbc req-96f80230-c011-4aa0-8274-7d39a61cbbb0 service nova] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Received unexpected event network-vif-plugged-dcfd0e9b-4eb7-456d-a50f-2e14b1763e56 for instance with vm_state building and task_state spawning.
Nov 15 04:49:03 user nova-compute[74805]: INFO nova.compute.manager [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Took 4.96 seconds to spawn the instance on the hypervisor.
Nov 15 04:49:03 user nova-compute[74805]: DEBUG nova.compute.manager [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:49:03 user nova-compute[74805]: INFO nova.compute.manager [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Took 10.27 seconds to build instance.
Nov 15 04:49:03 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-71c2953b-06e3-4a72-9eaa-37f66ef28688 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "f53096c2-b75c-48ca-8ca9-30cb92ee2733" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.368s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:49:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9d0b4873-e441-41d6-ab0c-c428d40e9e1e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9d0b4873-e441-41d6-ab0c-c428d40e9e1e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9d0b4873-e441-41d6-ab0c-c428d40e9e1e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9d0b4873-e441-41d6-ab0c-c428d40e9e1e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9d0b4873-e441-41d6-ab0c-c428d40e9e1e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:49:10 user nova-compute[74805]: INFO nova.compute.manager [None req-9d0b4873-e441-41d6-ab0c-c428d40e9e1e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Terminating instance
Nov 15 04:49:10 user nova-compute[74805]: DEBUG nova.compute.manager [None req-9d0b4873-e441-41d6-ab0c-c428d40e9e1e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG nova.compute.manager [req-9b6d9615-a24b-4aa0-a8fc-13784035233e req-2da9d818-5b3e-40d3-9363-fd23f8b0110d service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Received event network-vif-unplugged-375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9b6d9615-a24b-4aa0-a8fc-13784035233e req-2da9d818-5b3e-40d3-9363-fd23f8b0110d service nova] Acquiring lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9b6d9615-a24b-4aa0-a8fc-13784035233e req-2da9d818-5b3e-40d3-9363-fd23f8b0110d service nova] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9b6d9615-a24b-4aa0-a8fc-13784035233e req-2da9d818-5b3e-40d3-9363-fd23f8b0110d service nova] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG nova.compute.manager [req-9b6d9615-a24b-4aa0-a8fc-13784035233e req-2da9d818-5b3e-40d3-9363-fd23f8b0110d service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] No waiting events found dispatching network-vif-unplugged-375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG nova.compute.manager [req-9b6d9615-a24b-4aa0-a8fc-13784035233e req-2da9d818-5b3e-40d3-9363-fd23f8b0110d service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Received event network-vif-unplugged-375372d2-cb40-4701-be3c-528d0ad92cbf for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:49:10 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Instance destroyed successfully.
Nov 15 04:49:10 user nova-compute[74805]: DEBUG nova.objects.instance [None req-9d0b4873-e441-41d6-ab0c-c428d40e9e1e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lazy-loading 'resources' on Instance uuid 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-9d0b4873-e441-41d6-ab0c-c428d40e9e1e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:42:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-110684096',display_name='tempest-ServerRescueNegativeTestJSON-server-110684096',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-110684096',id=49,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAE5HhFJvy8VlNmzAMWl5yLE8KHtHwo8pYN0mzub8KKzLvnwz/uE4chZeNvhObq9OQiWhpYdTL50hYgSBIfWHvwLTHnzCowptfiEBuZgeCebgJdzx9BVq8KB7C1akdYcEA==',key_name='tempest-keypair-1055932374',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:44:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66fc455c6c7049d79a5c64451c126d56',ramdisk_id='',reservation_id='r-2sky0upa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-370335706',owner_user_name='tempest-ServerRescueNegativeTestJSON-370335706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:46:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6da72213d3ae446088876b3a3c34f976',uuid=0ab0bf04-d54a-4656-85cd-a20bdbf92ba9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "375372d2-cb40-4701-be3c-528d0ad92cbf", "address": "fa:16:3e:7f:bb:a8", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375372d2-cb", "ovs_interfaceid": "375372d2-cb40-4701-be3c-528d0ad92cbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-9d0b4873-e441-41d6-ab0c-c428d40e9e1e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Converting VIF {"id": "375372d2-cb40-4701-be3c-528d0ad92cbf", "address": "fa:16:3e:7f:bb:a8", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap375372d2-cb", "ovs_interfaceid": "375372d2-cb40-4701-be3c-528d0ad92cbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-9d0b4873-e441-41d6-ab0c-c428d40e9e1e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:bb:a8,bridge_name='br-int',has_traffic_filtering=True,id=375372d2-cb40-4701-be3c-528d0ad92cbf,network=Network(98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap375372d2-cb') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG os_vif [None req-9d0b4873-e441-41d6-ab0c-c428d40e9e1e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:bb:a8,bridge_name='br-int',has_traffic_filtering=True,id=375372d2-cb40-4701-be3c-528d0ad92cbf,network=Network(98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap375372d2-cb') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap375372d2-cb, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b433e04-6da7-4b05-847a-2159c6364890) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:10 user nova-compute[74805]: INFO os_vif [None req-9d0b4873-e441-41d6-ab0c-c428d40e9e1e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:bb:a8,bridge_name='br-int',has_traffic_filtering=True,id=375372d2-cb40-4701-be3c-528d0ad92cbf,network=Network(98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap375372d2-cb')
Nov 15 04:49:10 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-9d0b4873-e441-41d6-ab0c-c428d40e9e1e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Deleting instance files /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9_del
Nov 15 04:49:10 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-9d0b4873-e441-41d6-ab0c-c428d40e9e1e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Deletion of /opt/stack/data/nova/instances/0ab0bf04-d54a-4656-85cd-a20bdbf92ba9_del complete
Nov 15 04:49:10 user nova-compute[74805]: INFO nova.compute.manager [None req-9d0b4873-e441-41d6-ab0c-c428d40e9e1e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 15 04:49:10 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-9d0b4873-e441-41d6-ab0c-c428d40e9e1e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:49:10 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:49:11 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:49:11 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Took 0.71 seconds to deallocate network for instance.
Nov 15 04:49:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9d0b4873-e441-41d6-ab0c-c428d40e9e1e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:49:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9d0b4873-e441-41d6-ab0c-c428d40e9e1e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:49:11 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-9d0b4873-e441-41d6-ab0c-c428d40e9e1e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:49:11 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-9d0b4873-e441-41d6-ab0c-c428d40e9e1e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:49:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9d0b4873-e441-41d6-ab0c-c428d40e9e1e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:49:11 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-9d0b4873-e441-41d6-ab0c-c428d40e9e1e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Deleted allocations for instance 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9
Nov 15 04:49:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-9d0b4873-e441-41d6-ab0c-c428d40e9e1e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.977s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:49:12 user nova-compute[74805]: DEBUG nova.compute.manager [req-91ef48ca-b171-4a4f-9ede-9981ff167323 req-44a30ba4-9fda-43eb-985f-6828ad82d489 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Received event network-vif-plugged-375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:49:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-91ef48ca-b171-4a4f-9ede-9981ff167323 req-44a30ba4-9fda-43eb-985f-6828ad82d489 service nova] Acquiring lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:49:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-91ef48ca-b171-4a4f-9ede-9981ff167323 req-44a30ba4-9fda-43eb-985f-6828ad82d489 service nova] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:49:12 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-91ef48ca-b171-4a4f-9ede-9981ff167323 req-44a30ba4-9fda-43eb-985f-6828ad82d489 service nova] Lock "0ab0bf04-d54a-4656-85cd-a20bdbf92ba9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:49:12 user nova-compute[74805]: DEBUG nova.compute.manager [req-91ef48ca-b171-4a4f-9ede-9981ff167323 req-44a30ba4-9fda-43eb-985f-6828ad82d489 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] No waiting events found dispatching network-vif-plugged-375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:49:12 user nova-compute[74805]: WARNING nova.compute.manager [req-91ef48ca-b171-4a4f-9ede-9981ff167323 req-44a30ba4-9fda-43eb-985f-6828ad82d489 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Received unexpected event network-vif-plugged-375372d2-cb40-4701-be3c-528d0ad92cbf for instance with vm_state deleted and task_state None.
Nov 15 04:49:12 user nova-compute[74805]: DEBUG nova.compute.manager [req-91ef48ca-b171-4a4f-9ede-9981ff167323 req-44a30ba4-9fda-43eb-985f-6828ad82d489 service nova] [instance: 0ab0bf04-d54a-4656-85cd-a20bdbf92ba9] Received event network-vif-deleted-375372d2-cb40-4701-be3c-528d0ad92cbf {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:49:15 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:20 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:49:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:25 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:28 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:49:30 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:49:30 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:31 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:49:31 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:49:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:35 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:36 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:49:37 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:49:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:49:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:49:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:49:37 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:49:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:49:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:49:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:49:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:49:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:49:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:49:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:49:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:49:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:49:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:49:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:49:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:49:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:49:38 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:49:38 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:49:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=8702MB free_disk=25.03731918334961GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:49:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:49:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:49:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 75731a3d-3c78-4014-a8dc-f38c3d7b3305 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:49:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:49:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance f53096c2-b75c-48ca-8ca9-30cb92ee2733 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:49:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:49:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:49:38 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:49:38 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:49:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:49:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:49:39 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:49:39 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:49:39 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Didn't find any instances for network info cache update. {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 04:49:39 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:49:40 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:49:41 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:49:41 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:49:45 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:55 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:49:58 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:49:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:49:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:49:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:49:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:49:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:49:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:49:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Verify base images {{(pid=74805) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 15 04:49:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74805) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 15 04:49:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Image id f5f2780a-c8f6-40c5-9044-7e9b73af604f yields fingerprint 8298f0be92f6485351ab1eaa3d445eec10b5ebe9 {{(pid=74805) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 15 04:49:58 user nova-compute[74805]: INFO nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] image f5f2780a-c8f6-40c5-9044-7e9b73af604f at (/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9): checking
Nov 15 04:49:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] image f5f2780a-c8f6-40c5-9044-7e9b73af604f at (/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9): image is in use {{(pid=74805) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 15 04:49:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] 75731a3d-3c78-4014-a8dc-f38c3d7b3305 is a valid instance name {{(pid=74805) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 15 04:49:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] 75731a3d-3c78-4014-a8dc-f38c3d7b3305 has a disk file {{(pid=74805) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 15 04:49:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:49:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:49:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 75731a3d-3c78-4014-a8dc-f38c3d7b3305 is backed by 8298f0be92f6485351ab1eaa3d445eec10b5ebe9 {{(pid=74805) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 15 04:49:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af is a valid instance name {{(pid=74805) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 15 04:49:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af has a disk file {{(pid=74805) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 15 04:49:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:49:58 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:49:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af is backed by 8298f0be92f6485351ab1eaa3d445eec10b5ebe9 {{(pid=74805) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 15 04:49:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] f53096c2-b75c-48ca-8ca9-30cb92ee2733 is a valid instance name {{(pid=74805) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 15 04:49:58 user nova-compute[74805]: WARNING nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Unknown base file: /opt/stack/data/nova/instances/_base/03f15382947f82eb984e779fd7253d44eaec1b92
Nov 15 04:49:58 user nova-compute[74805]: WARNING nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7f8e877eca710056507fc43c4370f51f1ffb7aa0
Nov 15 04:49:58 user nova-compute[74805]: WARNING nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c1cec425695dd7fabc345043db8586bf910327aa
Nov 15 04:49:58 user nova-compute[74805]: WARNING nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7385d404a30eca169892b35b30b8adb4683c22dd
Nov 15 04:49:58 user nova-compute[74805]: WARNING nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e78e4c1006976523ab94049dbe67510dce4016b2
Nov 15 04:49:58 user nova-compute[74805]: WARNING nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7008c873508ef073ab013283f274b38cfa538726
Nov 15 04:49:58 user nova-compute[74805]: WARNING nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a32bca047063c6290680328ffec321473cc86545
Nov 15 04:49:58 user nova-compute[74805]: WARNING nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f041c4f3b6b7c2ea1e905263f0f77ea614dc02c8
Nov 15 04:49:58 user nova-compute[74805]: WARNING nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2b8004f5ff1076d73c3be9241d490f9bd28468cf
Nov 15 04:49:58 user nova-compute[74805]: INFO nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Active base files: /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9
Nov 15 04:49:58 user nova-compute[74805]: INFO nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Removable base files: /opt/stack/data/nova/instances/_base/03f15382947f82eb984e779fd7253d44eaec1b92 /opt/stack/data/nova/instances/_base/7f8e877eca710056507fc43c4370f51f1ffb7aa0 /opt/stack/data/nova/instances/_base/c1cec425695dd7fabc345043db8586bf910327aa /opt/stack/data/nova/instances/_base/7385d404a30eca169892b35b30b8adb4683c22dd /opt/stack/data/nova/instances/_base/e78e4c1006976523ab94049dbe67510dce4016b2 /opt/stack/data/nova/instances/_base/7008c873508ef073ab013283f274b38cfa538726 /opt/stack/data/nova/instances/_base/a32bca047063c6290680328ffec321473cc86545 /opt/stack/data/nova/instances/_base/f041c4f3b6b7c2ea1e905263f0f77ea614dc02c8 /opt/stack/data/nova/instances/_base/2b8004f5ff1076d73c3be9241d490f9bd28468cf
Nov 15 04:49:58 user nova-compute[74805]: INFO nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/03f15382947f82eb984e779fd7253d44eaec1b92
Nov 15 04:49:58 user nova-compute[74805]: INFO nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7f8e877eca710056507fc43c4370f51f1ffb7aa0
Nov 15 04:49:58 user nova-compute[74805]: INFO nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c1cec425695dd7fabc345043db8586bf910327aa
Nov 15 04:49:58 user nova-compute[74805]: INFO nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7385d404a30eca169892b35b30b8adb4683c22dd
Nov 15 04:49:58 user nova-compute[74805]: INFO nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e78e4c1006976523ab94049dbe67510dce4016b2
Nov 15 04:49:58 user nova-compute[74805]: INFO nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7008c873508ef073ab013283f274b38cfa538726
Nov 15 04:49:58 user nova-compute[74805]: INFO nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a32bca047063c6290680328ffec321473cc86545
Nov 15 04:49:58 user nova-compute[74805]: INFO nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f041c4f3b6b7c2ea1e905263f0f77ea614dc02c8
Nov 15 04:49:58 user nova-compute[74805]: INFO nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2b8004f5ff1076d73c3be9241d490f9bd28468cf
Nov 15 04:49:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Verification complete {{(pid=74805) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 15 04:49:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Verify swap images {{(pid=74805) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 15 04:49:58 user nova-compute[74805]: DEBUG nova.virt.libvirt.imagecache [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Verify ephemeral images {{(pid=74805) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 15 04:50:00 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6b79984e-876a-49dc-8129-b588a6f3c70e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:50:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6b79984e-876a-49dc-8129-b588a6f3c70e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:50:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6b79984e-876a-49dc-8129-b588a6f3c70e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:50:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6b79984e-876a-49dc-8129-b588a6f3c70e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:50:05 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6b79984e-876a-49dc-8129-b588a6f3c70e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:50:05 user nova-compute[74805]: INFO nova.compute.manager [None req-6b79984e-876a-49dc-8129-b588a6f3c70e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Terminating instance
Nov 15 04:50:05 user nova-compute[74805]: DEBUG nova.compute.manager [None req-6b79984e-876a-49dc-8129-b588a6f3c70e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:50:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:05 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:06 user nova-compute[74805]: DEBUG nova.compute.manager [req-ef009903-00b2-4b6a-ba10-ef897e0d67b8 req-c2c56f5d-1d45-42e6-ba3d-7b5874fb36a2 service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Received event network-vif-unplugged-4d9bd2e9-b1dc-4fc8-b045-6e5513061c22 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:50:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ef009903-00b2-4b6a-ba10-ef897e0d67b8 req-c2c56f5d-1d45-42e6-ba3d-7b5874fb36a2 service nova] Acquiring lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:50:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ef009903-00b2-4b6a-ba10-ef897e0d67b8 req-c2c56f5d-1d45-42e6-ba3d-7b5874fb36a2 service nova] Lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:50:06 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ef009903-00b2-4b6a-ba10-ef897e0d67b8 req-c2c56f5d-1d45-42e6-ba3d-7b5874fb36a2 service nova] Lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:50:06 user nova-compute[74805]: DEBUG nova.compute.manager [req-ef009903-00b2-4b6a-ba10-ef897e0d67b8 req-c2c56f5d-1d45-42e6-ba3d-7b5874fb36a2 service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] No waiting events found dispatching network-vif-unplugged-4d9bd2e9-b1dc-4fc8-b045-6e5513061c22 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:50:06 user nova-compute[74805]: DEBUG nova.compute.manager [req-ef009903-00b2-4b6a-ba10-ef897e0d67b8 req-c2c56f5d-1d45-42e6-ba3d-7b5874fb36a2 service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Received event network-vif-unplugged-4d9bd2e9-b1dc-4fc8-b045-6e5513061c22 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:50:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:06 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Instance destroyed successfully.
Nov 15 04:50:06 user nova-compute[74805]: DEBUG nova.objects.instance [None req-6b79984e-876a-49dc-8129-b588a6f3c70e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lazy-loading 'resources' on Instance uuid 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:50:06 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-6b79984e-876a-49dc-8129-b588a6f3c70e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:34:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-715241780',display_name='tempest-ServerRescueNegativeTestJSON-server-715241780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-715241780',id=42,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:36:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66fc455c6c7049d79a5c64451c126d56',ramdisk_id='',reservation_id='r-nfy5l0dx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-370335706',owner_user_name='tempest-ServerRescueNegativeTestJSON-370335706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:36:05Z,user_data=None,user_id='6da72213d3ae446088876b3a3c34f976',uuid=01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "address": "fa:16:3e:c6:13:c6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9bd2e9-b1", "ovs_interfaceid": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:50:06 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-6b79984e-876a-49dc-8129-b588a6f3c70e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Converting VIF {"id": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "address": "fa:16:3e:c6:13:c6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9bd2e9-b1", "ovs_interfaceid": "4d9bd2e9-b1dc-4fc8-b045-6e5513061c22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:50:06 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-6b79984e-876a-49dc-8129-b588a6f3c70e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:13:c6,bridge_name='br-int',has_traffic_filtering=True,id=4d9bd2e9-b1dc-4fc8-b045-6e5513061c22,network=Network(98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d9bd2e9-b1') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:50:06 user nova-compute[74805]: DEBUG os_vif [None req-6b79984e-876a-49dc-8129-b588a6f3c70e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:13:c6,bridge_name='br-int',has_traffic_filtering=True,id=4d9bd2e9-b1dc-4fc8-b045-6e5513061c22,network=Network(98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d9bd2e9-b1') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:50:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d9bd2e9-b1, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:50:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:50:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f4104bb-eca2-4f93-b758-dcc41c1f2939) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:50:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:06 user nova-compute[74805]: INFO os_vif [None req-6b79984e-876a-49dc-8129-b588a6f3c70e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:13:c6,bridge_name='br-int',has_traffic_filtering=True,id=4d9bd2e9-b1dc-4fc8-b045-6e5513061c22,network=Network(98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d9bd2e9-b1')
Nov 15 04:50:06 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-6b79984e-876a-49dc-8129-b588a6f3c70e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Deleting instance files /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af_del
Nov 15 04:50:06 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-6b79984e-876a-49dc-8129-b588a6f3c70e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Deletion of /opt/stack/data/nova/instances/01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af_del complete
Nov 15 04:50:06 user nova-compute[74805]: INFO nova.compute.manager [None req-6b79984e-876a-49dc-8129-b588a6f3c70e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Took 0.79 seconds to destroy the instance on the hypervisor.
Nov 15 04:50:06 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-6b79984e-876a-49dc-8129-b588a6f3c70e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:50:06 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:50:06 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:50:07 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:50:07 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Took 0.79 seconds to deallocate network for instance.
Nov 15 04:50:07 user nova-compute[74805]: DEBUG nova.compute.manager [req-dc4f71b9-a743-4499-a762-47acfc7c233a req-93c2f2de-1d74-4f85-8f62-aabd996bc3ba service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Received event network-vif-deleted-4d9bd2e9-b1dc-4fc8-b045-6e5513061c22 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:50:07 user nova-compute[74805]: INFO nova.compute.manager [req-dc4f71b9-a743-4499-a762-47acfc7c233a req-93c2f2de-1d74-4f85-8f62-aabd996bc3ba service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Neutron deleted interface 4d9bd2e9-b1dc-4fc8-b045-6e5513061c22; detaching it from the instance and deleting it from the info cache
Nov 15 04:50:07 user nova-compute[74805]: DEBUG nova.network.neutron [req-dc4f71b9-a743-4499-a762-47acfc7c233a req-93c2f2de-1d74-4f85-8f62-aabd996bc3ba service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:50:07 user nova-compute[74805]: DEBUG nova.compute.manager [req-dc4f71b9-a743-4499-a762-47acfc7c233a req-93c2f2de-1d74-4f85-8f62-aabd996bc3ba service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Detach interface failed, port_id=4d9bd2e9-b1dc-4fc8-b045-6e5513061c22, reason: Instance 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af could not be found. {{(pid=74805) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 04:50:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6b79984e-876a-49dc-8129-b588a6f3c70e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:50:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6b79984e-876a-49dc-8129-b588a6f3c70e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:50:07 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-6b79984e-876a-49dc-8129-b588a6f3c70e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:50:07 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-6b79984e-876a-49dc-8129-b588a6f3c70e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:50:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6b79984e-876a-49dc-8129-b588a6f3c70e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:50:07 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-6b79984e-876a-49dc-8129-b588a6f3c70e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Deleted allocations for instance 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af
Nov 15 04:50:07 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-6b79984e-876a-49dc-8129-b588a6f3c70e tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.940s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:50:08 user nova-compute[74805]: DEBUG nova.compute.manager [req-fea6cf5a-7150-4721-8739-76fc2991855d req-c0789fad-e971-4918-8dce-325958b92c9c service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Received event network-vif-plugged-4d9bd2e9-b1dc-4fc8-b045-6e5513061c22 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:50:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-fea6cf5a-7150-4721-8739-76fc2991855d req-c0789fad-e971-4918-8dce-325958b92c9c service nova] Acquiring lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:50:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-fea6cf5a-7150-4721-8739-76fc2991855d req-c0789fad-e971-4918-8dce-325958b92c9c service nova] Lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:50:08 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-fea6cf5a-7150-4721-8739-76fc2991855d req-c0789fad-e971-4918-8dce-325958b92c9c service nova] Lock "01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:50:08 user nova-compute[74805]: DEBUG nova.compute.manager [req-fea6cf5a-7150-4721-8739-76fc2991855d req-c0789fad-e971-4918-8dce-325958b92c9c service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] No waiting events found dispatching network-vif-plugged-4d9bd2e9-b1dc-4fc8-b045-6e5513061c22 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:50:08 user nova-compute[74805]: WARNING nova.compute.manager [req-fea6cf5a-7150-4721-8739-76fc2991855d req-c0789fad-e971-4918-8dce-325958b92c9c service nova] [instance: 01ef5a0c-1f40-41fb-94dc-8e3d0c8f21af] Received unexpected event network-vif-plugged-4d9bd2e9-b1dc-4fc8-b045-6e5513061c22 for instance with vm_state deleted and task_state None.
Nov 15 04:50:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:24 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:50:24 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74805) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 04:50:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:50:30 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:50:31 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:50:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:50:32 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:50:33 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:50:35 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:50:35 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Cleaning up deleted instances {{(pid=74805) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 04:50:35 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] There are 0 instances to clean {{(pid=74805) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 04:50:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:37 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:50:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:50:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:50:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:50:37 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:50:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:50:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:50:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:50:37 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:50:37 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:50:38 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:50:38 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:50:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=8842MB free_disk=25.056900024414062GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:50:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:50:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:50:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 75731a3d-3c78-4014-a8dc-f38c3d7b3305 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:50:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance f53096c2-b75c-48ca-8ca9-30cb92ee2733 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:50:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:50:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:50:38 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:50:38 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:50:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:50:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:50:39 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:50:39 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:50:40 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:50:40 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:50:40 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Rebuilding the list of instances to heal {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 04:50:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-75731a3d-3c78-4014-a8dc-f38c3d7b3305" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:50:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-75731a3d-3c78-4014-a8dc-f38c3d7b3305" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:50:40 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:50:40 user nova-compute[74805]: DEBUG nova.objects.instance [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lazy-loading 'info_cache' on Instance uuid 75731a3d-3c78-4014-a8dc-f38c3d7b3305 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:50:40 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Updating instance_info_cache with network_info: [{"id": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "address": "fa:16:3e:8f:e3:f6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39aa6c19-c3", "ovs_interfaceid": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:50:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-75731a3d-3c78-4014-a8dc-f38c3d7b3305" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:50:40 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:50:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:50:42 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:50:43 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:50:43 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:50:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-1ea9fb45-f618-403c-9174-04e59507cd0d req-e95051dc-c033-43bd-a6c6-be5e2947dccc service nova] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Received event network-changed-dcfd0e9b-4eb7-456d-a50f-2e14b1763e56 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:50:45 user nova-compute[74805]: DEBUG nova.compute.manager [req-1ea9fb45-f618-403c-9174-04e59507cd0d req-e95051dc-c033-43bd-a6c6-be5e2947dccc service nova] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Refreshing instance network info cache due to event network-changed-dcfd0e9b-4eb7-456d-a50f-2e14b1763e56. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:50:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1ea9fb45-f618-403c-9174-04e59507cd0d req-e95051dc-c033-43bd-a6c6-be5e2947dccc service nova] Acquiring lock "refresh_cache-f53096c2-b75c-48ca-8ca9-30cb92ee2733" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:50:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1ea9fb45-f618-403c-9174-04e59507cd0d req-e95051dc-c033-43bd-a6c6-be5e2947dccc service nova] Acquired lock "refresh_cache-f53096c2-b75c-48ca-8ca9-30cb92ee2733" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:50:45 user nova-compute[74805]: DEBUG nova.network.neutron [req-1ea9fb45-f618-403c-9174-04e59507cd0d req-e95051dc-c033-43bd-a6c6-be5e2947dccc service nova] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Refreshing network info cache for port dcfd0e9b-4eb7-456d-a50f-2e14b1763e56 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:50:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:46 user nova-compute[74805]: DEBUG nova.network.neutron [req-1ea9fb45-f618-403c-9174-04e59507cd0d req-e95051dc-c033-43bd-a6c6-be5e2947dccc service nova] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Updated VIF entry in instance network info cache for port dcfd0e9b-4eb7-456d-a50f-2e14b1763e56. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:50:46 user nova-compute[74805]: DEBUG nova.network.neutron [req-1ea9fb45-f618-403c-9174-04e59507cd0d req-e95051dc-c033-43bd-a6c6-be5e2947dccc service nova] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Updating instance_info_cache with network_info: [{"id": "dcfd0e9b-4eb7-456d-a50f-2e14b1763e56", "address": "fa:16:3e:33:b1:4f", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfd0e9b-4e", "ovs_interfaceid": "dcfd0e9b-4eb7-456d-a50f-2e14b1763e56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:50:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1ea9fb45-f618-403c-9174-04e59507cd0d req-e95051dc-c033-43bd-a6c6-be5e2947dccc service nova] Releasing lock "refresh_cache-f53096c2-b75c-48ca-8ca9-30cb92ee2733" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:50:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "90ef7272-9bdb-4eb9-b97d-57e46b1532de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:50:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "90ef7272-9bdb-4eb9-b97d-57e46b1532de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:50:49 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:50:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:50:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:50:49 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:50:49 user nova-compute[74805]: INFO nova.compute.claims [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Claim successful on node user
Nov 15 04:50:50 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:50:50 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:50:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.249s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:50:50 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:50:50 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:50:50 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:50:50 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:50:50 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:50:50 user nova-compute[74805]: INFO nova.virt.block_device [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Booting with volume 5b335fd0-83cc-49f5-9e7c-9906fcbdf721 at /dev/vda
Nov 15 04:50:50 user nova-compute[74805]: DEBUG nova.policy [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bd96ecd9d404779ad64456c6517591f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2744859f249a4326ab6d268319a34b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:50:50 user nova-compute[74805]: DEBUG os_brick.utils [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:50:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:50:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:50:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22da102-b9d2-49e0-a85f-636db5358b11]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:50:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:50:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:50:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[48eebd80-97cd-48e6-b53f-db506ea8cd7c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:50:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:50:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:50:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c6933c-1e26-4e4a-83e3-67aa35906f18]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:50:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a8338a-953c-47e5-add1-d087c9ab4161]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:50:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:50:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:50:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:50:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:50:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:50:50 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:50:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d891ffe-53fe-466a-9aca-9f2f3f44a7a4]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:50:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:50:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:50:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:50:50 user nova-compute[74805]: DEBUG os_brick.utils [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:50:50 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Updating existing volume attachment record: 749b1d4d-bed9-413c-8157-622e1d006647 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:50:50 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:50 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Successfully created port: c78711d2-3ecc-4f15-a63e-6168d11069c8 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:50:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:51 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Successfully updated port: c78711d2-3ecc-4f15-a63e-6168d11069c8 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:50:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "refresh_cache-90ef7272-9bdb-4eb9-b97d-57e46b1532de" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:50:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquired lock "refresh_cache-90ef7272-9bdb-4eb9-b97d-57e46b1532de" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:50:51 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:50:51 user nova-compute[74805]: DEBUG nova.compute.manager [req-530d4971-7928-4a80-9bd5-fc668bfa6c28 req-07faedb7-b541-4676-af7d-fd8e75ba8881 service nova] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Received event network-changed-c78711d2-3ecc-4f15-a63e-6168d11069c8 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:50:51 user nova-compute[74805]: DEBUG nova.compute.manager [req-530d4971-7928-4a80-9bd5-fc668bfa6c28 req-07faedb7-b541-4676-af7d-fd8e75ba8881 service nova] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Refreshing instance network info cache due to event network-changed-c78711d2-3ecc-4f15-a63e-6168d11069c8. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:50:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-530d4971-7928-4a80-9bd5-fc668bfa6c28 req-07faedb7-b541-4676-af7d-fd8e75ba8881 service nova] Acquiring lock "refresh_cache-90ef7272-9bdb-4eb9-b97d-57e46b1532de" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:50:51 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:50:52 user nova-compute[74805]: DEBUG nova.network.neutron [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Updating instance_info_cache with network_info: [{"id": "c78711d2-3ecc-4f15-a63e-6168d11069c8", "address": "fa:16:3e:f3:89:e9", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc78711d2-3e", "ovs_interfaceid": "c78711d2-3ecc-4f15-a63e-6168d11069c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:50:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Releasing lock "refresh_cache-90ef7272-9bdb-4eb9-b97d-57e46b1532de" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:50:52 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Instance network_info: |[{"id": "c78711d2-3ecc-4f15-a63e-6168d11069c8", "address": "fa:16:3e:f3:89:e9", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc78711d2-3e", "ovs_interfaceid": "c78711d2-3ecc-4f15-a63e-6168d11069c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:50:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-530d4971-7928-4a80-9bd5-fc668bfa6c28 req-07faedb7-b541-4676-af7d-fd8e75ba8881 service nova] Acquired lock "refresh_cache-90ef7272-9bdb-4eb9-b97d-57e46b1532de" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:50:52 user nova-compute[74805]: DEBUG nova.network.neutron [req-530d4971-7928-4a80-9bd5-fc668bfa6c28 req-07faedb7-b541-4676-af7d-fd8e75ba8881 service nova] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Refreshing network info cache for port c78711d2-3ecc-4f15-a63e-6168d11069c8 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:50:52 user nova-compute[74805]: DEBUG nova.network.neutron [req-530d4971-7928-4a80-9bd5-fc668bfa6c28 req-07faedb7-b541-4676-af7d-fd8e75ba8881 service nova] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Updated VIF entry in instance network info cache for port c78711d2-3ecc-4f15-a63e-6168d11069c8. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:50:52 user nova-compute[74805]: DEBUG nova.network.neutron [req-530d4971-7928-4a80-9bd5-fc668bfa6c28 req-07faedb7-b541-4676-af7d-fd8e75ba8881 service nova] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Updating instance_info_cache with network_info: [{"id": "c78711d2-3ecc-4f15-a63e-6168d11069c8", "address": "fa:16:3e:f3:89:e9", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc78711d2-3e", "ovs_interfaceid": "c78711d2-3ecc-4f15-a63e-6168d11069c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:50:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-530d4971-7928-4a80-9bd5-fc668bfa6c28 req-07faedb7-b541-4676-af7d-fd8e75ba8881 service nova] Releasing lock "refresh_cache-90ef7272-9bdb-4eb9-b97d-57e46b1532de" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:50:54 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:50:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:50:54 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Creating image(s)
Nov 15 04:50:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Did not create local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 04:50:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Ensure instance console log exists: /opt/stack/data/nova/instances/90ef7272-9bdb-4eb9-b97d-57e46b1532de/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:50:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:50:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:50:54 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:50:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Start _get_guest_xml network_info=[{"id": "c78711d2-3ecc-4f15-a63e-6168d11069c8", "address": "fa:16:3e:f3:89:e9", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc78711d2-3e", "ovs_interfaceid": "c78711d2-3ecc-4f15-a63e-6168d11069c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ocISwfkT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '90ef7272-9bdb-4eb9-b97d-57e46b1532de', 'attached_at': '', 'detached_at': '', 'volume_id': '5b335fd0-83cc-49f5-9e7c-9906fcbdf721', 'serial': '5b335fd0-83cc-49f5-9e7c-9906fcbdf721'}, 'delete_on_termination': False, 'attachment_id': '749b1d4d-bed9-413c-8157-622e1d006647', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:50:54 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:50:54 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:50:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:50:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:50:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:50:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:50:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:50:54 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:50:54 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:50:54 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:50:54 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:50:54 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:50:54 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:50:54 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:50:54 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:50:54 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:50:54 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:50:54 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:50:54 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:50:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ocISwfkT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:50:54 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:50:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:50:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:50:54 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:50:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:50:54 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:50:54 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:50:54 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d311c942-8ba2-480e-a5c2-34f5c8d5b08b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:50:55 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f830cafc-fd8a-4f04-a96a-34c3c8d4c846]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721] added
Nov 15 04:50:55 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[348d4c94-3388-4569-84b9-a997dbae4cc7]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9d2a9b-5e31-4fa0-929a-f554b24e6cca]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ocISwfkT {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ocISwfkT" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bc3d16-05ce-44b3-ba5b-5e4a51cf7f52]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ocISwfkT'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3f963a-8470-49af-8a6f-10534501013d]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8a9b23-a4c6-43d6-ab40-900d92875387]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f (non-flash)
Nov 15 04:50:55 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f (non-flash)
Nov 15 04:50:55 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb42955c-ce71-4547-a651-7d1a26d0d4f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721, portal: 172.16.0.220,3260]
Nov 15 04:50:55 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721, portal: 172.16.0.220,3260] successful.
Nov 15 04:50:55 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9ea516-d2e9-42a8-a26d-7269202af868]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9ac8b2-d681-4d5d-afdf-57fda86cd417]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f (non-flash)
Nov 15 04:50:55 user nova-compute[74805]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721 (non-flash)
Nov 15 04:50:55 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f (non-flash)
Nov 15 04:50:55 user nova-compute[74805]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721 (non-flash)
Nov 15 04:50:55 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4d1b1b-c691-445c-bb21-4a6c5180ca2e]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:50:55 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ocISwfkT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26430656661333834', 'path': '/dev/sdc'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430656661333834', 'path': '/dev/sdc'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:50:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-333371252',display_name='tempest-TestVolumeBootPattern-server-333371252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-333371252',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPSZsjBao2IiCSH6iNxCBnd9/tVkNXbrNJpEOjeMrEDWwanT/XX2Dcm8vpngfLnbfGhydqc2p2DnAgn/CCrGmL8T0FuaHg/KrFgmSAIbSmou7lS7rh9h9Z85pHvQBKirA==',key_name='tempest-TestVolumeBootPattern-1567239913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2744859f249a4326ab6d268319a34b7f',ramdisk_id='',reservation_id='r-rv6x07c3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2043506637',owner_user_name='tempest-TestVolumeBootPattern-2043506637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:50:50Z,user_data=None,user_id='0bd96ecd9d404779ad64456c6517591f',uuid=90ef7272-9bdb-4eb9-b97d-57e46b1532de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c78711d2-3ecc-4f15-a63e-6168d11069c8", "address": "fa:16:3e:f3:89:e9", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc78711d2-3e", "ovs_interfaceid": "c78711d2-3ecc-4f15-a63e-6168d11069c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converting VIF {"id": "c78711d2-3ecc-4f15-a63e-6168d11069c8", "address": "fa:16:3e:f3:89:e9", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc78711d2-3e", "ovs_interfaceid": "c78711d2-3ecc-4f15-a63e-6168d11069c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:89:e9,bridge_name='br-int',has_traffic_filtering=True,id=c78711d2-3ecc-4f15-a63e-6168d11069c8,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc78711d2-3e') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG nova.objects.instance [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lazy-loading 'pci_devices' on Instance uuid 90ef7272-9bdb-4eb9-b97d-57e46b1532de {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:50:56 user nova-compute[74805]:   <uuid>90ef7272-9bdb-4eb9-b97d-57e46b1532de</uuid>
Nov 15 04:50:56 user nova-compute[74805]:   <name>instance-00000034</name>
Nov 15 04:50:56 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:50:56 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:50:56 user nova-compute[74805]:   <metadata>
Nov 15 04:50:56 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:50:56 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:50:56 user nova-compute[74805]:       <nova:name>tempest-TestVolumeBootPattern-server-333371252</nova:name>
Nov 15 04:50:56 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:50:54</nova:creationTime>
Nov 15 04:50:56 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:50:56 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:50:56 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:50:56 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:50:56 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:50:56 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:50:56 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:50:56 user nova-compute[74805]:       <nova:owner>
Nov 15 04:50:56 user nova-compute[74805]:         <nova:user uuid="0bd96ecd9d404779ad64456c6517591f">tempest-TestVolumeBootPattern-2043506637-project-member</nova:user>
Nov 15 04:50:56 user nova-compute[74805]:         <nova:project uuid="2744859f249a4326ab6d268319a34b7f">tempest-TestVolumeBootPattern-2043506637</nova:project>
Nov 15 04:50:56 user nova-compute[74805]:       </nova:owner>
Nov 15 04:50:56 user nova-compute[74805]:       <nova:ports>
Nov 15 04:50:56 user nova-compute[74805]:         <nova:port uuid="c78711d2-3ecc-4f15-a63e-6168d11069c8">
Nov 15 04:50:56 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 04:50:56 user nova-compute[74805]:         </nova:port>
Nov 15 04:50:56 user nova-compute[74805]:       </nova:ports>
Nov 15 04:50:56 user nova-compute[74805]:     </nova:instance>
Nov 15 04:50:56 user nova-compute[74805]:   </metadata>
Nov 15 04:50:56 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:50:56 user nova-compute[74805]:     <system>
Nov 15 04:50:56 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:50:56 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:50:56 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:50:56 user nova-compute[74805]:       <entry name="serial">90ef7272-9bdb-4eb9-b97d-57e46b1532de</entry>
Nov 15 04:50:56 user nova-compute[74805]:       <entry name="uuid">90ef7272-9bdb-4eb9-b97d-57e46b1532de</entry>
Nov 15 04:50:56 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:50:56 user nova-compute[74805]:     </system>
Nov 15 04:50:56 user nova-compute[74805]:   </sysinfo>
Nov 15 04:50:56 user nova-compute[74805]:   <os>
Nov 15 04:50:56 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:50:56 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:50:56 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:50:56 user nova-compute[74805]:   </os>
Nov 15 04:50:56 user nova-compute[74805]:   <features>
Nov 15 04:50:56 user nova-compute[74805]:     <acpi/>
Nov 15 04:50:56 user nova-compute[74805]:     <apic/>
Nov 15 04:50:56 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:50:56 user nova-compute[74805]:   </features>
Nov 15 04:50:56 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:50:56 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:50:56 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:50:56 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:50:56 user nova-compute[74805]:   </clock>
Nov 15 04:50:56 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:50:56 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:50:56 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:50:56 user nova-compute[74805]:   </cpu>
Nov 15 04:50:56 user nova-compute[74805]:   <devices>
Nov 15 04:50:56 user nova-compute[74805]:     <disk type="block" device="disk">
Nov 15 04:50:56 user nova-compute[74805]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:50:56 user nova-compute[74805]:       <source dev="/dev/sdc"/>
Nov 15 04:50:56 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:50:56 user nova-compute[74805]:       <serial>5b335fd0-83cc-49f5-9e7c-9906fcbdf721</serial>
Nov 15 04:50:56 user nova-compute[74805]:     </disk>
Nov 15 04:50:56 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:50:56 user nova-compute[74805]:       <mac address="fa:16:3e:f3:89:e9"/>
Nov 15 04:50:56 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:50:56 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:50:56 user nova-compute[74805]:       <target dev="tapc78711d2-3e"/>
Nov 15 04:50:56 user nova-compute[74805]:     </interface>
Nov 15 04:50:56 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:50:56 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/90ef7272-9bdb-4eb9-b97d-57e46b1532de/console.log" append="off"/>
Nov 15 04:50:56 user nova-compute[74805]:     </serial>
Nov 15 04:50:56 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:50:56 user nova-compute[74805]:     <video>
Nov 15 04:50:56 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:50:56 user nova-compute[74805]:     </video>
Nov 15 04:50:56 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:50:56 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:50:56 user nova-compute[74805]:     </rng>
Nov 15 04:50:56 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:50:56 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:50:56 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:50:56 user nova-compute[74805]:     </memballoon>
Nov 15 04:50:56 user nova-compute[74805]:   </devices>
Nov 15 04:50:56 user nova-compute[74805]: </domain>
Nov 15 04:50:56 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:50:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-333371252',display_name='tempest-TestVolumeBootPattern-server-333371252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-333371252',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPSZsjBao2IiCSH6iNxCBnd9/tVkNXbrNJpEOjeMrEDWwanT/XX2Dcm8vpngfLnbfGhydqc2p2DnAgn/CCrGmL8T0FuaHg/KrFgmSAIbSmou7lS7rh9h9Z85pHvQBKirA==',key_name='tempest-TestVolumeBootPattern-1567239913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2744859f249a4326ab6d268319a34b7f',ramdisk_id='',reservation_id='r-rv6x07c3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2043506637',owner_user_name='tempest-TestVolumeBootPattern-2043506637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:50:50Z,user_data=None,user_id='0bd96ecd9d404779ad64456c6517591f',uuid=90ef7272-9bdb-4eb9-b97d-57e46b1532de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c78711d2-3ecc-4f15-a63e-6168d11069c8", "address": "fa:16:3e:f3:89:e9", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc78711d2-3e", "ovs_interfaceid": "c78711d2-3ecc-4f15-a63e-6168d11069c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converting VIF {"id": "c78711d2-3ecc-4f15-a63e-6168d11069c8", "address": "fa:16:3e:f3:89:e9", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc78711d2-3e", "ovs_interfaceid": "c78711d2-3ecc-4f15-a63e-6168d11069c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:89:e9,bridge_name='br-int',has_traffic_filtering=True,id=c78711d2-3ecc-4f15-a63e-6168d11069c8,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc78711d2-3e') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG os_vif [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:89:e9,bridge_name='br-int',has_traffic_filtering=True,id=c78711d2-3ecc-4f15-a63e-6168d11069c8,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc78711d2-3e') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7520f43-3209-541c-974f-e548f10bcacc', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc78711d2-3e, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc78711d2-3e, col_values=(('qos', UUID('3217353e-4b43-4252-a82c-1db875a55a80')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc78711d2-3e, col_values=(('external_ids', {'iface-id': 'c78711d2-3ecc-4f15-a63e-6168d11069c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:89:e9', 'vm-uuid': '90ef7272-9bdb-4eb9-b97d-57e46b1532de'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:56 user nova-compute[74805]: INFO os_vif [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:89:e9,bridge_name='br-int',has_traffic_filtering=True,id=c78711d2-3ecc-4f15-a63e-6168d11069c8,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc78711d2-3e')
Nov 15 04:50:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-85e7ed1c-10b4-4c74-b87c-be3e0223bcf3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-85e7ed1c-10b4-4c74-b87c-be3e0223bcf3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-85e7ed1c-10b4-4c74-b87c-be3e0223bcf3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-85e7ed1c-10b4-4c74-b87c-be3e0223bcf3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-85e7ed1c-10b4-4c74-b87c-be3e0223bcf3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:50:56 user nova-compute[74805]: INFO nova.compute.manager [None req-85e7ed1c-10b4-4c74-b87c-be3e0223bcf3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Terminating instance
Nov 15 04:50:56 user nova-compute[74805]: DEBUG nova.compute.manager [None req-85e7ed1c-10b4-4c74-b87c-be3e0223bcf3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] No VIF found with MAC fa:16:3e:f3:89:e9, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG nova.compute.manager [req-1045a5cc-151b-4e4e-9c50-30f09bcecd0e req-7c8b042d-7409-43c9-b578-1cf070f8b975 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received event network-vif-unplugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1045a5cc-151b-4e4e-9c50-30f09bcecd0e req-7c8b042d-7409-43c9-b578-1cf070f8b975 service nova] Acquiring lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1045a5cc-151b-4e4e-9c50-30f09bcecd0e req-7c8b042d-7409-43c9-b578-1cf070f8b975 service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-1045a5cc-151b-4e4e-9c50-30f09bcecd0e req-7c8b042d-7409-43c9-b578-1cf070f8b975 service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG nova.compute.manager [req-1045a5cc-151b-4e4e-9c50-30f09bcecd0e req-7c8b042d-7409-43c9-b578-1cf070f8b975 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] No waiting events found dispatching network-vif-unplugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:50:56 user nova-compute[74805]: DEBUG nova.compute.manager [req-1045a5cc-151b-4e4e-9c50-30f09bcecd0e req-7c8b042d-7409-43c9-b578-1cf070f8b975 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received event network-vif-unplugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:50:57 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Instance destroyed successfully.
Nov 15 04:50:57 user nova-compute[74805]: DEBUG nova.objects.instance [None req-85e7ed1c-10b4-4c74-b87c-be3e0223bcf3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lazy-loading 'resources' on Instance uuid 75731a3d-3c78-4014-a8dc-f38c3d7b3305 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:50:57 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-85e7ed1c-10b4-4c74-b87c-be3e0223bcf3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:34:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2014027379',display_name='tempest-ServerRescueNegativeTestJSON-server-2014027379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2014027379',id=41,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:38:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66fc455c6c7049d79a5c64451c126d56',ramdisk_id='',reservation_id='r-xszr1u4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-370335706',owner_user_name='tempest-ServerRescueNegativeTestJSON-370335706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:40:48Z,user_data=None,user_id='6da72213d3ae446088876b3a3c34f976',uuid=75731a3d-3c78-4014-a8dc-f38c3d7b3305,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "address": "fa:16:3e:8f:e3:f6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39aa6c19-c3", "ovs_interfaceid": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:50:57 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-85e7ed1c-10b4-4c74-b87c-be3e0223bcf3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Converting VIF {"id": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "address": "fa:16:3e:8f:e3:f6", "network": {"id": "98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-587024641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66fc455c6c7049d79a5c64451c126d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39aa6c19-c3", "ovs_interfaceid": "39aa6c19-c319-4f9d-ac4e-a1deccecc95a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:50:57 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-85e7ed1c-10b4-4c74-b87c-be3e0223bcf3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:e3:f6,bridge_name='br-int',has_traffic_filtering=True,id=39aa6c19-c319-4f9d-ac4e-a1deccecc95a,network=Network(98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39aa6c19-c3') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:50:57 user nova-compute[74805]: DEBUG os_vif [None req-85e7ed1c-10b4-4c74-b87c-be3e0223bcf3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:e3:f6,bridge_name='br-int',has_traffic_filtering=True,id=39aa6c19-c319-4f9d-ac4e-a1deccecc95a,network=Network(98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39aa6c19-c3') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:50:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39aa6c19-c3, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:50:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:50:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3727c9c1-77fd-4274-bb83-adc36c8c7d60) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:50:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:50:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:57 user nova-compute[74805]: INFO os_vif [None req-85e7ed1c-10b4-4c74-b87c-be3e0223bcf3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:e3:f6,bridge_name='br-int',has_traffic_filtering=True,id=39aa6c19-c319-4f9d-ac4e-a1deccecc95a,network=Network(98791bbd-c4d4-4d9a-83e8-7a3ce2fcdafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39aa6c19-c3')
Nov 15 04:50:57 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-85e7ed1c-10b4-4c74-b87c-be3e0223bcf3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Deleting instance files /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305_del
Nov 15 04:50:57 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-85e7ed1c-10b4-4c74-b87c-be3e0223bcf3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Deletion of /opt/stack/data/nova/instances/75731a3d-3c78-4014-a8dc-f38c3d7b3305_del complete
Nov 15 04:50:57 user nova-compute[74805]: INFO nova.compute.manager [None req-85e7ed1c-10b4-4c74-b87c-be3e0223bcf3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 15 04:50:57 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-85e7ed1c-10b4-4c74-b87c-be3e0223bcf3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:50:57 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:50:57 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:50:57 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:50:57 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Took 0.37 seconds to deallocate network for instance.
Nov 15 04:50:57 user nova-compute[74805]: DEBUG nova.compute.manager [req-58adc091-cf35-4f88-902a-f61fa71bf1b4 req-b4af02f6-40a0-413d-9fec-78917d4232a7 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received event network-vif-deleted-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:50:57 user nova-compute[74805]: INFO nova.compute.manager [req-58adc091-cf35-4f88-902a-f61fa71bf1b4 req-b4af02f6-40a0-413d-9fec-78917d4232a7 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Neutron deleted interface 39aa6c19-c319-4f9d-ac4e-a1deccecc95a; detaching it from the instance and deleting it from the info cache
Nov 15 04:50:57 user nova-compute[74805]: DEBUG nova.network.neutron [req-58adc091-cf35-4f88-902a-f61fa71bf1b4 req-b4af02f6-40a0-413d-9fec-78917d4232a7 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:50:57 user nova-compute[74805]: DEBUG nova.compute.manager [req-58adc091-cf35-4f88-902a-f61fa71bf1b4 req-b4af02f6-40a0-413d-9fec-78917d4232a7 service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Detach interface failed, port_id=39aa6c19-c319-4f9d-ac4e-a1deccecc95a, reason: Instance 75731a3d-3c78-4014-a8dc-f38c3d7b3305 could not be found. {{(pid=74805) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 04:50:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-85e7ed1c-10b4-4c74-b87c-be3e0223bcf3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:50:57 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-85e7ed1c-10b4-4c74-b87c-be3e0223bcf3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:50:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:57 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-85e7ed1c-10b4-4c74-b87c-be3e0223bcf3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:50:57 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-85e7ed1c-10b4-4c74-b87c-be3e0223bcf3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:50:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-85e7ed1c-10b4-4c74-b87c-be3e0223bcf3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:50:58 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-85e7ed1c-10b4-4c74-b87c-be3e0223bcf3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Deleted allocations for instance 75731a3d-3c78-4014-a8dc-f38c3d7b3305
Nov 15 04:50:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-85e7ed1c-10b4-4c74-b87c-be3e0223bcf3 tempest-ServerRescueNegativeTestJSON-370335706 tempest-ServerRescueNegativeTestJSON-370335706-project-member] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.768s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:50:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:50:58 user nova-compute[74805]: DEBUG nova.compute.manager [req-3526c216-8e11-41fe-9100-f8e0dc14c280 req-ed9ee7ad-1f97-4fcc-bfbe-7b64f96d6f1f service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received event network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:50:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3526c216-8e11-41fe-9100-f8e0dc14c280 req-ed9ee7ad-1f97-4fcc-bfbe-7b64f96d6f1f service nova] Acquiring lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:50:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3526c216-8e11-41fe-9100-f8e0dc14c280 req-ed9ee7ad-1f97-4fcc-bfbe-7b64f96d6f1f service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:50:58 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-3526c216-8e11-41fe-9100-f8e0dc14c280 req-ed9ee7ad-1f97-4fcc-bfbe-7b64f96d6f1f service nova] Lock "75731a3d-3c78-4014-a8dc-f38c3d7b3305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:50:58 user nova-compute[74805]: DEBUG nova.compute.manager [req-3526c216-8e11-41fe-9100-f8e0dc14c280 req-ed9ee7ad-1f97-4fcc-bfbe-7b64f96d6f1f service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] No waiting events found dispatching network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:50:58 user nova-compute[74805]: WARNING nova.compute.manager [req-3526c216-8e11-41fe-9100-f8e0dc14c280 req-ed9ee7ad-1f97-4fcc-bfbe-7b64f96d6f1f service nova] [instance: 75731a3d-3c78-4014-a8dc-f38c3d7b3305] Received unexpected event network-vif-plugged-39aa6c19-c319-4f9d-ac4e-a1deccecc95a for instance with vm_state deleted and task_state None.
Nov 15 04:50:59 user nova-compute[74805]: DEBUG nova.compute.manager [req-d8f88be2-1674-4fa4-bd8e-3551f5a9f975 req-0fdcd959-8832-4688-8310-28744d2fea52 service nova] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Received event network-vif-plugged-c78711d2-3ecc-4f15-a63e-6168d11069c8 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:50:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d8f88be2-1674-4fa4-bd8e-3551f5a9f975 req-0fdcd959-8832-4688-8310-28744d2fea52 service nova] Acquiring lock "90ef7272-9bdb-4eb9-b97d-57e46b1532de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:50:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d8f88be2-1674-4fa4-bd8e-3551f5a9f975 req-0fdcd959-8832-4688-8310-28744d2fea52 service nova] Lock "90ef7272-9bdb-4eb9-b97d-57e46b1532de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:50:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d8f88be2-1674-4fa4-bd8e-3551f5a9f975 req-0fdcd959-8832-4688-8310-28744d2fea52 service nova] Lock "90ef7272-9bdb-4eb9-b97d-57e46b1532de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:50:59 user nova-compute[74805]: DEBUG nova.compute.manager [req-d8f88be2-1674-4fa4-bd8e-3551f5a9f975 req-0fdcd959-8832-4688-8310-28744d2fea52 service nova] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] No waiting events found dispatching network-vif-plugged-c78711d2-3ecc-4f15-a63e-6168d11069c8 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:50:59 user nova-compute[74805]: WARNING nova.compute.manager [req-d8f88be2-1674-4fa4-bd8e-3551f5a9f975 req-0fdcd959-8832-4688-8310-28744d2fea52 service nova] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Received unexpected event network-vif-plugged-c78711d2-3ecc-4f15-a63e-6168d11069c8 for instance with vm_state building and task_state spawning.
Nov 15 04:50:59 user nova-compute[74805]: DEBUG nova.compute.manager [req-d8f88be2-1674-4fa4-bd8e-3551f5a9f975 req-0fdcd959-8832-4688-8310-28744d2fea52 service nova] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Received event network-vif-plugged-c78711d2-3ecc-4f15-a63e-6168d11069c8 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:50:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d8f88be2-1674-4fa4-bd8e-3551f5a9f975 req-0fdcd959-8832-4688-8310-28744d2fea52 service nova] Acquiring lock "90ef7272-9bdb-4eb9-b97d-57e46b1532de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:50:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d8f88be2-1674-4fa4-bd8e-3551f5a9f975 req-0fdcd959-8832-4688-8310-28744d2fea52 service nova] Lock "90ef7272-9bdb-4eb9-b97d-57e46b1532de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:50:59 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-d8f88be2-1674-4fa4-bd8e-3551f5a9f975 req-0fdcd959-8832-4688-8310-28744d2fea52 service nova] Lock "90ef7272-9bdb-4eb9-b97d-57e46b1532de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:50:59 user nova-compute[74805]: DEBUG nova.compute.manager [req-d8f88be2-1674-4fa4-bd8e-3551f5a9f975 req-0fdcd959-8832-4688-8310-28744d2fea52 service nova] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] No waiting events found dispatching network-vif-plugged-c78711d2-3ecc-4f15-a63e-6168d11069c8 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:50:59 user nova-compute[74805]: WARNING nova.compute.manager [req-d8f88be2-1674-4fa4-bd8e-3551f5a9f975 req-0fdcd959-8832-4688-8310-28744d2fea52 service nova] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Received unexpected event network-vif-plugged-c78711d2-3ecc-4f15-a63e-6168d11069c8 for instance with vm_state building and task_state spawning.
Nov 15 04:51:00 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:51:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:51:00 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Instance spawned successfully.
Nov 15 04:51:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:51:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:51:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:51:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:51:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:51:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:51:00 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:51:00 user nova-compute[74805]: INFO nova.compute.manager [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Took 5.20 seconds to spawn the instance on the hypervisor.
Nov 15 04:51:00 user nova-compute[74805]: DEBUG nova.compute.manager [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:51:00 user nova-compute[74805]: INFO nova.compute.manager [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Took 10.36 seconds to build instance.
Nov 15 04:51:00 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-d457dbbe-6cc0-42d6-9197-4672259e36ad tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "90ef7272-9bdb-4eb9-b97d-57e46b1532de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.452s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:51:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:51:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:51:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:51:08 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:51:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:51:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:51:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:51:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:51:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:51:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:51:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:51:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:51:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:51:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:51:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:51:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:51:30 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:51:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:51:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:51:33 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:51:34 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:51:35 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:51:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:51:37 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:51:37 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Triggering sync for uuid f53096c2-b75c-48ca-8ca9-30cb92ee2733 {{(pid=74805) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 04:51:37 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Triggering sync for uuid 90ef7272-9bdb-4eb9-b97d-57e46b1532de {{(pid=74805) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 04:51:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "f53096c2-b75c-48ca-8ca9-30cb92ee2733" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:51:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "f53096c2-b75c-48ca-8ca9-30cb92ee2733" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:51:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "90ef7272-9bdb-4eb9-b97d-57e46b1532de" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:51:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "90ef7272-9bdb-4eb9-b97d-57e46b1532de" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:51:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "90ef7272-9bdb-4eb9-b97d-57e46b1532de" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:51:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "f53096c2-b75c-48ca-8ca9-30cb92ee2733" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:51:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:51:38 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:51:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:51:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:51:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:51:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:51:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:51:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:51:38 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:51:38 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:51:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=8816MB free_disk=25.083145141601562GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:51:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:51:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:51:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance f53096c2-b75c-48ca-8ca9-30cb92ee2733 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:51:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 90ef7272-9bdb-4eb9-b97d-57e46b1532de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:51:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:51:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:51:38 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Refreshing inventories for resource provider ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 04:51:38 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Updating ProviderTree inventory for provider ada87504-5552-4a33-b754-f9a54c67fe39 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 04:51:38 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Updating inventory in ProviderTree for provider ada87504-5552-4a33-b754-f9a54c67fe39 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 04:51:38 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Refreshing aggregate associations for resource provider ada87504-5552-4a33-b754-f9a54c67fe39, aggregates: None {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 04:51:38 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Refreshing trait associations for resource provider ada87504-5552-4a33-b754-f9a54c67fe39, traits: COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 04:51:38 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:51:38 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:51:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:51:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.413s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:51:39 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:51:39 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:51:41 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:51:41 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:51:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-f53096c2-b75c-48ca-8ca9-30cb92ee2733" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:51:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-f53096c2-b75c-48ca-8ca9-30cb92ee2733" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:51:41 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:51:41 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:51:41 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Updating instance_info_cache with network_info: [{"id": "dcfd0e9b-4eb7-456d-a50f-2e14b1763e56", "address": "fa:16:3e:33:b1:4f", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfd0e9b-4e", "ovs_interfaceid": "dcfd0e9b-4eb7-456d-a50f-2e14b1763e56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:51:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-f53096c2-b75c-48ca-8ca9-30cb92ee2733" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:51:41 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:51:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:51:45 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:51:45 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:51:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:51:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:51:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:51:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:51:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:52:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:52:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:52:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:52:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:52:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:52:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:52:30 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:52:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:52:35 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:52:35 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:52:36 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:52:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:52:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:52:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:52:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:52:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:52:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:52:38 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:52:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:52:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:52:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:52:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:52:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:52:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74805) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 04:52:38 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:52:38 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:52:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=8857MB free_disk=25.080013275146484GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:52:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:52:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:52:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance f53096c2-b75c-48ca-8ca9-30cb92ee2733 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:52:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 90ef7272-9bdb-4eb9-b97d-57e46b1532de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:52:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:52:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:52:38 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:52:38 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:52:38 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:52:38 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:52:40 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:52:41 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:52:41 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:52:41 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Rebuilding the list of instances to heal {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 04:52:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-f53096c2-b75c-48ca-8ca9-30cb92ee2733" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:52:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-f53096c2-b75c-48ca-8ca9-30cb92ee2733" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:52:41 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:52:41 user nova-compute[74805]: DEBUG nova.objects.instance [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lazy-loading 'info_cache' on Instance uuid f53096c2-b75c-48ca-8ca9-30cb92ee2733 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:52:41 user nova-compute[74805]: DEBUG nova.compute.manager [req-2105a3da-f50b-4a57-aca5-290d8ebe7ee8 req-e0b08b9e-9dc7-40eb-a046-af97801af18a service nova] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Received event network-changed-c78711d2-3ecc-4f15-a63e-6168d11069c8 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:52:41 user nova-compute[74805]: DEBUG nova.compute.manager [req-2105a3da-f50b-4a57-aca5-290d8ebe7ee8 req-e0b08b9e-9dc7-40eb-a046-af97801af18a service nova] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Refreshing instance network info cache due to event network-changed-c78711d2-3ecc-4f15-a63e-6168d11069c8. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:52:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2105a3da-f50b-4a57-aca5-290d8ebe7ee8 req-e0b08b9e-9dc7-40eb-a046-af97801af18a service nova] Acquiring lock "refresh_cache-90ef7272-9bdb-4eb9-b97d-57e46b1532de" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:52:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2105a3da-f50b-4a57-aca5-290d8ebe7ee8 req-e0b08b9e-9dc7-40eb-a046-af97801af18a service nova] Acquired lock "refresh_cache-90ef7272-9bdb-4eb9-b97d-57e46b1532de" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:52:41 user nova-compute[74805]: DEBUG nova.network.neutron [req-2105a3da-f50b-4a57-aca5-290d8ebe7ee8 req-e0b08b9e-9dc7-40eb-a046-af97801af18a service nova] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Refreshing network info cache for port c78711d2-3ecc-4f15-a63e-6168d11069c8 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:52:41 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Updating instance_info_cache with network_info: [{"id": "dcfd0e9b-4eb7-456d-a50f-2e14b1763e56", "address": "fa:16:3e:33:b1:4f", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfd0e9b-4e", "ovs_interfaceid": "dcfd0e9b-4eb7-456d-a50f-2e14b1763e56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:52:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-f53096c2-b75c-48ca-8ca9-30cb92ee2733" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:52:41 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:52:41 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:52:41 user nova-compute[74805]: DEBUG nova.network.neutron [req-2105a3da-f50b-4a57-aca5-290d8ebe7ee8 req-e0b08b9e-9dc7-40eb-a046-af97801af18a service nova] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Updated VIF entry in instance network info cache for port c78711d2-3ecc-4f15-a63e-6168d11069c8. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:52:41 user nova-compute[74805]: DEBUG nova.network.neutron [req-2105a3da-f50b-4a57-aca5-290d8ebe7ee8 req-e0b08b9e-9dc7-40eb-a046-af97801af18a service nova] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Updating instance_info_cache with network_info: [{"id": "c78711d2-3ecc-4f15-a63e-6168d11069c8", "address": "fa:16:3e:f3:89:e9", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc78711d2-3e", "ovs_interfaceid": "c78711d2-3ecc-4f15-a63e-6168d11069c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:52:41 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-2105a3da-f50b-4a57-aca5-290d8ebe7ee8 req-e0b08b9e-9dc7-40eb-a046-af97801af18a service nova] Releasing lock "refresh_cache-90ef7272-9bdb-4eb9-b97d-57e46b1532de" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:52:42 user nova-compute[74805]: DEBUG nova.compute.manager [req-dcae9db4-0652-4fae-8f4a-d9ed31cc7998 req-25fc332b-0f9d-497f-b29c-9a184f038b64 service nova] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Received event network-changed-c78711d2-3ecc-4f15-a63e-6168d11069c8 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:52:42 user nova-compute[74805]: DEBUG nova.compute.manager [req-dcae9db4-0652-4fae-8f4a-d9ed31cc7998 req-25fc332b-0f9d-497f-b29c-9a184f038b64 service nova] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Refreshing instance network info cache due to event network-changed-c78711d2-3ecc-4f15-a63e-6168d11069c8. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:52:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-dcae9db4-0652-4fae-8f4a-d9ed31cc7998 req-25fc332b-0f9d-497f-b29c-9a184f038b64 service nova] Acquiring lock "refresh_cache-90ef7272-9bdb-4eb9-b97d-57e46b1532de" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:52:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-dcae9db4-0652-4fae-8f4a-d9ed31cc7998 req-25fc332b-0f9d-497f-b29c-9a184f038b64 service nova] Acquired lock "refresh_cache-90ef7272-9bdb-4eb9-b97d-57e46b1532de" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:52:42 user nova-compute[74805]: DEBUG nova.network.neutron [req-dcae9db4-0652-4fae-8f4a-d9ed31cc7998 req-25fc332b-0f9d-497f-b29c-9a184f038b64 service nova] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Refreshing network info cache for port c78711d2-3ecc-4f15-a63e-6168d11069c8 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:52:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:52:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "90ef7272-9bdb-4eb9-b97d-57e46b1532de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:52:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "90ef7272-9bdb-4eb9-b97d-57e46b1532de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:52:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "90ef7272-9bdb-4eb9-b97d-57e46b1532de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:52:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "90ef7272-9bdb-4eb9-b97d-57e46b1532de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:52:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "90ef7272-9bdb-4eb9-b97d-57e46b1532de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:52:42 user nova-compute[74805]: INFO nova.compute.manager [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Terminating instance
Nov 15 04:52:42 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:52:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:52:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:52:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:52:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:52:42 user nova-compute[74805]: DEBUG nova.compute.manager [req-bd02f2ca-161b-4f3f-a4d7-cc612af3b9be req-085baf06-1f97-4994-be27-241aca694391 service nova] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Received event network-vif-unplugged-c78711d2-3ecc-4f15-a63e-6168d11069c8 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:52:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bd02f2ca-161b-4f3f-a4d7-cc612af3b9be req-085baf06-1f97-4994-be27-241aca694391 service nova] Acquiring lock "90ef7272-9bdb-4eb9-b97d-57e46b1532de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:52:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bd02f2ca-161b-4f3f-a4d7-cc612af3b9be req-085baf06-1f97-4994-be27-241aca694391 service nova] Lock "90ef7272-9bdb-4eb9-b97d-57e46b1532de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:52:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-bd02f2ca-161b-4f3f-a4d7-cc612af3b9be req-085baf06-1f97-4994-be27-241aca694391 service nova] Lock "90ef7272-9bdb-4eb9-b97d-57e46b1532de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:52:42 user nova-compute[74805]: DEBUG nova.compute.manager [req-bd02f2ca-161b-4f3f-a4d7-cc612af3b9be req-085baf06-1f97-4994-be27-241aca694391 service nova] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] No waiting events found dispatching network-vif-unplugged-c78711d2-3ecc-4f15-a63e-6168d11069c8 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:52:42 user nova-compute[74805]: DEBUG nova.compute.manager [req-bd02f2ca-161b-4f3f-a4d7-cc612af3b9be req-085baf06-1f97-4994-be27-241aca694391 service nova] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Received event network-vif-unplugged-c78711d2-3ecc-4f15-a63e-6168d11069c8 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG nova.network.neutron [req-dcae9db4-0652-4fae-8f4a-d9ed31cc7998 req-25fc332b-0f9d-497f-b29c-9a184f038b64 service nova] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Updated VIF entry in instance network info cache for port c78711d2-3ecc-4f15-a63e-6168d11069c8. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG nova.network.neutron [req-dcae9db4-0652-4fae-8f4a-d9ed31cc7998 req-25fc332b-0f9d-497f-b29c-9a184f038b64 service nova] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Updating instance_info_cache with network_info: [{"id": "c78711d2-3ecc-4f15-a63e-6168d11069c8", "address": "fa:16:3e:f3:89:e9", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc78711d2-3e", "ovs_interfaceid": "c78711d2-3ecc-4f15-a63e-6168d11069c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-dcae9db4-0652-4fae-8f4a-d9ed31cc7998 req-25fc332b-0f9d-497f-b29c-9a184f038b64 service nova] Releasing lock "refresh_cache-90ef7272-9bdb-4eb9-b97d-57e46b1532de" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:52:43 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Instance destroyed successfully.
Nov 15 04:52:43 user nova-compute[74805]: DEBUG nova.objects.instance [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lazy-loading 'resources' on Instance uuid 90ef7272-9bdb-4eb9-b97d-57e46b1532de {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:50:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-333371252',display_name='tempest-TestVolumeBootPattern-server-333371252',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-333371252',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPSZsjBao2IiCSH6iNxCBnd9/tVkNXbrNJpEOjeMrEDWwanT/XX2Dcm8vpngfLnbfGhydqc2p2DnAgn/CCrGmL8T0FuaHg/KrFgmSAIbSmou7lS7rh9h9Z85pHvQBKirA==',key_name='tempest-TestVolumeBootPattern-1567239913',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:51:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2744859f249a4326ab6d268319a34b7f',ramdisk_id='',reservation_id='r-rv6x07c3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2043506637',owner_user_name='tempest-TestVolumeBootPattern-2043506637-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:51:00Z,user_data=None,user_id='0bd96ecd9d404779ad64456c6517591f',uuid=90ef7272-9bdb-4eb9-b97d-57e46b1532de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c78711d2-3ecc-4f15-a63e-6168d11069c8", "address": "fa:16:3e:f3:89:e9", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc78711d2-3e", "ovs_interfaceid": "c78711d2-3ecc-4f15-a63e-6168d11069c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converting VIF {"id": "c78711d2-3ecc-4f15-a63e-6168d11069c8", "address": "fa:16:3e:f3:89:e9", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc78711d2-3e", "ovs_interfaceid": "c78711d2-3ecc-4f15-a63e-6168d11069c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:89:e9,bridge_name='br-int',has_traffic_filtering=True,id=c78711d2-3ecc-4f15-a63e-6168d11069c8,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc78711d2-3e') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG os_vif [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:89:e9,bridge_name='br-int',has_traffic_filtering=True,id=c78711d2-3ecc-4f15-a63e-6168d11069c8,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc78711d2-3e') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc78711d2-3e, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3217353e-4b43-4252-a82c-1db875a55a80) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:52:43 user nova-compute[74805]: INFO os_vif [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:89:e9,bridge_name='br-int',has_traffic_filtering=True,id=c78711d2-3ecc-4f15-a63e-6168d11069c8,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc78711d2-3e')
Nov 15 04:52:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ocISwfkT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:52:43 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:52:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[04512f81-4b7c-4b25-bbf1-785bf8737b5e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:52:43 user nova-compute[74805]: No targets found.
Nov 15 04:52:43 user nova-compute[74805]: iSNS:
Nov 15 04:52:43 user nova-compute[74805]: No targets found.
Nov 15 04:52:43 user nova-compute[74805]: STATIC:
Nov 15 04:52:43 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f
Nov 15 04:52:43 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:52:43 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:52:43 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721
Nov 15 04:52:43 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:52:43 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:52:43 user nova-compute[74805]: FIRMWARE:
Nov 15 04:52:43 user nova-compute[74805]: No targets found.
Nov 15 04:52:43 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:52:43 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:52:43 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[790c86f0-7aa2-41ab-8035-9ac3aa6193bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[256c3156-c10c-4751-8715-adb1fd18822a]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f (non-flash)
Nov 15 04:52:43 user nova-compute[74805]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721 (non-flash)
Nov 15 04:52:43 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f (non-flash)
Nov 15 04:52:43 user nova-compute[74805]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721 (non-flash)
Nov 15 04:52:43 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c11b520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721'): ({'sdc'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Removing single pathed devices sdc {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02febb5-fd63-482f-9097-514c30b869bb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[57298e92-7e6e-46b6-8461-000fa6c69886]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Flushing IO for device /dev/sdc {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[108367db-316a-4569-b494-336d84268cc2]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.119s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dedaa8-fe48-4203-9ddb-556f86685b6f]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] SCSI volumes sdc have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf96c1e6-84e3-4761-8c10-6818ab1b2196]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[09577187-8771-4ccc-9394-8d5d9dfc98f2]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721, portal: 172.16.0.220,3260]
Nov 15 04:52:43 user nova-compute[74805]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721, portal: 172.16.0.220,3260] successful.
Nov 15 04:52:43 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b335fd0-83cc-49f5-9e7c-9906fcbdf721 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32e8907-2eb9-43cb-9be9-c388f4090349]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] <== disconnect_volume: return (375ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:52:43 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Deleting instance files /opt/stack/data/nova/instances/90ef7272-9bdb-4eb9-b97d-57e46b1532de_del
Nov 15 04:52:43 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Deletion of /opt/stack/data/nova/instances/90ef7272-9bdb-4eb9-b97d-57e46b1532de_del complete
Nov 15 04:52:43 user nova-compute[74805]: INFO nova.compute.manager [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 15 04:52:43 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:52:43 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:52:44 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:52:44 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Took 0.39 seconds to deallocate network for instance.
Nov 15 04:52:44 user nova-compute[74805]: DEBUG nova.compute.manager [req-997bd895-58c1-46fc-9c40-90a31f733ea7 req-c563e9cc-3e11-4f06-a548-ce8bccf1d700 service nova] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Received event network-vif-deleted-c78711d2-3ecc-4f15-a63e-6168d11069c8 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:52:44 user nova-compute[74805]: DEBUG nova.compute.manager [req-e8c43fae-b881-4d64-acdc-94d0b6bdc5df req-79035ac5-8737-4b02-8858-e8a4e603f681 service nova] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Received event network-vif-plugged-c78711d2-3ecc-4f15-a63e-6168d11069c8 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:52:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e8c43fae-b881-4d64-acdc-94d0b6bdc5df req-79035ac5-8737-4b02-8858-e8a4e603f681 service nova] Acquiring lock "90ef7272-9bdb-4eb9-b97d-57e46b1532de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:52:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e8c43fae-b881-4d64-acdc-94d0b6bdc5df req-79035ac5-8737-4b02-8858-e8a4e603f681 service nova] Lock "90ef7272-9bdb-4eb9-b97d-57e46b1532de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:52:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e8c43fae-b881-4d64-acdc-94d0b6bdc5df req-79035ac5-8737-4b02-8858-e8a4e603f681 service nova] Lock "90ef7272-9bdb-4eb9-b97d-57e46b1532de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:52:44 user nova-compute[74805]: DEBUG nova.compute.manager [req-e8c43fae-b881-4d64-acdc-94d0b6bdc5df req-79035ac5-8737-4b02-8858-e8a4e603f681 service nova] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] No waiting events found dispatching network-vif-plugged-c78711d2-3ecc-4f15-a63e-6168d11069c8 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:52:44 user nova-compute[74805]: WARNING nova.compute.manager [req-e8c43fae-b881-4d64-acdc-94d0b6bdc5df req-79035ac5-8737-4b02-8858-e8a4e603f681 service nova] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Received unexpected event network-vif-plugged-c78711d2-3ecc-4f15-a63e-6168d11069c8 for instance with vm_state active and task_state deleting.
Nov 15 04:52:45 user nova-compute[74805]: INFO nova.compute.manager [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: 90ef7272-9bdb-4eb9-b97d-57e46b1532de] Took 0.97 seconds to detach 1 volumes for instance.
Nov 15 04:52:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:52:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:52:45 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:52:45 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:52:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:52:45 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Deleted allocations for instance 90ef7272-9bdb-4eb9-b97d-57e46b1532de
Nov 15 04:52:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cf912aa3-ac4d-4b0f-aa44-d96729dc55f6 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "90ef7272-9bdb-4eb9-b97d-57e46b1532de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.922s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:52:45 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:52:46 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:52:46 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:52:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:52:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:52:53 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:52:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:53:01 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:53:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:53:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:53:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:53:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:53:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:53:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:53:31 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:53:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:53:36 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:53:36 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:53:37 user nova-compute[74805]: DEBUG nova.compute.manager [req-e9db0838-ddfb-43be-9963-f49ed6141875 req-ac2e863b-e131-44cc-8d14-902af932b3cc service nova] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Received event network-changed-dcfd0e9b-4eb7-456d-a50f-2e14b1763e56 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:53:37 user nova-compute[74805]: DEBUG nova.compute.manager [req-e9db0838-ddfb-43be-9963-f49ed6141875 req-ac2e863b-e131-44cc-8d14-902af932b3cc service nova] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Refreshing instance network info cache due to event network-changed-dcfd0e9b-4eb7-456d-a50f-2e14b1763e56. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:53:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e9db0838-ddfb-43be-9963-f49ed6141875 req-ac2e863b-e131-44cc-8d14-902af932b3cc service nova] Acquiring lock "refresh_cache-f53096c2-b75c-48ca-8ca9-30cb92ee2733" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:53:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e9db0838-ddfb-43be-9963-f49ed6141875 req-ac2e863b-e131-44cc-8d14-902af932b3cc service nova] Acquired lock "refresh_cache-f53096c2-b75c-48ca-8ca9-30cb92ee2733" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:53:37 user nova-compute[74805]: DEBUG nova.network.neutron [req-e9db0838-ddfb-43be-9963-f49ed6141875 req-ac2e863b-e131-44cc-8d14-902af932b3cc service nova] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Refreshing network info cache for port dcfd0e9b-4eb7-456d-a50f-2e14b1763e56 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:53:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "f53096c2-b75c-48ca-8ca9-30cb92ee2733" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:53:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "f53096c2-b75c-48ca-8ca9-30cb92ee2733" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:53:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "f53096c2-b75c-48ca-8ca9-30cb92ee2733-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:53:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "f53096c2-b75c-48ca-8ca9-30cb92ee2733-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:53:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "f53096c2-b75c-48ca-8ca9-30cb92ee2733-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:53:37 user nova-compute[74805]: INFO nova.compute.manager [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Terminating instance
Nov 15 04:53:37 user nova-compute[74805]: DEBUG nova.compute.manager [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 04:53:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:53:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:53:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:53:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:53:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:53:37 user nova-compute[74805]: DEBUG nova.compute.manager [req-e1e7d138-6f31-49bd-8093-ad0c9824de8e req-722c62bf-58ef-421e-aa1c-21b3fca83c57 service nova] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Received event network-vif-unplugged-dcfd0e9b-4eb7-456d-a50f-2e14b1763e56 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:53:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e1e7d138-6f31-49bd-8093-ad0c9824de8e req-722c62bf-58ef-421e-aa1c-21b3fca83c57 service nova] Acquiring lock "f53096c2-b75c-48ca-8ca9-30cb92ee2733-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:53:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e1e7d138-6f31-49bd-8093-ad0c9824de8e req-722c62bf-58ef-421e-aa1c-21b3fca83c57 service nova] Lock "f53096c2-b75c-48ca-8ca9-30cb92ee2733-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:53:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e1e7d138-6f31-49bd-8093-ad0c9824de8e req-722c62bf-58ef-421e-aa1c-21b3fca83c57 service nova] Lock "f53096c2-b75c-48ca-8ca9-30cb92ee2733-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:53:37 user nova-compute[74805]: DEBUG nova.compute.manager [req-e1e7d138-6f31-49bd-8093-ad0c9824de8e req-722c62bf-58ef-421e-aa1c-21b3fca83c57 service nova] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] No waiting events found dispatching network-vif-unplugged-dcfd0e9b-4eb7-456d-a50f-2e14b1763e56 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:53:37 user nova-compute[74805]: DEBUG nova.compute.manager [req-e1e7d138-6f31-49bd-8093-ad0c9824de8e req-722c62bf-58ef-421e-aa1c-21b3fca83c57 service nova] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Received event network-vif-unplugged-dcfd0e9b-4eb7-456d-a50f-2e14b1763e56 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 04:53:37 user nova-compute[74805]: DEBUG nova.network.neutron [req-e9db0838-ddfb-43be-9963-f49ed6141875 req-ac2e863b-e131-44cc-8d14-902af932b3cc service nova] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Updated VIF entry in instance network info cache for port dcfd0e9b-4eb7-456d-a50f-2e14b1763e56. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:53:37 user nova-compute[74805]: DEBUG nova.network.neutron [req-e9db0838-ddfb-43be-9963-f49ed6141875 req-ac2e863b-e131-44cc-8d14-902af932b3cc service nova] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Updating instance_info_cache with network_info: [{"id": "dcfd0e9b-4eb7-456d-a50f-2e14b1763e56", "address": "fa:16:3e:33:b1:4f", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfd0e9b-4e", "ovs_interfaceid": "dcfd0e9b-4eb7-456d-a50f-2e14b1763e56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:53:37 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e9db0838-ddfb-43be-9963-f49ed6141875 req-ac2e863b-e131-44cc-8d14-902af932b3cc service nova] Releasing lock "refresh_cache-f53096c2-b75c-48ca-8ca9-30cb92ee2733" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:53:38 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Instance destroyed successfully.
Nov 15 04:53:38 user nova-compute[74805]: DEBUG nova.objects.instance [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lazy-loading 'resources' on Instance uuid f53096c2-b75c-48ca-8ca9-30cb92ee2733 {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:48:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-283977774',display_name='tempest-TestVolumeBootPattern-server-283977774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-283977774',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPSZsjBao2IiCSH6iNxCBnd9/tVkNXbrNJpEOjeMrEDWwanT/XX2Dcm8vpngfLnbfGhydqc2p2DnAgn/CCrGmL8T0FuaHg/KrFgmSAIbSmou7lS7rh9h9Z85pHvQBKirA==',key_name='tempest-TestVolumeBootPattern-1567239913',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:49:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2744859f249a4326ab6d268319a34b7f',ramdisk_id='',reservation_id='r-hl800ok3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2043506637',owner_user_name='tempest-TestVolumeBootPattern-2043506637-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:49:04Z,user_data=None,user_id='0bd96ecd9d404779ad64456c6517591f',uuid=f53096c2-b75c-48ca-8ca9-30cb92ee2733,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcfd0e9b-4eb7-456d-a50f-2e14b1763e56", "address": "fa:16:3e:33:b1:4f", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfd0e9b-4e", "ovs_interfaceid": "dcfd0e9b-4eb7-456d-a50f-2e14b1763e56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converting VIF {"id": "dcfd0e9b-4eb7-456d-a50f-2e14b1763e56", "address": "fa:16:3e:33:b1:4f", "network": {"id": "36fb5df3-49ad-4d54-86e7-7a559dc8270d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-140387873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2744859f249a4326ab6d268319a34b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcfd0e9b-4e", "ovs_interfaceid": "dcfd0e9b-4eb7-456d-a50f-2e14b1763e56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:b1:4f,bridge_name='br-int',has_traffic_filtering=True,id=dcfd0e9b-4eb7-456d-a50f-2e14b1763e56,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfd0e9b-4e') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG os_vif [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:b1:4f,bridge_name='br-int',has_traffic_filtering=True,id=dcfd0e9b-4eb7-456d-a50f-2e14b1763e56,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfd0e9b-4e') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdcfd0e9b-4e, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a3b5cdc-c12b-4f27-806e-b57c7a368399) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:53:38 user nova-compute[74805]: INFO os_vif [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:b1:4f,bridge_name='br-int',has_traffic_filtering=True,id=dcfd0e9b-4eb7-456d-a50f-2e14b1763e56,network=Network(36fb5df3-49ad-4d54-86e7-7a559dc8270d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcfd0e9b-4e')
Nov 15 04:53:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WziNdebE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:53:38 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:53:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ff7b1e-1842-4a5a-9408-97905ce23801]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:53:38 user nova-compute[74805]: No targets found.
Nov 15 04:53:38 user nova-compute[74805]: iSNS:
Nov 15 04:53:38 user nova-compute[74805]: No targets found.
Nov 15 04:53:38 user nova-compute[74805]: STATIC:
Nov 15 04:53:38 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f
Nov 15 04:53:38 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:53:38 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:53:38 user nova-compute[74805]: FIRMWARE:
Nov 15 04:53:38 user nova-compute[74805]: No targets found.
Nov 15 04:53:38 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:53:38 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:53:38 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[09509bb2-1b56-4eb4-88d3-c7d85a9e33e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0136abb-db63-4f1a-9791-6059e006479b]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f (non-flash)
Nov 15 04:53:38 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f (non-flash)
Nov 15 04:53:38 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2fac21ecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f'): ({'sdb'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Removing single pathed devices sdb {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a711b92-6cb2-449a-a81c-693b48119361]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abf6bf7-a76e-4ac4-b7c9-b175778b37d5]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Flushing IO for device /dev/sdb {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a548bf65-a383-4edb-b326-ba7329f94375]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5204947-80d1-44ec-8c18-d728e456d520]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[353758b0-1351-47c0-bd74-76ac0214ffac]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[112964ce-7b73-44db-af5c-9e27aeab24bd]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f, portal: 172.16.0.220,3260]
Nov 15 04:53:38 user nova-compute[74805]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f, portal: 172.16.0.220,3260] successful.
Nov 15 04:53:38 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddff8d6c-cbbb-45d2-8883-a5cd5db9478f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6d5838-1cf1-4cb8-a46e-703ba2301df5]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] <== disconnect_volume: return (299ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:53:38 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Deleting instance files /opt/stack/data/nova/instances/f53096c2-b75c-48ca-8ca9-30cb92ee2733_del
Nov 15 04:53:38 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Deletion of /opt/stack/data/nova/instances/f53096c2-b75c-48ca-8ca9-30cb92ee2733_del complete
Nov 15 04:53:38 user nova-compute[74805]: INFO nova.compute.manager [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 15 04:53:38 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 04:53:38 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 04:53:39 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:53:39 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Took 0.36 seconds to deallocate network for instance.
Nov 15 04:53:39 user nova-compute[74805]: DEBUG nova.compute.manager [req-c008f0e9-e980-4970-be24-3121d8667524 req-5f84d53d-deb3-4f35-ab4f-f2afc85a696e service nova] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Received event network-vif-deleted-dcfd0e9b-4eb7-456d-a50f-2e14b1763e56 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:53:39 user nova-compute[74805]: INFO nova.compute.manager [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Took 0.71 seconds to detach 1 volumes for instance.
Nov 15 04:53:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:53:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:53:39 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:53:39 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:53:39 user nova-compute[74805]: DEBUG nova.compute.manager [req-26605928-5dca-4971-8c98-b0e892e9a071 req-b530ffd3-f7c6-406b-977a-7d15c29615c7 service nova] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Received event network-vif-plugged-dcfd0e9b-4eb7-456d-a50f-2e14b1763e56 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:53:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-26605928-5dca-4971-8c98-b0e892e9a071 req-b530ffd3-f7c6-406b-977a-7d15c29615c7 service nova] Acquiring lock "f53096c2-b75c-48ca-8ca9-30cb92ee2733-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:53:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-26605928-5dca-4971-8c98-b0e892e9a071 req-b530ffd3-f7c6-406b-977a-7d15c29615c7 service nova] Lock "f53096c2-b75c-48ca-8ca9-30cb92ee2733-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:53:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-26605928-5dca-4971-8c98-b0e892e9a071 req-b530ffd3-f7c6-406b-977a-7d15c29615c7 service nova] Lock "f53096c2-b75c-48ca-8ca9-30cb92ee2733-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:53:39 user nova-compute[74805]: DEBUG nova.compute.manager [req-26605928-5dca-4971-8c98-b0e892e9a071 req-b530ffd3-f7c6-406b-977a-7d15c29615c7 service nova] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] No waiting events found dispatching network-vif-plugged-dcfd0e9b-4eb7-456d-a50f-2e14b1763e56 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:53:39 user nova-compute[74805]: WARNING nova.compute.manager [req-26605928-5dca-4971-8c98-b0e892e9a071 req-b530ffd3-f7c6-406b-977a-7d15c29615c7 service nova] [instance: f53096c2-b75c-48ca-8ca9-30cb92ee2733] Received unexpected event network-vif-plugged-dcfd0e9b-4eb7-456d-a50f-2e14b1763e56 for instance with vm_state deleted and task_state None.
Nov 15 04:53:39 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.118s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:53:39 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Deleted allocations for instance f53096c2-b75c-48ca-8ca9-30cb92ee2733
Nov 15 04:53:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ce9af987-e71f-46d4-8c6c-13e3d3b5f018 tempest-TestVolumeBootPattern-2043506637 tempest-TestVolumeBootPattern-2043506637-project-member] Lock "f53096c2-b75c-48ca-8ca9-30cb92ee2733" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.492s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:53:40 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:53:40 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:53:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:53:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:53:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:53:40 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:53:40 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:53:40 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:53:40 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=9089MB free_disk=25.07021713256836GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:53:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:53:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:53:40 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:53:40 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:53:40 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:53:40 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:53:40 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:53:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:53:41 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:53:43 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:53:43 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:53:43 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Didn't find any instances for network info cache update. {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 04:53:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:53:47 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:53:47 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:53:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:53:53 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:53:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:54:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:54:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:54:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:54:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:54:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:54:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:54:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:54:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:54:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:54:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:54:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:54:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:54:31 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:54:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:54:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:54:36 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:54:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:54:38 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:54:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:54:39 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:54:40 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:54:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:54:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:54:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:54:40 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:54:40 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:54:40 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:54:40 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=9242MB free_disk=25.06902313232422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:54:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:54:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:54:40 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:54:40 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:54:40 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:54:40 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:54:40 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:54:40 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:54:41 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:54:43 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:54:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:54:44 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:54:44 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:54:44 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Rebuilding the list of instances to heal {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 04:54:44 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Didn't find any instances for network info cache update. {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 04:54:47 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:54:47 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:54:47 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:54:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:54:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:54:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:54:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:54:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:54:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:54:53 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:54:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:06 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "1d786dce-e06c-4b52-b399-d7a71858314b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:55:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:55:19 user nova-compute[74805]: DEBUG nova.compute.manager [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Starting instance... {{(pid=74805) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 04:55:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:55:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:55:19 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74805) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 04:55:19 user nova-compute[74805]: INFO nova.compute.claims [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Claim successful on node user
Nov 15 04:55:20 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:55:20 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:55:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.231s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:55:20 user nova-compute[74805]: DEBUG nova.compute.manager [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Start building networks asynchronously for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 04:55:20 user nova-compute[74805]: DEBUG nova.compute.manager [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Allocating IP information in the background. {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 04:55:20 user nova-compute[74805]: DEBUG nova.network.neutron [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] allocate_for_instance() {{(pid=74805) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 04:55:20 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 04:55:20 user nova-compute[74805]: DEBUG nova.compute.manager [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Start building block device mappings for instance. {{(pid=74805) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 04:55:20 user nova-compute[74805]: DEBUG nova.compute.manager [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Start spawning the instance on the hypervisor. {{(pid=74805) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 04:55:20 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Creating instance directory {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 04:55:20 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Creating image(s)
Nov 15 04:55:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:55:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "/opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:55:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "/opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:55:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:55:20 user nova-compute[74805]: DEBUG nova.policy [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a03ee5d41faf471daf6cf2372c74483b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aff64a19c18461e85b60ee9d4984eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74805) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 04:55:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.185s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:55:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:55:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:55:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:55:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.225s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:55:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk 1073741824 {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:55:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9,backing_fmt=raw /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk 1073741824" returned: 0 in 0.074s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:55:20 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "8298f0be92f6485351ab1eaa3d445eec10b5ebe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:55:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:55:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8298f0be92f6485351ab1eaa3d445eec10b5ebe9 --force-share --output=json" returned: 0 in 0.174s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:55:21 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk. size=1073741824 {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 04:55:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:55:21 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:55:21 user nova-compute[74805]: DEBUG nova.virt.disk.api [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Cannot resize image /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk to a smaller size. {{(pid=74805) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 04:55:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Created local disks {{(pid=74805) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 04:55:21 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Ensure instance console log exists: /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/console.log {{(pid=74805) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 04:55:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:55:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:55:21 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:55:21 user nova-compute[74805]: DEBUG nova.network.neutron [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Successfully created port: a934aede-0db0-4ac2-90ae-cca05c77fbf7 {{(pid=74805) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 04:55:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:21 user nova-compute[74805]: DEBUG nova.network.neutron [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Successfully updated port: a934aede-0db0-4ac2-90ae-cca05c77fbf7 {{(pid=74805) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "refresh_cache-1d786dce-e06c-4b52-b399-d7a71858314b" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquired lock "refresh_cache-1d786dce-e06c-4b52-b399-d7a71858314b" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.network.neutron [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Building network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-245639e4-feae-42e4-81eb-06bb95eb09c5 req-c3bfa57c-8843-40ec-b0f2-339fb3267258 service nova] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Received event network-changed-a934aede-0db0-4ac2-90ae-cca05c77fbf7 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.compute.manager [req-245639e4-feae-42e4-81eb-06bb95eb09c5 req-c3bfa57c-8843-40ec-b0f2-339fb3267258 service nova] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Refreshing instance network info cache due to event network-changed-a934aede-0db0-4ac2-90ae-cca05c77fbf7. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-245639e4-feae-42e4-81eb-06bb95eb09c5 req-c3bfa57c-8843-40ec-b0f2-339fb3267258 service nova] Acquiring lock "refresh_cache-1d786dce-e06c-4b52-b399-d7a71858314b" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.network.neutron [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Instance cache missing network info. {{(pid=74805) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.network.neutron [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Updating instance_info_cache with network_info: [{"id": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "address": "fa:16:3e:50:a1:75", "network": {"id": "6e9ff022-e661-4a79-aca7-18f30f23041f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-214841182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aff64a19c18461e85b60ee9d4984eb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa934aede-0d", "ovs_interfaceid": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Releasing lock "refresh_cache-1d786dce-e06c-4b52-b399-d7a71858314b" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.compute.manager [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Instance network_info: |[{"id": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "address": "fa:16:3e:50:a1:75", "network": {"id": "6e9ff022-e661-4a79-aca7-18f30f23041f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-214841182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aff64a19c18461e85b60ee9d4984eb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa934aede-0d", "ovs_interfaceid": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74805) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-245639e4-feae-42e4-81eb-06bb95eb09c5 req-c3bfa57c-8843-40ec-b0f2-339fb3267258 service nova] Acquired lock "refresh_cache-1d786dce-e06c-4b52-b399-d7a71858314b" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.network.neutron [req-245639e4-feae-42e4-81eb-06bb95eb09c5 req-c3bfa57c-8843-40ec-b0f2-339fb3267258 service nova] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Refreshing network info cache for port a934aede-0db0-4ac2-90ae-cca05c77fbf7 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Start _get_guest_xml network_info=[{"id": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "address": "fa:16:3e:50:a1:75", "network": {"id": "6e9ff022-e661-4a79-aca7-18f30f23041f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-214841182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aff64a19c18461e85b60ee9d4984eb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa934aede-0d", "ovs_interfaceid": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'f5f2780a-c8f6-40c5-9044-7e9b73af604f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 04:55:22 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:55:22 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] CPU controller missing on host. {{(pid=74805) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.host [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] CPU controller found on host. {{(pid=74805) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74805) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T04:10:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T04:10:26Z,direct_url=<?>,disk_format='qcow2',id=f5f2780a-c8f6-40c5-9044-7e9b73af604f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='73611220d55a49e9a671c10706774c3c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T04:10:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Flavor limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Image limits 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Flavor pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Image pref 0:0:0 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Got 1 possible topologies {{(pid=74805) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.virt.hardware [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74805) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:55:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-672169126',display_name='tempest-SnapshotDataIntegrityTests-server-672169126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-672169126',id=53,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOCmr2zA7VkJ979UR7BPs/ZcsKwB5MEYYTQ0pH76KIRA79yZaHxCl0oMM26oWr7c2hoeFWIZ7AL2t0q2AsR+AH6Yl2U31Ny5zCH+W9PSmyT9q+wLUvASUe7fQdngltvtQ==',key_name='tempest-keypair-1112931856',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7aff64a19c18461e85b60ee9d4984eb3',ramdisk_id='',reservation_id='r-hnl0mkxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1537820554',owner_user_name='tempest-SnapshotDataIntegrityTests-1537820554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:55:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a03ee5d41faf471daf6cf2372c74483b',uuid=1d786dce-e06c-4b52-b399-d7a71858314b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "address": "fa:16:3e:50:a1:75", "network": {"id": "6e9ff022-e661-4a79-aca7-18f30f23041f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-214841182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aff64a19c18461e85b60ee9d4984eb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa934aede-0d", "ovs_interfaceid": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74805) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Converting VIF {"id": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "address": "fa:16:3e:50:a1:75", "network": {"id": "6e9ff022-e661-4a79-aca7-18f30f23041f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-214841182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aff64a19c18461e85b60ee9d4984eb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa934aede-0d", "ovs_interfaceid": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:a1:75,bridge_name='br-int',has_traffic_filtering=True,id=a934aede-0db0-4ac2-90ae-cca05c77fbf7,network=Network(6e9ff022-e661-4a79-aca7-18f30f23041f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa934aede-0d') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.objects.instance [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d786dce-e06c-4b52-b399-d7a71858314b {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 04:55:22 user nova-compute[74805]:   <uuid>1d786dce-e06c-4b52-b399-d7a71858314b</uuid>
Nov 15 04:55:22 user nova-compute[74805]:   <name>instance-00000035</name>
Nov 15 04:55:22 user nova-compute[74805]:   <memory>524288</memory>
Nov 15 04:55:22 user nova-compute[74805]:   <vcpu>1</vcpu>
Nov 15 04:55:22 user nova-compute[74805]:   <metadata>
Nov 15 04:55:22 user nova-compute[74805]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 04:55:22 user nova-compute[74805]:       <nova:package version="0.0.0"/>
Nov 15 04:55:22 user nova-compute[74805]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-672169126</nova:name>
Nov 15 04:55:22 user nova-compute[74805]:       <nova:creationTime>2023-11-15 04:55:22</nova:creationTime>
Nov 15 04:55:22 user nova-compute[74805]:       <nova:flavor name="m1.tiny">
Nov 15 04:55:22 user nova-compute[74805]:         <nova:memory>512</nova:memory>
Nov 15 04:55:22 user nova-compute[74805]:         <nova:disk>1</nova:disk>
Nov 15 04:55:22 user nova-compute[74805]:         <nova:swap>0</nova:swap>
Nov 15 04:55:22 user nova-compute[74805]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 04:55:22 user nova-compute[74805]:         <nova:vcpus>1</nova:vcpus>
Nov 15 04:55:22 user nova-compute[74805]:       </nova:flavor>
Nov 15 04:55:22 user nova-compute[74805]:       <nova:owner>
Nov 15 04:55:22 user nova-compute[74805]:         <nova:user uuid="a03ee5d41faf471daf6cf2372c74483b">tempest-SnapshotDataIntegrityTests-1537820554-project-member</nova:user>
Nov 15 04:55:22 user nova-compute[74805]:         <nova:project uuid="7aff64a19c18461e85b60ee9d4984eb3">tempest-SnapshotDataIntegrityTests-1537820554</nova:project>
Nov 15 04:55:22 user nova-compute[74805]:       </nova:owner>
Nov 15 04:55:22 user nova-compute[74805]:       <nova:root type="image" uuid="f5f2780a-c8f6-40c5-9044-7e9b73af604f"/>
Nov 15 04:55:22 user nova-compute[74805]:       <nova:ports>
Nov 15 04:55:22 user nova-compute[74805]:         <nova:port uuid="a934aede-0db0-4ac2-90ae-cca05c77fbf7">
Nov 15 04:55:22 user nova-compute[74805]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 04:55:22 user nova-compute[74805]:         </nova:port>
Nov 15 04:55:22 user nova-compute[74805]:       </nova:ports>
Nov 15 04:55:22 user nova-compute[74805]:     </nova:instance>
Nov 15 04:55:22 user nova-compute[74805]:   </metadata>
Nov 15 04:55:22 user nova-compute[74805]:   <sysinfo type="smbios">
Nov 15 04:55:22 user nova-compute[74805]:     <system>
Nov 15 04:55:22 user nova-compute[74805]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 04:55:22 user nova-compute[74805]:       <entry name="product">OpenStack Nova</entry>
Nov 15 04:55:22 user nova-compute[74805]:       <entry name="version">0.0.0</entry>
Nov 15 04:55:22 user nova-compute[74805]:       <entry name="serial">1d786dce-e06c-4b52-b399-d7a71858314b</entry>
Nov 15 04:55:22 user nova-compute[74805]:       <entry name="uuid">1d786dce-e06c-4b52-b399-d7a71858314b</entry>
Nov 15 04:55:22 user nova-compute[74805]:       <entry name="family">Virtual Machine</entry>
Nov 15 04:55:22 user nova-compute[74805]:     </system>
Nov 15 04:55:22 user nova-compute[74805]:   </sysinfo>
Nov 15 04:55:22 user nova-compute[74805]:   <os>
Nov 15 04:55:22 user nova-compute[74805]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 04:55:22 user nova-compute[74805]:     <boot dev="hd"/>
Nov 15 04:55:22 user nova-compute[74805]:     <smbios mode="sysinfo"/>
Nov 15 04:55:22 user nova-compute[74805]:   </os>
Nov 15 04:55:22 user nova-compute[74805]:   <features>
Nov 15 04:55:22 user nova-compute[74805]:     <acpi/>
Nov 15 04:55:22 user nova-compute[74805]:     <apic/>
Nov 15 04:55:22 user nova-compute[74805]:     <vmcoreinfo/>
Nov 15 04:55:22 user nova-compute[74805]:   </features>
Nov 15 04:55:22 user nova-compute[74805]:   <clock offset="utc">
Nov 15 04:55:22 user nova-compute[74805]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 04:55:22 user nova-compute[74805]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 04:55:22 user nova-compute[74805]:     <timer name="hpet" present="no"/>
Nov 15 04:55:22 user nova-compute[74805]:   </clock>
Nov 15 04:55:22 user nova-compute[74805]:   <cpu mode="custom" match="exact">
Nov 15 04:55:22 user nova-compute[74805]:     <model>Nehalem</model>
Nov 15 04:55:22 user nova-compute[74805]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 04:55:22 user nova-compute[74805]:   </cpu>
Nov 15 04:55:22 user nova-compute[74805]:   <devices>
Nov 15 04:55:22 user nova-compute[74805]:     <disk type="file" device="disk">
Nov 15 04:55:22 user nova-compute[74805]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 04:55:22 user nova-compute[74805]:       <source file="/opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk"/>
Nov 15 04:55:22 user nova-compute[74805]:       <target dev="vda" bus="virtio"/>
Nov 15 04:55:22 user nova-compute[74805]:     </disk>
Nov 15 04:55:22 user nova-compute[74805]:     <interface type="ethernet">
Nov 15 04:55:22 user nova-compute[74805]:       <mac address="fa:16:3e:50:a1:75"/>
Nov 15 04:55:22 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:55:22 user nova-compute[74805]:       <mtu size="1442"/>
Nov 15 04:55:22 user nova-compute[74805]:       <target dev="tapa934aede-0d"/>
Nov 15 04:55:22 user nova-compute[74805]:     </interface>
Nov 15 04:55:22 user nova-compute[74805]:     <serial type="pty">
Nov 15 04:55:22 user nova-compute[74805]:       <log file="/opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/console.log" append="off"/>
Nov 15 04:55:22 user nova-compute[74805]:     </serial>
Nov 15 04:55:22 user nova-compute[74805]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 04:55:22 user nova-compute[74805]:     <video>
Nov 15 04:55:22 user nova-compute[74805]:       <model type="virtio"/>
Nov 15 04:55:22 user nova-compute[74805]:     </video>
Nov 15 04:55:22 user nova-compute[74805]:     <rng model="virtio">
Nov 15 04:55:22 user nova-compute[74805]:       <backend model="random">/dev/urandom</backend>
Nov 15 04:55:22 user nova-compute[74805]:     </rng>
Nov 15 04:55:22 user nova-compute[74805]:     <controller type="usb" index="0" model="none"/>
Nov 15 04:55:22 user nova-compute[74805]:     <memballoon model="virtio">
Nov 15 04:55:22 user nova-compute[74805]:       <stats period="10"/>
Nov 15 04:55:22 user nova-compute[74805]:     </memballoon>
Nov 15 04:55:22 user nova-compute[74805]:   </devices>
Nov 15 04:55:22 user nova-compute[74805]: </domain>
Nov 15 04:55:22 user nova-compute[74805]:  {{(pid=74805) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:55:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-672169126',display_name='tempest-SnapshotDataIntegrityTests-server-672169126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-672169126',id=53,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOCmr2zA7VkJ979UR7BPs/ZcsKwB5MEYYTQ0pH76KIRA79yZaHxCl0oMM26oWr7c2hoeFWIZ7AL2t0q2AsR+AH6Yl2U31Ny5zCH+W9PSmyT9q+wLUvASUe7fQdngltvtQ==',key_name='tempest-keypair-1112931856',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7aff64a19c18461e85b60ee9d4984eb3',ramdisk_id='',reservation_id='r-hnl0mkxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1537820554',owner_user_name='tempest-SnapshotDataIntegrityTests-1537820554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T04:55:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a03ee5d41faf471daf6cf2372c74483b',uuid=1d786dce-e06c-4b52-b399-d7a71858314b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "address": "fa:16:3e:50:a1:75", "network": {"id": "6e9ff022-e661-4a79-aca7-18f30f23041f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-214841182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aff64a19c18461e85b60ee9d4984eb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa934aede-0d", "ovs_interfaceid": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Converting VIF {"id": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "address": "fa:16:3e:50:a1:75", "network": {"id": "6e9ff022-e661-4a79-aca7-18f30f23041f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-214841182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aff64a19c18461e85b60ee9d4984eb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa934aede-0d", "ovs_interfaceid": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:a1:75,bridge_name='br-int',has_traffic_filtering=True,id=a934aede-0db0-4ac2-90ae-cca05c77fbf7,network=Network(6e9ff022-e661-4a79-aca7-18f30f23041f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa934aede-0d') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG os_vif [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:a1:75,bridge_name='br-int',has_traffic_filtering=True,id=a934aede-0db0-4ac2-90ae-cca05c77fbf7,network=Network(6e9ff022-e661-4a79-aca7-18f30f23041f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa934aede-0d') {{(pid=74805) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28e6d69b-ef01-5b96-8e3d-65f719c2d782', '_type': 'linux-noop'}}, row=False) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa934aede-0d, may_exist=True, interface_attrs={}) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa934aede-0d, col_values=(('qos', UUID('06ae7fdc-d2de-4d5b-a061-0cb080c3d69a')),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa934aede-0d, col_values=(('external_ids', {'iface-id': 'a934aede-0db0-4ac2-90ae-cca05c77fbf7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:a1:75', 'vm-uuid': '1d786dce-e06c-4b52-b399-d7a71858314b'}),), if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:22 user nova-compute[74805]: INFO os_vif [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:a1:75,bridge_name='br-int',has_traffic_filtering=True,id=a934aede-0db0-4ac2-90ae-cca05c77fbf7,network=Network(6e9ff022-e661-4a79-aca7-18f30f23041f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa934aede-0d')
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] No VIF found with MAC fa:16:3e:50:a1:75, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.network.neutron [req-245639e4-feae-42e4-81eb-06bb95eb09c5 req-c3bfa57c-8843-40ec-b0f2-339fb3267258 service nova] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Updated VIF entry in instance network info cache for port a934aede-0db0-4ac2-90ae-cca05c77fbf7. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG nova.network.neutron [req-245639e4-feae-42e4-81eb-06bb95eb09c5 req-c3bfa57c-8843-40ec-b0f2-339fb3267258 service nova] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Updating instance_info_cache with network_info: [{"id": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "address": "fa:16:3e:50:a1:75", "network": {"id": "6e9ff022-e661-4a79-aca7-18f30f23041f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-214841182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aff64a19c18461e85b60ee9d4984eb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa934aede-0d", "ovs_interfaceid": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:55:22 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-245639e4-feae-42e4-81eb-06bb95eb09c5 req-c3bfa57c-8843-40ec-b0f2-339fb3267258 service nova] Releasing lock "refresh_cache-1d786dce-e06c-4b52-b399-d7a71858314b" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:55:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-18ff6be5-66ba-4bee-a041-83735b8aa804 req-8868a22f-41e4-4a03-99b4-7c8ed3e272cf service nova] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Received event network-vif-plugged-a934aede-0db0-4ac2-90ae-cca05c77fbf7 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:55:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-18ff6be5-66ba-4bee-a041-83735b8aa804 req-8868a22f-41e4-4a03-99b4-7c8ed3e272cf service nova] Acquiring lock "1d786dce-e06c-4b52-b399-d7a71858314b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:55:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-18ff6be5-66ba-4bee-a041-83735b8aa804 req-8868a22f-41e4-4a03-99b4-7c8ed3e272cf service nova] Lock "1d786dce-e06c-4b52-b399-d7a71858314b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:55:24 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-18ff6be5-66ba-4bee-a041-83735b8aa804 req-8868a22f-41e4-4a03-99b4-7c8ed3e272cf service nova] Lock "1d786dce-e06c-4b52-b399-d7a71858314b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:55:24 user nova-compute[74805]: DEBUG nova.compute.manager [req-18ff6be5-66ba-4bee-a041-83735b8aa804 req-8868a22f-41e4-4a03-99b4-7c8ed3e272cf service nova] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] No waiting events found dispatching network-vif-plugged-a934aede-0db0-4ac2-90ae-cca05c77fbf7 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:55:24 user nova-compute[74805]: WARNING nova.compute.manager [req-18ff6be5-66ba-4bee-a041-83735b8aa804 req-8868a22f-41e4-4a03-99b4-7c8ed3e272cf service nova] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Received unexpected event network-vif-plugged-a934aede-0db0-4ac2-90ae-cca05c77fbf7 for instance with vm_state building and task_state spawning.
Nov 15 04:55:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-ffc017ee-a116-4198-a7a6-4e9562343870 req-a8b19ccb-3531-4b5b-a6cc-6154fc23ddd3 service nova] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Received event network-vif-plugged-a934aede-0db0-4ac2-90ae-cca05c77fbf7 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:55:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ffc017ee-a116-4198-a7a6-4e9562343870 req-a8b19ccb-3531-4b5b-a6cc-6154fc23ddd3 service nova] Acquiring lock "1d786dce-e06c-4b52-b399-d7a71858314b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:55:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ffc017ee-a116-4198-a7a6-4e9562343870 req-a8b19ccb-3531-4b5b-a6cc-6154fc23ddd3 service nova] Lock "1d786dce-e06c-4b52-b399-d7a71858314b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:55:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-ffc017ee-a116-4198-a7a6-4e9562343870 req-a8b19ccb-3531-4b5b-a6cc-6154fc23ddd3 service nova] Lock "1d786dce-e06c-4b52-b399-d7a71858314b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:55:26 user nova-compute[74805]: DEBUG nova.compute.manager [req-ffc017ee-a116-4198-a7a6-4e9562343870 req-a8b19ccb-3531-4b5b-a6cc-6154fc23ddd3 service nova] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] No waiting events found dispatching network-vif-plugged-a934aede-0db0-4ac2-90ae-cca05c77fbf7 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 04:55:26 user nova-compute[74805]: WARNING nova.compute.manager [req-ffc017ee-a116-4198-a7a6-4e9562343870 req-a8b19ccb-3531-4b5b-a6cc-6154fc23ddd3 service nova] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Received unexpected event network-vif-plugged-a934aede-0db0-4ac2-90ae-cca05c77fbf7 for instance with vm_state building and task_state spawning.
Nov 15 04:55:26 user nova-compute[74805]: DEBUG nova.compute.manager [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Instance event wait completed in 0 seconds for  {{(pid=74805) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 04:55:26 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Guest created on hypervisor {{(pid=74805) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 04:55:26 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Instance spawned successfully.
Nov 15 04:55:26 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 04:55:26 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Found default for hw_cdrom_bus of ide {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:55:26 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Found default for hw_disk_bus of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:55:26 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Found default for hw_input_bus of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:55:26 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Found default for hw_pointer_model of None {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:55:26 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Found default for hw_video_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:55:26 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Found default for hw_vif_model of virtio {{(pid=74805) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 04:55:26 user nova-compute[74805]: INFO nova.compute.manager [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Took 6.56 seconds to spawn the instance on the hypervisor.
Nov 15 04:55:26 user nova-compute[74805]: DEBUG nova.compute.manager [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Checking state {{(pid=74805) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 04:55:27 user nova-compute[74805]: INFO nova.compute.manager [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Took 7.15 seconds to build instance.
Nov 15 04:55:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-10c4acbe-2ad2-46f7-8a69-f33ce7e7710e tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.397s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:55:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:33 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:55:36 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:37 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:55:37 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74805) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 04:55:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:38 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:55:38 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:55:39 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:55:42 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:55:42 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:55:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:55:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:55:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:55:42 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:55:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:55:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:55:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:55:42 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:55:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:42 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:55:42 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:55:42 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=8842MB free_disk=25.026752471923828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:55:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:55:42 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:55:43 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 1d786dce-e06c-4b52-b399-d7a71858314b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:55:43 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:55:43 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:55:43 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:55:43 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:55:43 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:55:43 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:55:44 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:55:45 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:55:45 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:55:45 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Rebuilding the list of instances to heal {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 04:55:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-1d786dce-e06c-4b52-b399-d7a71858314b" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:55:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-1d786dce-e06c-4b52-b399-d7a71858314b" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:55:45 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:55:45 user nova-compute[74805]: DEBUG nova.objects.instance [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lazy-loading 'info_cache' on Instance uuid 1d786dce-e06c-4b52-b399-d7a71858314b {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:55:45 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Updating instance_info_cache with network_info: [{"id": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "address": "fa:16:3e:50:a1:75", "network": {"id": "6e9ff022-e661-4a79-aca7-18f30f23041f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-214841182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aff64a19c18461e85b60ee9d4984eb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa934aede-0d", "ovs_interfaceid": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:55:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-1d786dce-e06c-4b52-b399-d7a71858314b" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:55:45 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:55:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:47 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:55:47 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:55:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:49 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:55:49 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Cleaning up deleted instances {{(pid=74805) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 04:55:49 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] There are 0 instances to clean {{(pid=74805) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 04:55:51 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:56 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:55:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:56:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:56:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:56:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:56:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:56:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:56:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:56:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:56:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:56:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:56:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:56:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:56:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:56:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:56:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:56:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:56:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:56:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:56:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:56:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:56:22 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:56:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:56:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:56:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:56:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:56:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:56:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:56:27 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:56:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:56:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:56:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:56:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:56:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:56:32 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:56:33 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:56:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:56:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:56:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:56:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:56:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:56:37 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:56:39 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:56:40 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:56:40 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:56:42 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:56:43 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:56:43 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:56:44 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:56:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:56:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:56:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:56:44 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:56:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:56:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:56:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:56:44 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:56:44 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:56:44 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:56:44 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=8983MB free_disk=25.024311065673828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:56:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:56:44 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:56:45 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 1d786dce-e06c-4b52-b399-d7a71858314b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:56:45 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:56:45 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:56:45 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Refreshing inventories for resource provider ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 04:56:45 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Updating ProviderTree inventory for provider ada87504-5552-4a33-b754-f9a54c67fe39 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 04:56:45 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Updating inventory in ProviderTree for provider ada87504-5552-4a33-b754-f9a54c67fe39 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 04:56:45 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Refreshing aggregate associations for resource provider ada87504-5552-4a33-b754-f9a54c67fe39, aggregates: None {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 04:56:45 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Refreshing trait associations for resource provider ada87504-5552-4a33-b754-f9a54c67fe39, traits: COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 04:56:45 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:56:45 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:56:45 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:56:45 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.398s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:56:47 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:56:47 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:56:47 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Rebuilding the list of instances to heal {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 04:56:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-1d786dce-e06c-4b52-b399-d7a71858314b" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:56:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-1d786dce-e06c-4b52-b399-d7a71858314b" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:56:47 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:56:47 user nova-compute[74805]: DEBUG nova.objects.instance [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lazy-loading 'info_cache' on Instance uuid 1d786dce-e06c-4b52-b399-d7a71858314b {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:56:47 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Updating instance_info_cache with network_info: [{"id": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "address": "fa:16:3e:50:a1:75", "network": {"id": "6e9ff022-e661-4a79-aca7-18f30f23041f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-214841182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aff64a19c18461e85b60ee9d4984eb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa934aede-0d", "ovs_interfaceid": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:56:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-1d786dce-e06c-4b52-b399-d7a71858314b" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:56:47 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:56:47 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:56:47 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:56:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:56:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:56:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:56:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:56:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:56:47 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:56:49 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:56:52 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:56:57 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:57:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:57:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:57:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:57:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:57:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:57:02 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:57:07 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:57:11 user nova-compute[74805]: DEBUG nova.compute.manager [req-4b09496f-6f42-4880-bb17-3366c1d5135c req-63747496-0308-4e7f-86d3-cd49380c8365 service nova] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Received event network-changed-a934aede-0db0-4ac2-90ae-cca05c77fbf7 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 04:57:11 user nova-compute[74805]: DEBUG nova.compute.manager [req-4b09496f-6f42-4880-bb17-3366c1d5135c req-63747496-0308-4e7f-86d3-cd49380c8365 service nova] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Refreshing instance network info cache due to event network-changed-a934aede-0db0-4ac2-90ae-cca05c77fbf7. {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 04:57:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-4b09496f-6f42-4880-bb17-3366c1d5135c req-63747496-0308-4e7f-86d3-cd49380c8365 service nova] Acquiring lock "refresh_cache-1d786dce-e06c-4b52-b399-d7a71858314b" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:57:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-4b09496f-6f42-4880-bb17-3366c1d5135c req-63747496-0308-4e7f-86d3-cd49380c8365 service nova] Acquired lock "refresh_cache-1d786dce-e06c-4b52-b399-d7a71858314b" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:57:11 user nova-compute[74805]: DEBUG nova.network.neutron [req-4b09496f-6f42-4880-bb17-3366c1d5135c req-63747496-0308-4e7f-86d3-cd49380c8365 service nova] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Refreshing network info cache for port a934aede-0db0-4ac2-90ae-cca05c77fbf7 {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 04:57:11 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:57:11 user nova-compute[74805]: DEBUG nova.network.neutron [req-4b09496f-6f42-4880-bb17-3366c1d5135c req-63747496-0308-4e7f-86d3-cd49380c8365 service nova] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Updated VIF entry in instance network info cache for port a934aede-0db0-4ac2-90ae-cca05c77fbf7. {{(pid=74805) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 04:57:11 user nova-compute[74805]: DEBUG nova.network.neutron [req-4b09496f-6f42-4880-bb17-3366c1d5135c req-63747496-0308-4e7f-86d3-cd49380c8365 service nova] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Updating instance_info_cache with network_info: [{"id": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "address": "fa:16:3e:50:a1:75", "network": {"id": "6e9ff022-e661-4a79-aca7-18f30f23041f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-214841182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aff64a19c18461e85b60ee9d4984eb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa934aede-0d", "ovs_interfaceid": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:57:11 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-4b09496f-6f42-4880-bb17-3366c1d5135c req-63747496-0308-4e7f-86d3-cd49380c8365 service nova] Releasing lock "refresh_cache-1d786dce-e06c-4b52-b399-d7a71858314b" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:57:12 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:57:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "1d786dce-e06c-4b52-b399-d7a71858314b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:57:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:57:13 user nova-compute[74805]: DEBUG nova.objects.instance [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lazy-loading 'flavor' on Instance uuid 1d786dce-e06c-4b52-b399-d7a71858314b {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:57:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:57:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "1d786dce-e06c-4b52-b399-d7a71858314b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:57:13 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:57:13 user nova-compute[74805]: INFO nova.compute.manager [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Attaching volume 7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 to /dev/vdb
Nov 15 04:57:13 user nova-compute[74805]: DEBUG os_brick.utils [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:57:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:57:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:57:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cb72df-0cf0-4543-8fc5-6114370f1977]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:57:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:57:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:57:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d0afc5-1719-4327-8616-53e5435986d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:57:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:57:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:57:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e3ff7b-2d7d-4610-a67e-a5d84b387fee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:57:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab310da8-b3df-4c9f-b65e-c05f3c9be323]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:57:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:57:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:57:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:57:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:57:13 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:57:13 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:57:13 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae24568-72f8-4c78-aeb0-a3799d26212c]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:57:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:57:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:57:13 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:57:13 user nova-compute[74805]: DEBUG os_brick.utils [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:57:13 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Updating existing volume attachment record: 761d8c97-573b-4424-a492-2cebbd5d326a {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:57:16 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:57:17 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCRikASD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:57:18 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:57:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:57:18 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:57:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:57:18 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e90be22-c81c-4013-8d05-644f3fc1a4dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:57:18 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4446e7-e977-4e78-9d2b-2f1af4bc9fba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4] added
Nov 15 04:57:18 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c768e030-2ec6-4d6f-91ef-be6fba782503]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a810de-8c56-4a59-958b-53827348a86b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OCRikASD {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OCRikASD" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa0f253-18d4-47be-ad1f-e714bded92cd]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OCRikASD'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf12892-1390-4cdd-835f-3fbc40856501]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f283f2-33d5-46c3-867a-eff6e62bf7d6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 04:57:18 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 04:57:18 user nova-compute[74805]:  {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:57:18 user nova-compute[74805]: WARNING os_brick.initiator.connectors.iscsi [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 04:57:18 user nova-compute[74805]: 
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[da86ad53-e4de-4352-b07c-c86066e45d39]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4, portal: 172.16.0.220,3260]
Nov 15 04:57:18 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4, portal: 172.16.0.220,3260] successful.
Nov 15 04:57:18 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9588b5f-3b9e-440b-9786-83e95a6a1eb6]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a524fd-77a7-4362-8556-ad46990c1ecc]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 (non-flash)
Nov 15 04:57:18 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 (non-flash)
Nov 15 04:57:18 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.238s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ead111-5169-4bd0-9ad0-ea2c36219fbf]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:57:18 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCRikASD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:57:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.267s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:57:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] <== connect_volume: return (1269ms) {'type': 'block', 'scsi_wwn': '23930386132396562', 'path': '/dev/sdb'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:57:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930386132396562', 'path': '/dev/sdb'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:57:19 user nova-compute[74805]: DEBUG nova.objects.instance [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lazy-loading 'flavor' on Instance uuid 1d786dce-e06c-4b52-b399-d7a71858314b {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:57:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:57:19 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:57:19 user nova-compute[74805]:   <source dev="/dev/sdb"/>
Nov 15 04:57:19 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:57:19 user nova-compute[74805]:   <serial>7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4</serial>
Nov 15 04:57:19 user nova-compute[74805]: </disk>
Nov 15 04:57:19 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:57:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:57:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:57:19 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] No VIF found with MAC fa:16:3e:50:a1:75, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:57:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3232f6f5-9fa4-44a5-a916-209cba98cdf2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.314s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:57:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:57:22 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:57:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:57:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "1d786dce-e06c-4b52-b399-d7a71858314b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:57:26 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:57:26 user nova-compute[74805]: INFO nova.compute.manager [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Detaching volume 7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4
Nov 15 04:57:27 user nova-compute[74805]: INFO nova.virt.block_device [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Attempting to driver detach volume 7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 from mountpoint /dev/vdb
Nov 15 04:57:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Attempting to detach device vdb from instance 1d786dce-e06c-4b52-b399-d7a71858314b from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:57:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:57:27 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:57:27 user nova-compute[74805]:   <source dev="/dev/sdb"/>
Nov 15 04:57:27 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:57:27 user nova-compute[74805]:   <serial>7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4</serial>
Nov 15 04:57:27 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:57:27 user nova-compute[74805]: </disk>
Nov 15 04:57:27 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:57:27 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Successfully detached device vdb from instance 1d786dce-e06c-4b52-b399-d7a71858314b from the persistent domain config.
Nov 15 04:57:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1d786dce-e06c-4b52-b399-d7a71858314b from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:57:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:57:27 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:57:27 user nova-compute[74805]:   <source dev="/dev/sdb"/>
Nov 15 04:57:27 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:57:27 user nova-compute[74805]:   <serial>7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4</serial>
Nov 15 04:57:27 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:57:27 user nova-compute[74805]: </disk>
Nov 15 04:57:27 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:57:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1d786dce-e06c-4b52-b399-d7a71858314b {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:57:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:57:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:57:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:57:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:57:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:57:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:57:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:57:34 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:57:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:57:40 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:57:42 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:57:42 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:57:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:57:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:57:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:57:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:57:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:57:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:57:45 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:57:45 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:57:46 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:57:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:57:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:57:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:57:46 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:57:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:57:46 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:57:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:57:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:57:46 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:57:46 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:57:46 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:57:46 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=8955MB free_disk=25.023052215576172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:57:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:57:46 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:57:46 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 1d786dce-e06c-4b52-b399-d7a71858314b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:57:46 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:57:46 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:57:47 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1d786dce-e06c-4b52-b399-d7a71858314b is timed out.
Nov 15 04:57:47 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Successfully detached device vdb from instance 1d786dce-e06c-4b52-b399-d7a71858314b from the live domain config.
Nov 15 04:57:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCRikASD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:57:47 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:57:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca86391e-66bf-47a9-bdc6-d6057cbf9709]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:57:47 user nova-compute[74805]: No targets found.
Nov 15 04:57:47 user nova-compute[74805]: iSNS:
Nov 15 04:57:47 user nova-compute[74805]: No targets found.
Nov 15 04:57:47 user nova-compute[74805]: STATIC:
Nov 15 04:57:47 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4
Nov 15 04:57:47 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:57:47 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:57:47 user nova-compute[74805]: FIRMWARE:
Nov 15 04:57:47 user nova-compute[74805]: No targets found.
Nov 15 04:57:47 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:57:47 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:57:47 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9c1a5b-2b1a-4579-a8f5-60d028a50489]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[df49fc48-88b6-414a-9317-31fc8828ada4]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 (non-flash)
Nov 15 04:57:47 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 (non-flash)
Nov 15 04:57:47 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c71b250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4'): ({'sdb'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Removing single pathed devices sdb {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4496dc9-a4e3-4b2d-bd84-599b162f24d9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51dfd67-7280-4db5-aa92-8abd0100f63f]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Flushing IO for device /dev/sdb {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42a9091-d746-4e49-9ab2-34ecaacee526]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[74622eaf-cd85-4d9e-987f-89391149379b]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[208f0ff8-f866-4075-b6c5-de13a9be6e44]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d71d319-ee71-4726-9981-95b3c6cf53dc]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4, portal: 172.16.0.220,3260]
Nov 15 04:57:47 user nova-compute[74805]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4, portal: 172.16.0.220,3260] successful.
Nov 15 04:57:47 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b9ee3e9-aa16-478d-bd8c-75899a0b9ba4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e201d87a-b2da-41d1-8f75-17e125fdeca5]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] <== disconnect_volume: return (295ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:57:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:57:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:57:48 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:57:48 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:57:48 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:57:48 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:57:48 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Rebuilding the list of instances to heal {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 04:57:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-1d786dce-e06c-4b52-b399-d7a71858314b" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:57:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-1d786dce-e06c-4b52-b399-d7a71858314b" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:57:48 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:57:48 user nova-compute[74805]: DEBUG nova.objects.instance [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lazy-loading 'info_cache' on Instance uuid 1d786dce-e06c-4b52-b399-d7a71858314b {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:57:48 user nova-compute[74805]: DEBUG nova.objects.instance [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lazy-loading 'flavor' on Instance uuid 1d786dce-e06c-4b52-b399-d7a71858314b {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:57:48 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Updating instance_info_cache with network_info: [{"id": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "address": "fa:16:3e:50:a1:75", "network": {"id": "6e9ff022-e661-4a79-aca7-18f30f23041f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-214841182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aff64a19c18461e85b60ee9d4984eb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa934aede-0d", "ovs_interfaceid": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:57:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-1d786dce-e06c-4b52-b399-d7a71858314b" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:57:48 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:57:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-b3972566-af79-4d7b-8b2a-f35df54622ea tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.646s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:57:53 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:57:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:57:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:57:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:57:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:57:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:57:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:58:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:58:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:58:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:58:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:58:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:58:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:58:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:58:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:58:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:58:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:58:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:58:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:58:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:58:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:58:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:58:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:58:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:58:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:58:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:58:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "1d786dce-e06c-4b52-b399-d7a71858314b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:58:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:58:19 user nova-compute[74805]: DEBUG nova.objects.instance [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lazy-loading 'flavor' on Instance uuid 1d786dce-e06c-4b52-b399-d7a71858314b {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:58:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:58:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "1d786dce-e06c-4b52-b399-d7a71858314b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:58:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:58:19 user nova-compute[74805]: INFO nova.compute.manager [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Attaching volume 26139b64-9967-45b6-b64a-e2cd0be3ec97 to /dev/vdb
Nov 15 04:58:19 user nova-compute[74805]: DEBUG os_brick.utils [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:58:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:58:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:58:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4900d9b6-e901-4144-81d6-51d91f0e2332]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:58:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:58:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:58:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2960f7c2-4762-441c-b56e-fa870d6dc260]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:58:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:58:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:58:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9426a9d7-b652-4234-a9b3-4812202461ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:58:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c382ca22-e919-4c7d-9ded-c696889262cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:58:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:58:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:58:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:58:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:58:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:58:19 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:58:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad915517-df01-4314-84f9-9b08fc35c582]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:58:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:58:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:58:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:58:19 user nova-compute[74805]: DEBUG os_brick.utils [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:58:19 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Updating existing volume attachment record: bfe04c7a-b00a-454c-95c3-bc1923ef1f10 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:58:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:58:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:58:23 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:58:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HRkwolcQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:58:23 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:58:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:58:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:58:23 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:58:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:58:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:58:23 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:58:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97 -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:58:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:58:23 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[440be701-bad1-445a-a304-ceb59b551d56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:58:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:58:23 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:58:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97 -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:58:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:58:23 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[415031ea-8a09-4208-b5a4-05d6abdfdb9d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:58:23 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97] added
Nov 15 04:58:23 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:58:23 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5d18cb-0f7f-4320-a54e-0317fd65b5c3]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[77eaf5a7-250b-4ecb-95ba-950816a45bed]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HRkwolcQ {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HRkwolcQ" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a307f6da-ffd7-46e4-b70a-4efbeacbe9da]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HRkwolcQ'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e283c5-cfd9-442c-b8e2-d15708a68abc]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f861e62e-09c6-438d-9e00-279fecdda51e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 04:58:24 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 04:58:24 user nova-compute[74805]:  {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:58:24 user nova-compute[74805]: WARNING os_brick.initiator.connectors.iscsi [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 04:58:24 user nova-compute[74805]: 
Nov 15 04:58:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97 -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[88078e38-353b-4bbb-9254-f94824bf5f59]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97, portal: 172.16.0.220,3260]
Nov 15 04:58:24 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97, portal: 172.16.0.220,3260] successful.
Nov 15 04:58:24 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[276d6f47-6b88-4135-a1a5-2d78d6e3b366]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40fa9d9-836d-47c4-99ac-05972d7cdf2e]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97 (non-flash)
Nov 15 04:58:24 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97 (non-flash)
Nov 15 04:58:24 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.238s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e32ce5-03c9-460d-81bf-929d77b9e61b]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:58:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HRkwolcQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:58:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.267s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:58:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] <== connect_volume: return (1270ms) {'type': 'block', 'scsi_wwn': '23934636463386363', 'path': '/dev/sdb'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:58:25 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934636463386363', 'path': '/dev/sdb'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:58:25 user nova-compute[74805]: DEBUG nova.objects.instance [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lazy-loading 'flavor' on Instance uuid 1d786dce-e06c-4b52-b399-d7a71858314b {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:58:25 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:58:25 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:58:25 user nova-compute[74805]:   <source dev="/dev/sdb"/>
Nov 15 04:58:25 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:58:25 user nova-compute[74805]:   <serial>26139b64-9967-45b6-b64a-e2cd0be3ec97</serial>
Nov 15 04:58:25 user nova-compute[74805]: </disk>
Nov 15 04:58:25 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:58:25 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:58:25 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:58:25 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] No VIF found with MAC fa:16:3e:50:a1:75, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:58:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-a61e3083-8fb2-4825-937a-36b1bc9bc6d2 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.426s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:58:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:58:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "1d786dce-e06c-4b52-b399-d7a71858314b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:58:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:58:27 user nova-compute[74805]: INFO nova.compute.manager [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Detaching volume 26139b64-9967-45b6-b64a-e2cd0be3ec97
Nov 15 04:58:27 user nova-compute[74805]: INFO nova.virt.block_device [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Attempting to driver detach volume 26139b64-9967-45b6-b64a-e2cd0be3ec97 from mountpoint /dev/vdb
Nov 15 04:58:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Attempting to detach device vdb from instance 1d786dce-e06c-4b52-b399-d7a71858314b from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:58:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:58:27 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:58:27 user nova-compute[74805]:   <source dev="/dev/sdb"/>
Nov 15 04:58:27 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:58:27 user nova-compute[74805]:   <serial>26139b64-9967-45b6-b64a-e2cd0be3ec97</serial>
Nov 15 04:58:27 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:58:27 user nova-compute[74805]: </disk>
Nov 15 04:58:27 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:58:27 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Successfully detached device vdb from instance 1d786dce-e06c-4b52-b399-d7a71858314b from the persistent domain config.
Nov 15 04:58:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1d786dce-e06c-4b52-b399-d7a71858314b from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:58:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:58:27 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:58:27 user nova-compute[74805]:   <source dev="/dev/sdb"/>
Nov 15 04:58:27 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:58:27 user nova-compute[74805]:   <serial>26139b64-9967-45b6-b64a-e2cd0be3ec97</serial>
Nov 15 04:58:27 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:58:27 user nova-compute[74805]: </disk>
Nov 15 04:58:27 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:58:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1d786dce-e06c-4b52-b399-d7a71858314b {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:58:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:58:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:58:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:58:35 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:58:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:58:41 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:58:42 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:58:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:58:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:58:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:58:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:58:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:58:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:58:43 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:58:46 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:58:47 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:58:47 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:58:47 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:58:47 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1d786dce-e06c-4b52-b399-d7a71858314b is timed out.
Nov 15 04:58:47 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Successfully detached device vdb from instance 1d786dce-e06c-4b52-b399-d7a71858314b from the live domain config.
Nov 15 04:58:47 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:58:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HRkwolcQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:58:47 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:58:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:58:47 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:58:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:58:47 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:58:47 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a27f96-d581-4b42-b864-7fdb238b94e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:58:48 user nova-compute[74805]: No targets found.
Nov 15 04:58:48 user nova-compute[74805]: iSNS:
Nov 15 04:58:48 user nova-compute[74805]: No targets found.
Nov 15 04:58:48 user nova-compute[74805]: STATIC:
Nov 15 04:58:48 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97
Nov 15 04:58:48 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:58:48 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:58:48 user nova-compute[74805]: FIRMWARE:
Nov 15 04:58:48 user nova-compute[74805]: No targets found.
Nov 15 04:58:48 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:58:48 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:58:48 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d83d8e3-1191-463f-9929-9a7b57ef49c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c3162c-5de7-4bbe-a07d-bf754e3d6888]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97 (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97 (non-flash)
Nov 15 04:58:48 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97 (non-flash)
Nov 15 04:58:48 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c1e8670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97'): ({'sdb'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Removing single pathed devices sdb {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[925fd47f-29be-49e9-bf48-acdbdb7617d5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1994fd-4d41-4758-b3e4-b322ce8e872e]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Flushing IO for device /dev/sdb {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc6783f-48e6-45f6-b71f-33416d97eda4]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20122c5-aad8-45e9-8c19-520797b4efac]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4806558-cd9f-40cf-9127-d9f917cfb59d]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97 -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af80311-a53b-4f1e-8c50-09ffd9be9484]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97, portal: 172.16.0.220,3260]
Nov 15 04:58:48 user nova-compute[74805]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97, portal: 172.16.0.220,3260] successful.
Nov 15 04:58:48 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97 -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26139b64-9967-45b6-b64a-e2cd0be3ec97 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdabbf0-23c7-4522-bd74-8a37e6eb97fd]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] <== disconnect_volume: return (308ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:58:48 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:58:48 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:58:48 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=8964MB free_disk=25.022071838378906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 1d786dce-e06c-4b52-b399-d7a71858314b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:58:48 user nova-compute[74805]: DEBUG nova.objects.instance [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lazy-loading 'flavor' on Instance uuid 1d786dce-e06c-4b52-b399-d7a71858314b {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:58:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-1835fb71-79b8-4ba9-b091-7890d7ee99de tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.587s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:58:49 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:58:49 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:58:49 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:58:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:58:51 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:58:51 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:58:51 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Rebuilding the list of instances to heal {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 04:58:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-1d786dce-e06c-4b52-b399-d7a71858314b" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:58:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-1d786dce-e06c-4b52-b399-d7a71858314b" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:58:51 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:58:51 user nova-compute[74805]: DEBUG nova.objects.instance [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lazy-loading 'info_cache' on Instance uuid 1d786dce-e06c-4b52-b399-d7a71858314b {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:58:51 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Updating instance_info_cache with network_info: [{"id": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "address": "fa:16:3e:50:a1:75", "network": {"id": "6e9ff022-e661-4a79-aca7-18f30f23041f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-214841182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aff64a19c18461e85b60ee9d4984eb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa934aede-0d", "ovs_interfaceid": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:58:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-1d786dce-e06c-4b52-b399-d7a71858314b" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:58:51 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:58:52 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:58:53 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:58:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:59:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:59:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:59:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:59:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:59:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:59:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:59:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:59:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:59:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:59:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "1d786dce-e06c-4b52-b399-d7a71858314b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:59:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:59:19 user nova-compute[74805]: DEBUG nova.objects.instance [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lazy-loading 'flavor' on Instance uuid 1d786dce-e06c-4b52-b399-d7a71858314b {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:59:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:59:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "1d786dce-e06c-4b52-b399-d7a71858314b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:59:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:59:19 user nova-compute[74805]: INFO nova.compute.manager [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Attaching volume 32336175-2cf8-4a41-b3c5-a9f8a7820d9b to /dev/vdb
Nov 15 04:59:19 user nova-compute[74805]: DEBUG os_brick.utils [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:59:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:59:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:59:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d424a52e-7792-4059-8fb1-1a9570479889]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:59:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:59:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:59:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f1b22d-c9cd-4da7-b3ac-a0e0efae7031]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:59:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:59:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:59:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c95cb6-9c3c-4f23-a80f-519ee71c7855]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:59:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1417fff0-8510-4cef-9690-337ac9adb545]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:59:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:59:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:59:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 04:59:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:59:19 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 04:59:19 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 04:59:19 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f492712-d7c7-41ab-a9b8-0d1a1e8ef4b2]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:59:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 04:59:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 04:59:19 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 04:59:19 user nova-compute[74805]: DEBUG os_brick.utils [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:59:19 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Updating existing volume attachment record: 8730a60f-c1b1-436e-9d5e-9dd32663fb9a {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 04:59:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:59:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TpaVveYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:59:24 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:59:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:59:24 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:59:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:59:24 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eea2153-b659-4c55-85df-c972ebf5632b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 04:59:24 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4f4fd2-bf50-4af0-b9ca-59ba3ead4161]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b] added
Nov 15 04:59:24 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1a9335-c7b4-41bd-92a2-f302a828d44f]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f7fd31-562b-4294-a036-6b734f84828b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TpaVveYt {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TpaVveYt" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5612272a-41bd-48e4-a22e-4bbd90e913c6]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TpaVveYt'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[be37f17c-d84f-404f-b7c3-b58029bfdd30]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1198e9-d82a-4107-a71a-bd84c2c8e3c9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 04:59:24 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 04:59:24 user nova-compute[74805]:  {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:59:24 user nova-compute[74805]: WARNING os_brick.initiator.connectors.iscsi [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 04:59:24 user nova-compute[74805]: 
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2de613-360b-44ad-a645-a88f2c0a238b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b, portal: 172.16.0.220,3260]
Nov 15 04:59:24 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b, portal: 172.16.0.220,3260] successful.
Nov 15 04:59:24 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d829744f-2341-4617-a9d7-50174014a516]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[116ad2a2-b8a4-4a15-9fc4-43d29415eab0]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b (non-flash)
Nov 15 04:59:24 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b (non-flash)
Nov 15 04:59:24 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7303e79-21b1-439b-bd80-e1303b101243]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:59:24 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:59:25 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 04:59:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TpaVveYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 04:59:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:59:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '26438366636616135', 'path': '/dev/sdb'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:59:25 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438366636616135', 'path': '/dev/sdb'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 04:59:25 user nova-compute[74805]: DEBUG nova.objects.instance [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lazy-loading 'flavor' on Instance uuid 1d786dce-e06c-4b52-b399-d7a71858314b {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:59:25 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 04:59:25 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:59:25 user nova-compute[74805]:   <source dev="/dev/sdb"/>
Nov 15 04:59:25 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:59:25 user nova-compute[74805]:   <serial>32336175-2cf8-4a41-b3c5-a9f8a7820d9b</serial>
Nov 15 04:59:25 user nova-compute[74805]: </disk>
Nov 15 04:59:25 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 04:59:25 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:59:25 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 04:59:25 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] No VIF found with MAC fa:16:3e:50:a1:75, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 04:59:25 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-8eff6f10-22ce-402f-aaa5-ae5d929ea1ed tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.299s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:59:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:59:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "1d786dce-e06c-4b52-b399-d7a71858314b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:59:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:59:27 user nova-compute[74805]: INFO nova.compute.manager [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Detaching volume 32336175-2cf8-4a41-b3c5-a9f8a7820d9b
Nov 15 04:59:27 user nova-compute[74805]: INFO nova.virt.block_device [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Attempting to driver detach volume 32336175-2cf8-4a41-b3c5-a9f8a7820d9b from mountpoint /dev/vdb
Nov 15 04:59:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Attempting to detach device vdb from instance 1d786dce-e06c-4b52-b399-d7a71858314b from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 04:59:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:59:27 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:59:27 user nova-compute[74805]:   <source dev="/dev/sdb"/>
Nov 15 04:59:27 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:59:27 user nova-compute[74805]:   <serial>32336175-2cf8-4a41-b3c5-a9f8a7820d9b</serial>
Nov 15 04:59:27 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:59:27 user nova-compute[74805]: </disk>
Nov 15 04:59:27 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:59:27 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Successfully detached device vdb from instance 1d786dce-e06c-4b52-b399-d7a71858314b from the persistent domain config.
Nov 15 04:59:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1d786dce-e06c-4b52-b399-d7a71858314b from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 04:59:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 04:59:27 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 04:59:27 user nova-compute[74805]:   <source dev="/dev/sdb"/>
Nov 15 04:59:27 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 04:59:27 user nova-compute[74805]:   <serial>32336175-2cf8-4a41-b3c5-a9f8a7820d9b</serial>
Nov 15 04:59:27 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 04:59:27 user nova-compute[74805]: </disk>
Nov 15 04:59:27 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 04:59:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:59:28 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1d786dce-e06c-4b52-b399-d7a71858314b {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 04:59:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:59:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:59:35 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:59:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:59:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:59:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:59:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:59:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:59:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:59:41 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:59:42 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:59:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:59:44 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:59:46 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 04:59:48 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1d786dce-e06c-4b52-b399-d7a71858314b is timed out.
Nov 15 04:59:48 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Successfully detached device vdb from instance 1d786dce-e06c-4b52-b399-d7a71858314b from the live domain config.
Nov 15 04:59:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TpaVveYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 04:59:48 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 04:59:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbba750-90a6-452d-858c-42af749d75ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 04:59:48 user nova-compute[74805]: No targets found.
Nov 15 04:59:48 user nova-compute[74805]: iSNS:
Nov 15 04:59:48 user nova-compute[74805]: No targets found.
Nov 15 04:59:48 user nova-compute[74805]: STATIC:
Nov 15 04:59:48 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b
Nov 15 04:59:48 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 04:59:48 user nova-compute[74805]:                 Iface Name: default
Nov 15 04:59:48 user nova-compute[74805]: FIRMWARE:
Nov 15 04:59:48 user nova-compute[74805]: No targets found.
Nov 15 04:59:48 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 04:59:48 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 04:59:48 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1811853-3016-4983-8d73-3e29ff3100bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f62e45-fab5-4490-a2b2-31351a2cad6d]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b (non-flash)
Nov 15 04:59:48 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b (non-flash)
Nov 15 04:59:48 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f78683520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b'): ({'sdb'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Removing single pathed devices sdb {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc82909-d787-4d6c-862f-e52f505eb809]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[17de9e26-af38-4794-9979-a27d99ab10fc]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Flushing IO for device /dev/sdb {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5629044b-acd4-402d-99e3-54505badd21f]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd55ecc-788f-4084-92e7-8eb0ad6f3f22]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.053s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b2140f-b916-440d-9173-3644354a2d50]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a797a15e-29f5-440f-8c10-1f00f2d3c099]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b, portal: 172.16.0.220,3260]
Nov 15 04:59:48 user nova-compute[74805]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b, portal: 172.16.0.220,3260] successful.
Nov 15 04:59:48 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32336175-2cf8-4a41-b3c5-a9f8a7820d9b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bab407-4f1f-483b-a520-c67ff272bf80]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] <== disconnect_volume: return (289ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 04:59:48 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 04:59:49 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:59:49 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:59:49 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 04:59:49 user nova-compute[74805]: DEBUG nova.objects.instance [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lazy-loading 'flavor' on Instance uuid 1d786dce-e06c-4b52-b399-d7a71858314b {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:59:49 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-ee9f5187-4112-442b-9245-bb2c8a985ffe tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.564s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:59:50 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:59:50 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 04:59:50 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Rebuilding the list of instances to heal {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 04:59:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-1d786dce-e06c-4b52-b399-d7a71858314b" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 04:59:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-1d786dce-e06c-4b52-b399-d7a71858314b" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 04:59:50 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 04:59:50 user nova-compute[74805]: DEBUG nova.objects.instance [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lazy-loading 'info_cache' on Instance uuid 1d786dce-e06c-4b52-b399-d7a71858314b {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 04:59:50 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Updating instance_info_cache with network_info: [{"id": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "address": "fa:16:3e:50:a1:75", "network": {"id": "6e9ff022-e661-4a79-aca7-18f30f23041f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-214841182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aff64a19c18461e85b60ee9d4984eb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa934aede-0d", "ovs_interfaceid": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 04:59:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-1d786dce-e06c-4b52-b399-d7a71858314b" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 04:59:50 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 04:59:50 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 04:59:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:59:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:59:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:59:50 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 04:59:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:59:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:59:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 04:59:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 04:59:51 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:59:51 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 04:59:51 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=8937MB free_disk=25.021018981933594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 04:59:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 04:59:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 04:59:51 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 1d786dce-e06c-4b52-b399-d7a71858314b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 04:59:51 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 04:59:51 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 04:59:51 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 04:59:51 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 04:59:51 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 04:59:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 04:59:53 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 04:59:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:00:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:00:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:00:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 05:00:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:00:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:00:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:00:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:00:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:00:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:00:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 05:00:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:00:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:00:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:00:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:00:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "1d786dce-e06c-4b52-b399-d7a71858314b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:00:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:00:19 user nova-compute[74805]: DEBUG nova.objects.instance [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lazy-loading 'flavor' on Instance uuid 1d786dce-e06c-4b52-b399-d7a71858314b {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:00:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:00:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "1d786dce-e06c-4b52-b399-d7a71858314b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:00:19 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:00:19 user nova-compute[74805]: INFO nova.compute.manager [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Attaching volume 21ed2f95-f915-4150-b190-4a17668c117c to /dev/vdb
Nov 15 05:00:20 user nova-compute[74805]: DEBUG os_brick.utils [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:00:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:00:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:00:20 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdf2e95-500f-40d1-9b4b-1b86e89af556]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f247c06c6c18\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:00:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:00:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:00:20 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5df87b2-eadf-4adc-9f52-62a008323b15]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:00:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:00:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:00:20 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bf8b29-07a7-48a0-a6d3-dd75fdd39795]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:00:20 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68f28b8-7169-493c-95e2-e4f9ec76da49]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:00:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Running cmd (subprocess): nvme version {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:00:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] 'nvme version' failed. Not Retrying. {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:00:20 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] nvme not present on system {{(pid=74805) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:00:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:00:20 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:00:20 user nova-compute[74805]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:00:20 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d43ebde-1016-49ce-a2d6-1887cbd32856]: (4, '') {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:00:20 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74805) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:00:20 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:00:20 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.lightos [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] LIGHTOS: no hostnqn found. {{(pid=74805) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:00:20 user nova-compute[74805]: DEBUG os_brick.utils [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f247c06c6c18', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:00:20 user nova-compute[74805]: DEBUG nova.virt.block_device [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Updating existing volume attachment record: e0b2011a-6f89-4eff-8a92-c4497a555568 {{(pid=74805) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:00:21 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:00:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Calling os-brick to attach iSCSI Volume {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrliqBQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:00:25 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:00:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:00:25 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:00:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:00:25 user nova-compute[74805]: INFO os_brick.initiator.connectors.iscsi [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c -p 172.16.0.220:3260 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2b456a-678c-46c7-924f-993de3c2e6d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:00:25 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c -p 172.16.0.220:3260 --interface default --op new {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b4e16c-5ed7-426b-8f66-b37ea78e462a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c] added\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c] added
Nov 15 05:00:25 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd72664c-b715-4a3d-9135-4444a1594b26]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c6cca8-cd08-45d1-ba11-808cfa8fb9a8]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wrliqBQv {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wrliqBQv" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[255c4ba2-5859-4bf2-bee4-fb6e0060032b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wrliqBQv'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1443c0-039b-4e7e-9356-17552a67880f]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd047e0-32ec-43ae-8181-5bc1af61592b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 05:00:25 user nova-compute[74805]:  {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 05:00:25 user nova-compute[74805]:  {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:00:25 user nova-compute[74805]: WARNING os_brick.initiator.connectors.iscsi [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 05:00:25 user nova-compute[74805]: 
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c -p 172.16.0.220:3260 --login {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1212fd51-eeea-49e9-ab98-697e9494f1f5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c, portal: 172.16.0.220,3260]
Nov 15 05:00:25 user nova-compute[74805]: Login to [iface: default, target: iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c, portal: 172.16.0.220,3260] successful.
Nov 15 05:00:25 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f075790-e914-4025-88ef-b1301df3e33b]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadca2e7-8bd4-4b15-8525-fc441ba23063]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c (non-flash)
Nov 15 05:00:25 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c (non-flash)
Nov 15 05:00:25 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Connected to 172.16.0.220:3260 {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=74805) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74805) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d5f6c1-0742-4c3a-9c37-7e2242e02103]: (4, ('- - 0', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:00:25 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:00:26 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74805) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:00:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrliqBQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74805) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:00:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:00:26 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23932303863666632', 'path': '/dev/sdb'} {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:00:26 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932303863666632', 'path': '/dev/sdb'} {{(pid=74805) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:00:26 user nova-compute[74805]: DEBUG nova.objects.instance [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lazy-loading 'flavor' on Instance uuid 1d786dce-e06c-4b52-b399-d7a71858314b {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:00:26 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 05:00:26 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:00:26 user nova-compute[74805]:   <source dev="/dev/sdb"/>
Nov 15 05:00:26 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:00:26 user nova-compute[74805]:   <serial>21ed2f95-f915-4150-b190-4a17668c117c</serial>
Nov 15 05:00:26 user nova-compute[74805]: </disk>
Nov 15 05:00:26 user nova-compute[74805]:  {{(pid=74805) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 05:00:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] No BDM found with device name vda, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:00:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74805) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:00:27 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] No VIF found with MAC fa:16:3e:50:a1:75, not building metadata {{(pid=74805) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:00:27 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-52694534-867e-465a-8953-1afb0e050218 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.462s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:00:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:00:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:00:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 05:00:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:00:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:00:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:00:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "1d786dce-e06c-4b52-b399-d7a71858314b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:00:29 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:00:29 user nova-compute[74805]: INFO nova.compute.manager [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Detaching volume 21ed2f95-f915-4150-b190-4a17668c117c
Nov 15 05:00:29 user nova-compute[74805]: INFO nova.virt.block_device [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Attempting to driver detach volume 21ed2f95-f915-4150-b190-4a17668c117c from mountpoint /dev/vdb
Nov 15 05:00:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Attempting to detach device vdb from instance 1d786dce-e06c-4b52-b399-d7a71858314b from the persistent domain config. {{(pid=74805) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 05:00:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:00:29 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:00:29 user nova-compute[74805]:   <source dev="/dev/sdb"/>
Nov 15 05:00:29 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:00:29 user nova-compute[74805]:   <serial>21ed2f95-f915-4150-b190-4a17668c117c</serial>
Nov 15 05:00:29 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:00:29 user nova-compute[74805]: </disk>
Nov 15 05:00:29 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:00:29 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Successfully detached device vdb from instance 1d786dce-e06c-4b52-b399-d7a71858314b from the persistent domain config.
Nov 15 05:00:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1d786dce-e06c-4b52-b399-d7a71858314b from the live domain config. {{(pid=74805) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 05:00:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.guest [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:00:29 user nova-compute[74805]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:00:29 user nova-compute[74805]:   <source dev="/dev/sdb"/>
Nov 15 05:00:29 user nova-compute[74805]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:00:29 user nova-compute[74805]:   <serial>21ed2f95-f915-4150-b190-4a17668c117c</serial>
Nov 15 05:00:29 user nova-compute[74805]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:00:29 user nova-compute[74805]: </disk>
Nov 15 05:00:29 user nova-compute[74805]:  {{(pid=74805) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:00:29 user nova-compute[74805]: DEBUG nova.virt.libvirt.driver [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1d786dce-e06c-4b52-b399-d7a71858314b {{(pid=74805) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 05:00:31 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:00:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:00:37 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:00:37 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:00:37 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74805) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 05:00:38 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:00:41 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:00:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:00:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:00:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 05:00:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:00:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:00:43 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:00:44 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:00:46 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:00:48 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:00:48 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 05:00:49 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1d786dce-e06c-4b52-b399-d7a71858314b is timed out.
Nov 15 05:00:49 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Successfully detached device vdb from instance 1d786dce-e06c-4b52-b399-d7a71858314b from the live domain config.
Nov 15 05:00:49 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] calling os-brick to detach iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2f9c615180>, {'target_iqn': 'iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrliqBQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:00:49 user nova-compute[74805]: WARNING os_brick.initiator.connectors.base [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:00:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e97c7e-94b7-48bf-b97d-cba079b8ae0b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:00:49 user nova-compute[74805]: No targets found.
Nov 15 05:00:49 user nova-compute[74805]: iSNS:
Nov 15 05:00:49 user nova-compute[74805]: No targets found.
Nov 15 05:00:49 user nova-compute[74805]: STATIC:
Nov 15 05:00:49 user nova-compute[74805]: Target: iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c
Nov 15 05:00:49 user nova-compute[74805]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:00:49 user nova-compute[74805]:                 Iface Name: default
Nov 15 05:00:49 user nova-compute[74805]: FIRMWARE:
Nov 15 05:00:49 user nova-compute[74805]: No targets found.
Nov 15 05:00:49 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:00:49 user nova-compute[74805]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:00:49 user nova-compute[74805]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74805) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c', 0)] {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[899d586d-e457-45c4-8bf0-6a2d5b587510]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e13e79-4160-4143-bffc-06b27c326916]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c (non-flash)\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c (non-flash)
Nov 15 05:00:49 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c (non-flash)
Nov 15 05:00:49 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2f9c6713f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c'): ({'sdb'}, set())}) {{(pid=74805) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Removing single pathed devices sdb {{(pid=74805) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe53ae0c-874c-48d6-aadd-13397c4192a6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be0a62c-84b7-41cf-87b1-206d6f949b98]: (4, ('ok\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Flushing IO for device /dev/sdb {{(pid=74805) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5123cd4b-e0c9-41f0-a47b-28aec20f733c]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74805) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e60cc60-3183-4176-947f-fe737a2b1e60]: (4, ('1', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG os_brick.initiator.linuxscsi [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] SCSI volumes sdb have been removed. {{(pid=74805) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c')] {{(pid=74805) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:00:49 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:00:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:00:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabd30dc-8811-47df-8140-d3439e4d5d13]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:00:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:00:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c -p 172.16.0.220:3260 --logout {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:00:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:00:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c66b6e0-37a2-40e2-a190-c40e489a0100]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:00:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c, portal: 172.16.0.220,3260]
Nov 15 05:00:50 user nova-compute[74805]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c, portal: 172.16.0.220,3260] successful.
Nov 15 05:00:50 user nova-compute[74805]:  stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:00:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c -p 172.16.0.220:3260 --op delete {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:00:50 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21ed2f95-f915-4150-b190-4a17668c117c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:00:50 user nova-compute[74805]: DEBUG oslo.privsep.daemon [-] privsep: reply[66be2dc3-bf59-4cd3-afe0-4293b41d976f]: (4, ('', '')) {{(pid=85029) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:00:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74805) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:00:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.base [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:00:50 user nova-compute[74805]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] <== disconnect_volume: return (285ms) None {{(pid=74805) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:00:50 user nova-compute[74805]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Disconnected iSCSI Volume {{(pid=74805) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:00:50 user nova-compute[74805]: DEBUG nova.objects.instance [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lazy-loading 'flavor' on Instance uuid 1d786dce-e06c-4b52-b399-d7a71858314b {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:00:50 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-0e5f3ef0-8f95-4084-8d82-735ff5de172f tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.569s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:00:51 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:00:51 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:00:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:00:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:00:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:00:51 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 05:00:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:00:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:00:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk --force-share --output=json {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:00:51 user nova-compute[74805]: DEBUG oslo_concurrency.processutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74805) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:00:51 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:00:51 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:00:51 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=8945MB free_disk=25.020076751708984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 05:00:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:00:51 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:00:51 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Instance 1d786dce-e06c-4b52-b399-d7a71858314b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74805) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:00:51 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 05:00:51 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 05:00:52 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:00:52 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:00:52 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 05:00:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:00:53 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:00:53 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:00:53 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 05:00:53 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Rebuilding the list of instances to heal {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 05:00:53 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:00:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "refresh_cache-1d786dce-e06c-4b52-b399-d7a71858314b" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:00:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquired lock "refresh_cache-1d786dce-e06c-4b52-b399-d7a71858314b" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:00:53 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Forcefully refreshing network info cache for instance {{(pid=74805) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 05:00:53 user nova-compute[74805]: DEBUG nova.objects.instance [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lazy-loading 'info_cache' on Instance uuid 1d786dce-e06c-4b52-b399-d7a71858314b {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:00:53 user nova-compute[74805]: DEBUG nova.network.neutron [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Updating instance_info_cache with network_info: [{"id": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "address": "fa:16:3e:50:a1:75", "network": {"id": "6e9ff022-e661-4a79-aca7-18f30f23041f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-214841182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aff64a19c18461e85b60ee9d4984eb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa934aede-0d", "ovs_interfaceid": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:00:53 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Releasing lock "refresh_cache-1d786dce-e06c-4b52-b399-d7a71858314b" {{(pid=74805) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:00:53 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Updated the network info_cache for instance {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 05:00:58 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:01:02 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:01:02 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Cleaning up deleted instances {{(pid=74805) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 05:01:02 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] There are 0 instances to clean {{(pid=74805) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 05:01:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:01:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:01:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 05:01:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:01:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:01:03 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:01:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:01:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:01:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 05:01:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:01:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:01:08 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:01:13 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:01:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:01:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:01:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 05:01:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:01:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:01:18 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:01:23 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:01:28 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:01:30 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:01:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:01:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:01:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 05:01:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:01:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:01:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:01:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3fb2e2fb-a609-4d50-a167-d1536c6a49f7 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "1d786dce-e06c-4b52-b399-d7a71858314b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:01:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3fb2e2fb-a609-4d50-a167-d1536c6a49f7 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:01:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3fb2e2fb-a609-4d50-a167-d1536c6a49f7 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "1d786dce-e06c-4b52-b399-d7a71858314b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:01:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3fb2e2fb-a609-4d50-a167-d1536c6a49f7 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:01:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3fb2e2fb-a609-4d50-a167-d1536c6a49f7 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:01:33 user nova-compute[74805]: INFO nova.compute.manager [None req-3fb2e2fb-a609-4d50-a167-d1536c6a49f7 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Terminating instance
Nov 15 05:01:33 user nova-compute[74805]: DEBUG nova.compute.manager [None req-3fb2e2fb-a609-4d50-a167-d1536c6a49f7 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Start destroying the instance on the hypervisor. {{(pid=74805) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:01:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:01:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:01:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:01:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:01:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:01:33 user nova-compute[74805]: DEBUG nova.compute.manager [req-9cfd5722-0d70-45b5-a6fd-6ae857774c92 req-bea0c989-d52d-407c-9737-0545d2af073c service nova] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Received event network-vif-unplugged-a934aede-0db0-4ac2-90ae-cca05c77fbf7 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:01:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9cfd5722-0d70-45b5-a6fd-6ae857774c92 req-bea0c989-d52d-407c-9737-0545d2af073c service nova] Acquiring lock "1d786dce-e06c-4b52-b399-d7a71858314b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:01:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9cfd5722-0d70-45b5-a6fd-6ae857774c92 req-bea0c989-d52d-407c-9737-0545d2af073c service nova] Lock "1d786dce-e06c-4b52-b399-d7a71858314b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:01:33 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-9cfd5722-0d70-45b5-a6fd-6ae857774c92 req-bea0c989-d52d-407c-9737-0545d2af073c service nova] Lock "1d786dce-e06c-4b52-b399-d7a71858314b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:01:33 user nova-compute[74805]: DEBUG nova.compute.manager [req-9cfd5722-0d70-45b5-a6fd-6ae857774c92 req-bea0c989-d52d-407c-9737-0545d2af073c service nova] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] No waiting events found dispatching network-vif-unplugged-a934aede-0db0-4ac2-90ae-cca05c77fbf7 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:01:33 user nova-compute[74805]: DEBUG nova.compute.manager [req-9cfd5722-0d70-45b5-a6fd-6ae857774c92 req-bea0c989-d52d-407c-9737-0545d2af073c service nova] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Received event network-vif-unplugged-a934aede-0db0-4ac2-90ae-cca05c77fbf7 for instance with task_state deleting. {{(pid=74805) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:01:33 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:01:34 user nova-compute[74805]: INFO nova.virt.libvirt.driver [-] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Instance destroyed successfully.
Nov 15 05:01:34 user nova-compute[74805]: DEBUG nova.objects.instance [None req-3fb2e2fb-a609-4d50-a167-d1536c6a49f7 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lazy-loading 'resources' on Instance uuid 1d786dce-e06c-4b52-b399-d7a71858314b {{(pid=74805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:01:34 user nova-compute[74805]: DEBUG nova.virt.libvirt.vif [None req-3fb2e2fb-a609-4d50-a167-d1536c6a49f7 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T04:55:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-672169126',display_name='tempest-SnapshotDataIntegrityTests-server-672169126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-672169126',id=53,image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOCmr2zA7VkJ979UR7BPs/ZcsKwB5MEYYTQ0pH76KIRA79yZaHxCl0oMM26oWr7c2hoeFWIZ7AL2t0q2AsR+AH6Yl2U31Ny5zCH+W9PSmyT9q+wLUvASUe7fQdngltvtQ==',key_name='tempest-keypair-1112931856',keypairs=<?>,launch_index=0,launched_at=2023-11-15T04:55:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7aff64a19c18461e85b60ee9d4984eb3',ramdisk_id='',reservation_id='r-hnl0mkxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f5f2780a-c8f6-40c5-9044-7e9b73af604f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1537820554',owner_user_name='tempest-SnapshotDataIntegrityTests-1537820554-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T04:55:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a03ee5d41faf471daf6cf2372c74483b',uuid=1d786dce-e06c-4b52-b399-d7a71858314b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "address": "fa:16:3e:50:a1:75", "network": {"id": "6e9ff022-e661-4a79-aca7-18f30f23041f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-214841182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aff64a19c18461e85b60ee9d4984eb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa934aede-0d", "ovs_interfaceid": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:01:34 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3fb2e2fb-a609-4d50-a167-d1536c6a49f7 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Converting VIF {"id": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "address": "fa:16:3e:50:a1:75", "network": {"id": "6e9ff022-e661-4a79-aca7-18f30f23041f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-214841182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aff64a19c18461e85b60ee9d4984eb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa934aede-0d", "ovs_interfaceid": "a934aede-0db0-4ac2-90ae-cca05c77fbf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:01:34 user nova-compute[74805]: DEBUG nova.network.os_vif_util [None req-3fb2e2fb-a609-4d50-a167-d1536c6a49f7 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:a1:75,bridge_name='br-int',has_traffic_filtering=True,id=a934aede-0db0-4ac2-90ae-cca05c77fbf7,network=Network(6e9ff022-e661-4a79-aca7-18f30f23041f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa934aede-0d') {{(pid=74805) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:01:34 user nova-compute[74805]: DEBUG os_vif [None req-3fb2e2fb-a609-4d50-a167-d1536c6a49f7 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:a1:75,bridge_name='br-int',has_traffic_filtering=True,id=a934aede-0db0-4ac2-90ae-cca05c77fbf7,network=Network(6e9ff022-e661-4a79-aca7-18f30f23041f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa934aede-0d') {{(pid=74805) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:01:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:01:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa934aede-0d, bridge=br-int, if_exists=True) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:01:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:01:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:01:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:01:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=06ae7fdc-d2de-4d5b-a061-0cb080c3d69a) {{(pid=74805) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:01:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:01:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:01:34 user nova-compute[74805]: INFO os_vif [None req-3fb2e2fb-a609-4d50-a167-d1536c6a49f7 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:a1:75,bridge_name='br-int',has_traffic_filtering=True,id=a934aede-0db0-4ac2-90ae-cca05c77fbf7,network=Network(6e9ff022-e661-4a79-aca7-18f30f23041f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa934aede-0d')
Nov 15 05:01:34 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-3fb2e2fb-a609-4d50-a167-d1536c6a49f7 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Deleting instance files /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b_del
Nov 15 05:01:34 user nova-compute[74805]: INFO nova.virt.libvirt.driver [None req-3fb2e2fb-a609-4d50-a167-d1536c6a49f7 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Deletion of /opt/stack/data/nova/instances/1d786dce-e06c-4b52-b399-d7a71858314b_del complete
Nov 15 05:01:34 user nova-compute[74805]: INFO nova.compute.manager [None req-3fb2e2fb-a609-4d50-a167-d1536c6a49f7 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 15 05:01:34 user nova-compute[74805]: DEBUG oslo.service.loopingcall [None req-3fb2e2fb-a609-4d50-a167-d1536c6a49f7 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74805) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:01:34 user nova-compute[74805]: DEBUG nova.compute.manager [-] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Deallocating network for instance {{(pid=74805) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:01:34 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] deallocate_for_instance() {{(pid=74805) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:01:34 user nova-compute[74805]: DEBUG nova.network.neutron [-] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Updating instance_info_cache with network_info: [] {{(pid=74805) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:01:34 user nova-compute[74805]: INFO nova.compute.manager [-] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Took 0.73 seconds to deallocate network for instance.
Nov 15 05:01:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3fb2e2fb-a609-4d50-a167-d1536c6a49f7 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:01:34 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3fb2e2fb-a609-4d50-a167-d1536c6a49f7 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:01:35 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-3fb2e2fb-a609-4d50-a167-d1536c6a49f7 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:01:35 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-3fb2e2fb-a609-4d50-a167-d1536c6a49f7 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:01:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3fb2e2fb-a609-4d50-a167-d1536c6a49f7 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:01:35 user nova-compute[74805]: INFO nova.scheduler.client.report [None req-3fb2e2fb-a609-4d50-a167-d1536c6a49f7 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Deleted allocations for instance 1d786dce-e06c-4b52-b399-d7a71858314b
Nov 15 05:01:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-3fb2e2fb-a609-4d50-a167-d1536c6a49f7 tempest-SnapshotDataIntegrityTests-1537820554 tempest-SnapshotDataIntegrityTests-1537820554-project-member] Lock "1d786dce-e06c-4b52-b399-d7a71858314b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.868s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:01:35 user nova-compute[74805]: DEBUG nova.compute.manager [req-e28d205a-1732-4335-9450-ff76ad753b09 req-8e14af9d-19c7-4e85-a75d-087bf44105ad service nova] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Received event network-vif-plugged-a934aede-0db0-4ac2-90ae-cca05c77fbf7 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:01:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e28d205a-1732-4335-9450-ff76ad753b09 req-8e14af9d-19c7-4e85-a75d-087bf44105ad service nova] Acquiring lock "1d786dce-e06c-4b52-b399-d7a71858314b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:01:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e28d205a-1732-4335-9450-ff76ad753b09 req-8e14af9d-19c7-4e85-a75d-087bf44105ad service nova] Lock "1d786dce-e06c-4b52-b399-d7a71858314b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:01:35 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [req-e28d205a-1732-4335-9450-ff76ad753b09 req-8e14af9d-19c7-4e85-a75d-087bf44105ad service nova] Lock "1d786dce-e06c-4b52-b399-d7a71858314b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:01:35 user nova-compute[74805]: DEBUG nova.compute.manager [req-e28d205a-1732-4335-9450-ff76ad753b09 req-8e14af9d-19c7-4e85-a75d-087bf44105ad service nova] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] No waiting events found dispatching network-vif-plugged-a934aede-0db0-4ac2-90ae-cca05c77fbf7 {{(pid=74805) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:01:35 user nova-compute[74805]: WARNING nova.compute.manager [req-e28d205a-1732-4335-9450-ff76ad753b09 req-8e14af9d-19c7-4e85-a75d-087bf44105ad service nova] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Received unexpected event network-vif-plugged-a934aede-0db0-4ac2-90ae-cca05c77fbf7 for instance with vm_state deleted and task_state None.
Nov 15 05:01:35 user nova-compute[74805]: DEBUG nova.compute.manager [req-e28d205a-1732-4335-9450-ff76ad753b09 req-8e14af9d-19c7-4e85-a75d-087bf44105ad service nova] [instance: 1d786dce-e06c-4b52-b399-d7a71858314b] Received event network-vif-deleted-a934aede-0db0-4ac2-90ae-cca05c77fbf7 {{(pid=74805) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:01:38 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:01:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:01:39 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:01:43 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:01:44 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:01:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:01:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:01:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 05:01:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:01:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:01:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:01:46 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:01:48 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:01:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:01:50 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:01:50 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 05:01:51 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:01:52 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:01:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:01:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:01:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:01:52 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Auditing locally available compute resources for user (node: user) {{(pid=74805) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 05:01:52 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:01:52 user nova-compute[74805]: WARNING nova.virt.libvirt.driver [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:01:52 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Hypervisor/Node resource view: name=user free_ram=9086MB free_disk=25.04720687866211GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74805) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 05:01:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:01:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:01:52 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 05:01:52 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74805) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 05:01:52 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Refreshing inventories for resource provider ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 05:01:52 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Updating ProviderTree inventory for provider ada87504-5552-4a33-b754-f9a54c67fe39 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 05:01:52 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Updating inventory in ProviderTree for provider ada87504-5552-4a33-b754-f9a54c67fe39 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 05:01:52 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Refreshing aggregate associations for resource provider ada87504-5552-4a33-b754-f9a54c67fe39, aggregates: None {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 05:01:52 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Refreshing trait associations for resource provider ada87504-5552-4a33-b754-f9a54c67fe39, traits: COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND {{(pid=74805) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 05:01:52 user nova-compute[74805]: DEBUG nova.compute.provider_tree [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed in ProviderTree for provider: ada87504-5552-4a33-b754-f9a54c67fe39 {{(pid=74805) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:01:52 user nova-compute[74805]: DEBUG nova.scheduler.client.report [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Inventory has not changed for provider ada87504-5552-4a33-b754-f9a54c67fe39 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74805) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:01:52 user nova-compute[74805]: DEBUG nova.compute.resource_tracker [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Compute_service record updated for user:user {{(pid=74805) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 05:01:52 user nova-compute[74805]: DEBUG oslo_concurrency.lockutils [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.373s {{(pid=74805) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:01:53 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:01:53 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Starting heal instance info cache {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 05:01:53 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Rebuilding the list of instances to heal {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 05:01:53 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Didn't find any instances for network info cache update. {{(pid=74805) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 05:01:54 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:01:54 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:01:54 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 05:01:54 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:01:54 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:01:54 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:01:59 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:02:04 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:02:09 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:02:14 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:02:19 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:02:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:02:24 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:02:26 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:02:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:02:29 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:02:34 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:02:39 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:02:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:02:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:02:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74805) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 05:02:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:02:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74805) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:02:39 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:02:44 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:02:45 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:02:46 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:02:46 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:02:48 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:02:49 user nova-compute[74805]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74805) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:02:51 user nova-compute[74805]: DEBUG oslo_service.periodic_task [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74805) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:02:51 user nova-compute[74805]: DEBUG nova.compute.manager [None req-cd8efc45-b1cc-4b5f-bfc3-db614ba88a28 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74805) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}